-- Logs begin at Tue 2022-09-13 19:06:49 UTC, end at Tue 2022-09-13 20:19:34 UTC. -- Sep 13 19:42:29.619092 dv-cinder-828807-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 13 19:42:29.627098 dv-cinder-828807-6-smb devstack@keystone.service[81543]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 13 19:42:29.629106 dv-cinder-828807-6-smb devstack@keystone.service[81543]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 13 19:42:29 2022] *** Sep 13 19:42:29.629106 dv-cinder-828807-6-smb devstack@keystone.service[81543]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 13 19:42:29.629106 dv-cinder-828807-6-smb devstack@keystone.service[81543]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 13 19:42:29.629106 dv-cinder-828807-6-smb devstack@keystone.service[81543]: nodename: dv-cinder-828807-6-smb Sep 13 19:42:29.629106 dv-cinder-828807-6-smb devstack@keystone.service[81543]: machine: x86_64 Sep 13 19:42:29.629106 dv-cinder-828807-6-smb devstack@keystone.service[81543]: clock source: unix Sep 13 19:42:29.629496 dv-cinder-828807-6-smb devstack@keystone.service[81543]: pcre jit disabled Sep 13 19:42:29.629496 dv-cinder-828807-6-smb devstack@keystone.service[81543]: detected number of CPU cores: 4 Sep 13 19:42:29.629496 dv-cinder-828807-6-smb devstack@keystone.service[81543]: current working directory: / Sep 13 19:42:29.629496 dv-cinder-828807-6-smb devstack@keystone.service[81543]: detected binary path: /usr/bin/uwsgi-core Sep 13 19:42:29.629496 dv-cinder-828807-6-smb devstack@keystone.service[81543]: your processes number limit is 47680 Sep 13 19:42:29.629496 dv-cinder-828807-6-smb devstack@keystone.service[81543]: your memory page size is 4096 bytes Sep 13 19:42:29.629496 dv-cinder-828807-6-smb devstack@keystone.service[81543]: detected max file descriptor number: 2048 Sep 13 19:42:29.629496 dv-cinder-828807-6-smb devstack@keystone.service[81543]: lock engine: pthread robust mutexes Sep 13 19:42:29.629496 dv-cinder-828807-6-smb devstack@keystone.service[81543]: thunder lock: enabled Sep 13 19:42:29.629496 dv-cinder-828807-6-smb devstack@keystone.service[81543]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 13 19:42:29.630210 dv-cinder-828807-6-smb devstack@keystone.service[81543]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 13 19:42:29.669784 dv-cinder-828807-6-smb devstack@keystone.service[81543]: Python main interpreter initialized at 0x55970cd069c0 Sep 13 19:42:29.669784 dv-cinder-828807-6-smb devstack@keystone.service[81543]: python threads support enabled Sep 13 19:42:29.669784 dv-cinder-828807-6-smb devstack@keystone.service[81543]: your server socket listen backlog is limited to 100 connections Sep 13 19:42:29.669784 dv-cinder-828807-6-smb devstack@keystone.service[81543]: your mercy for graceful operations on workers is 90 seconds Sep 13 19:42:29.670145 dv-cinder-828807-6-smb devstack@keystone.service[81543]: mapped 403077 bytes (393 KB) for 2 cores Sep 13 19:42:29.670265 dv-cinder-828807-6-smb devstack@keystone.service[81543]: *** Operational MODE: preforking *** Sep 13 19:42:29.670540 dv-cinder-828807-6-smb devstack@keystone.service[81543]: *** uWSGI is running in multiple interpreter mode *** Sep 13 19:42:29.670540 dv-cinder-828807-6-smb devstack@keystone.service[81543]: spawned uWSGI master process (pid: 81543) Sep 13 19:42:29.670740 dv-cinder-828807-6-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 13 19:42:29.673715 dv-cinder-828807-6-smb devstack@keystone.service[81543]: spawned uWSGI worker 1 (pid: 81554, cores: 1) Sep 13 19:42:29.673715 dv-cinder-828807-6-smb devstack@keystone.service[81543]: spawned uWSGI worker 2 (pid: 81555, cores: 1) Sep 13 19:42:29.673715 dv-cinder-828807-6-smb devstack@keystone.service[81543]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 13 19:42:34.006343 dv-cinder-828807-6-smb devstack@keystone.service[81554]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:42:34.006343 dv-cinder-828807-6-smb devstack@keystone.service[81554]: from cryptography.utils import int_from_bytes Sep 13 19:42:34.007108 dv-cinder-828807-6-smb devstack@keystone.service[81554]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:42:34.007108 dv-cinder-828807-6-smb devstack@keystone.service[81554]: from cryptography.utils import int_from_bytes Sep 13 19:42:34.007254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:42:34.007254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: from cryptography.utils import int_from_bytes Sep 13 19:42:34.007254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 13 19:42:34.007254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: from cryptography.utils import int_from_bytes Sep 13 19:42:34.060217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 19:42:34.060400 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 13 19:42:34.060489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 19:42:34.060585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 13 19:42:34.060660 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] command line args: [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 19:42:34.060731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] command line args: [] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 13 19:42:34.060840 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 19:42:34.060920 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 13 19:42:34.061007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ================================================================================ {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 19:42:34.061085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ================================================================================ {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 13 19:42:34.061256 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] admin_token = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.061336 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] admin_token = **** {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.061496 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] config_dir = [] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.061574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] config_dir = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.061681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.061786 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.061920 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] config_source = [] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.062002 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] config_source = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.062075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] debug = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.062153 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] debug = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.062221 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.062547 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.062642 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.062703 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.062771 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.062836 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.062999 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.063133 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.063244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.063347 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.063453 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.063555 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] list_limit = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.063663 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_config_append = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.063764 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] log_config_append = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.063868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.063962 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.064073 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_dir = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.064175 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] log_dir = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.064276 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_file = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.064371 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] log_file = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.064477 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.064564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.064694 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.064771 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.064892 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.064973 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.065088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.065171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.065301 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.065384 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.065384 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.065519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.065637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.065789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.065867 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.066164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.066164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.066346 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.066458 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.066542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.066620 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.066741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.066817 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.066937 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.067013 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.067142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.067224 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.067296 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.067472 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.067555 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.067955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.068046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.59/identity {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.068120 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] publish_errors = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.068242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] publish_errors = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.068362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.068442 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.068565 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.068643 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.068806 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.068920 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.068995 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.069128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.069204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.069326 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.069403 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] standard_threads = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.069517 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] standard_threads = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.069626 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.069726 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.069891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.069984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.070058 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.070133 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.070227 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] use_journal = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.070303 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] use_journal = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.070402 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] use_json = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.070490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] use_json = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.070563 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] use_stderr = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.070638 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] use_stderr = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.070716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] use_syslog = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.070839 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] use_syslog = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.070946 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.071036 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 13 19:42:34.071200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.071280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.071434 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.071512 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.071690 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.071844 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.071919 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.071996 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.072166 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.072244 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.072404 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.072494 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.072653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.072736 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.072887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.072963 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.073132 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.073219 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.073375 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.073451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.073622 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.073721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.073881 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.073968 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.074659 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.074735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.074896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.074984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.075141 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.075220 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.075386 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.075469 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.075621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.075703 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.075873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.075950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.076123 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.076200 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.076365 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.076443 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.076599 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.076675 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.076848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.076929 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.077105 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.077181 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.077353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.077429 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.077598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.077674 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.077857 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.077947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.078104 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.078180 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.078303 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.078381 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.078539 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.078616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.078784 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.078861 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.079028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.079104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.079254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.079336 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.079482 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.079561 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.079727 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.079803 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.079971 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.080046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.080204 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.080282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.080448 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.080524 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.080678 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.080758 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.080909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.080986 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.081142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.081218 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.081367 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.081444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.081594 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.081670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.081843 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.081958 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.082071 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.082158 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.082303 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.082373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.082548 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.082623 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.082778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.082857 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.083022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.083095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.083246 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.083321 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.083482 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.083595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.083715 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.083803 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.083960 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.084044 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.084186 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.084264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.084422 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.084601 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.084680 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.084753 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.084881 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.084959 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.085116 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.085195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.085351 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.085428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.085577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.085649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.090880 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.090978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.091053 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.091137 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.091211 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.091282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.091360 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.091434 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.091514 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.091598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.091671 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.091742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.091814 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.091893 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.091966 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.092037 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.092107 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.092184 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.092256 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.092339 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.092412 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.092484 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.092554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.092624 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.092705 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.092789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.092863 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.092934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.093005 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.093073 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.093143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.093287 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.093362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.093433 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.093503 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.093574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.093574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.093826 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.093906 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.093977 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.094056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.094135 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.094216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.094298 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.094383 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.094457 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.094528 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.094599 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.094669 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.094740 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.094819 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.094892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.094964 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.095034 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.095113 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.095186 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.095266 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.095338 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.095416 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.095488 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.095560 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.095631 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.095709 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.095782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.095948 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.096031 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.096100 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.096181 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.096263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.096336 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.096412 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.096484 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.096551 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.096616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.096689 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.096766 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.096877 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.096954 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.097021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.097095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.097169 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.097249 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.097317 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.097383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.097454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.097524 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.097594 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.097672 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.097757 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.097829 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.097900 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.097970 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.098053 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.098127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.098204 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.098302 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.098391 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.external = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.098464 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] auth.external = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.098542 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.098614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.098693 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.098768 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.098839 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.098910 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.098981 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.password = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.099051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] auth.password = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.099130 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] auth.token = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.099203 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] auth.token = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.099274 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.099344 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.099415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.099485 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.099564 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.099637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.099637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.099773 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.099853 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.099926 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.100035 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.100119 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.100265 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.100342 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.100498 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] credential.caching = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.100575 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.100742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.100822 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.100988 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.101072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.101231 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.101318 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.101471 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.101550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.101729 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.101810 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.101968 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.102058 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.102213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.102290 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.102467 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.102545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.102706 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.102793 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.102960 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.103045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.103237 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.103318 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.103481 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.103636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.103739 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.103817 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.103980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.104058 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.104233 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.104320 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.104469 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.104559 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] federation.caching = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.104700 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.104778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.104943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.105037 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.105185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.105264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.105440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.105518 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.105683 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.105817 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.105941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.106019 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.106192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.106368 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.106461 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.106536 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.106668 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.106904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.106982 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.107149 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.107228 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.107385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.107465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.107632 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.107713 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.caching = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.107879 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.107958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.108121 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.108203 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.108349 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.108427 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.108588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.108667 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.108818 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.108897 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.109051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.109128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.109286 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.109370 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.109532 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.109621 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.109791 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.109871 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.110026 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.110104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.110254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.110333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.110482 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.110561 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.110724 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.110803 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.110968 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.111048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.111213 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.111292 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.111459 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.111550 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.111702 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.111780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.111959 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.112036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.112195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.112280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.112425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.112503 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.112663 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.112752 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.112937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.113039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.113136 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.113216 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.113379 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.113459 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.113620 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.113761 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.113883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.113962 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.114115 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.114192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.114348 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.118189 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.118273 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.118340 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.118340 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.118468 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.118468 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.118599 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.118674 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.118746 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.118818 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.118889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.118960 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.119039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.119113 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.119184 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.119255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.119327 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.119398 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.119478 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.119551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.119623 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.119701 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.119774 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.119852 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.119933 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.120007 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.120079 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.120150 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.120222 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.120299 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.120380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.120380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.120500 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.120571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.120642 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.120713 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.120792 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.120866 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.120960 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.121036 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.121107 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.121179 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.121259 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.121333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.121404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.121476 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.121547 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.121619 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.121758 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.121836 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.121908 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.121980 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.122053 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.122125 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.122208 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.122283 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.122355 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.122428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.122499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.122571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.122651 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.122725 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.122797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.122797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.122927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.122998 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.123082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.123199 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.123275 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.123347 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.123418 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.123479 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.123548 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.123621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.123693 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.123771 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.123844 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.123916 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.123995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.124069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.124141 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.124212 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.124282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.124362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.124438 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.124517 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.124591 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.124663 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.124734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.124865 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.124947 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.125100 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.125179 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.125344 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.125423 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.125581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.125660 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.125841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.125920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.126081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.126159 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.126308 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.126384 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.126542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.126622 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.126777 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.126856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.127013 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.127093 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.127247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.127324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.127492 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.127571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.127724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.127802 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.127952 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.128029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.128185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.128263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.128426 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] resource.caching = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.128506 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.128673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.128757 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.128912 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.128991 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.129163 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.129244 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.129418 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.129497 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.129655 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.129780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.129912 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.129992 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.130157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.130240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.130389 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.130467 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.130624 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] role.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.130704 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.130856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] role.caching = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.130934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] role.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.131089 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.131166 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] role.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.131316 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.131396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.131562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.131641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.131807 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.131884 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.132048 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.132134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.132292 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.132372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.132535 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.132613 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.132778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.132858 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.133023 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.133100 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.133257 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.133335 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.133483 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.133559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.133753 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.133847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.134001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.134081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.134246 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.134325 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.134488 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.134644 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.134880 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.134968 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.135117 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.135197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.135369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.135446 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.135621 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.135709 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.135872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.135952 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.136373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.136458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.137117 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.137213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.137371 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.137450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.137609 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.137719 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.137867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.137960 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.138096 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.138175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.138326 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.138404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.138553 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.138639 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.138802 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.138882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.139054 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.139136 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.139291 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.139382 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.139524 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.139603 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.139753 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.139830 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.139979 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.140066 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.140217 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] token.caching = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.140300 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.140460 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.140539 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.140705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.140806 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.140939 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.141018 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.141185 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.141263 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.141424 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.141511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.141657 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.141756 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.141924 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.142003 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.142166 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.142259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.142445 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.142531 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.142636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.142714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.142869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.142956 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.143101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.143179 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.143350 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.143429 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.143590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.143679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.143832 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.143914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.144072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.144198 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.144352 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.connection = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.144441 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.144587 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.144678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.connection = **** {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.144835 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.144915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.145072 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.145151 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.145310 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.145397 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.145544 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.145622 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.145800 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.145882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.146035 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.148155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.148155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.148285 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.148346 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.148419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.148419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.148537 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.148610 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.148713 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.148817 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.148898 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.148971 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.149052 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.149127 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.149200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.149271 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.149342 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.149414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.149494 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.149568 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.149641 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.149734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.149810 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.149882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81554) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 19:42:34.149967 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 13 19:42:34.149967 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81555) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 13 19:42:34.178094 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.178318 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.178544 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.178628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.178773 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.178997 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.186886 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.187340 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.220582 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.220814 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.221057 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.221292 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.278899 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.279123 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.327252 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.327497 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.327593 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.327709 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.495565 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.495797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.496532 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.496628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.496752 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.496931 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.497042 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.497166 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.497322 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.497604 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.497907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.498184 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.520684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.520910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.520994 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.521136 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.521328 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.521427 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.521564 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.521747 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.521833 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.522007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.522101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.522383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.522659 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.522935 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.533066 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.533303 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.559389 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.559616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.559699 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.559840 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.560060 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.560159 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.560277 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.560457 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.560539 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.560692 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81554) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.560844 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.561126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.561407 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.561701 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81555) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 13 19:42:34.577830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.578039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 19:42:34.578381 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.578583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 19:42:34.578789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.578872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.579110 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 19:42:34.579202 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.579369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.579630 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.579712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.579943 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 13 19:42:34.580278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.580604 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.580929 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.581253 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.589161 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.589437 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.589751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.590044 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.591312 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.591699 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.592034 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.592387 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.596975 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.599609 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.599895 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.600184 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.600557 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.600772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.601025 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.601286 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.601558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.601861 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.602135 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.602410 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.602680 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.602855 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.603145 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.603435 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.603721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.604005 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.604266 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.604539 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.604816 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.605091 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.605389 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.605661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.625740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.627194 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.627480 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.629104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.630600 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.630889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.632154 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.632438 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.632720 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.635576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.635920 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.636472 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.639909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.640232 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.643452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.643739 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.645797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.646098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.646392 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.646683 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.646959 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.647235 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.647506 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.647779 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.649399 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.649722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.650014 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.650328 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.650586 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.656186 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.656186 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.656186 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.663260 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.663537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.667125 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.667370 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.667454 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.670671 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.670970 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.671348 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.674600 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.674900 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.675187 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.678395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.679117 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.685023 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.685023 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.685023 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.685210 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.685279 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.685279 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.685279 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.686083 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.686386 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.686675 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.686965 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.687259 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.687550 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.699785 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.700075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.700345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.700606 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.704064 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.704359 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.704628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.704891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.707449 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.708984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.710538 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.710816 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.711780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.713323 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.713484 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.713793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.714080 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.714364 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.714788 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.714968 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.715245 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.717960 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.718247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.718540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.718829 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.719214 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.725943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.726228 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.726509 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.726791 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.727170 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.727454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.727743 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.730506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.730794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.731080 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.731365 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.731750 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.732040 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.732326 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.743123 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.746943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.748311 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.749465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.750944 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.751306 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.752398 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.752684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.753089 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.756325 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.756325 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.757367 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.757653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.758074 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.759470 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.760914 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.764629 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.765028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.765283 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.765412 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.765587 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.766779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.769762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.770160 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.770453 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.770734 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.773351 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.773643 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.773950 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.778688 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.778984 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.779265 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.780893 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81554) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.781180 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.784941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.784941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.784941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.784941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.784941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.784941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.784941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.785373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.785373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.785373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.785373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.785373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81554) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.786230 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81555) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 13 19:42:34.786517 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.786802 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.787093 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.787373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.787657 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.787934 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.788216 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.788487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.788768 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.789051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.789326 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.789594 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.789890 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81555) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 13 19:42:34.819234 dv-cinder-828807-6-smb devstack@keystone.service[81554]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55970cd069c0 pid: 81554 (default app) Sep 13 19:42:34.822546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5086f71-ae7e-4380-98bf-cdf5a6aa3519 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:34.822833 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5086f71-ae7e-4380-98bf-cdf5a6aa3519 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:34.823107 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5086f71-ae7e-4380-98bf-cdf5a6aa3519 None None] PATH_INFO: `/v3` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:34.825016 dv-cinder-828807-6-smb devstack@keystone.service[81555]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55970cd069c0 pid: 81555 (default app) Sep 13 19:42:34.827331 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 791 bytes} [Tue Sep 13 19:42:34 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:42.528678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18788f34-22c6-442f-8089-3fbeb2ba51c3 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:42.529208 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18788f34-22c6-442f-8089-3fbeb2ba51c3 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:42.529208 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18788f34-22c6-442f-8089-3fbeb2ba51c3 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:42.533493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1/2] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:42:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:42.539421 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abe11e-7127-4ea5-8314-7026fa9d5f44 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:42.539895 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abe11e-7127-4ea5-8314-7026fa9d5f44 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:42.540056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abe11e-7127-4ea5-8314-7026fa9d5f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:42.612319 dv-cinder-828807-6-smb devstack@keystone.service[81554]: INFO dbcounter [None req-f9abe11e-7127-4ea5-8314-7026fa9d5f44 None None] Registered counter for database keystone Sep 13 19:42:42.631609 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG oslo_db.sqlalchemy.engines [None req-f9abe11e-7127-4ea5-8314-7026fa9d5f44 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81554) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:42:42.638059 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writer thread running {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:42:42.816482 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG passlib.handlers.bcrypt [None req-f9abe11e-7127-4ea5-8314-7026fa9d5f44 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81554) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 19:42:42.816795 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG passlib.handlers.bcrypt [None req-f9abe11e-7127-4ea5-8314-7026fa9d5f44 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81554) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 19:42:42.874180 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f9abe11e-7127-4ea5-8314-7026fa9d5f44 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:42.875788 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f9abe11e-7127-4ea5-8314-7026fa9d5f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:43.003922 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 2/3] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:42 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 13 19:42:43.470961 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18788f34-22c6-442f-8089-3fbeb2ba51c3 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:43.539745 dv-cinder-828807-6-smb devstack@keystone.service[81555]: INFO dbcounter [None req-18788f34-22c6-442f-8089-3fbeb2ba51c3 None None] Registered counter for database keystone Sep 13 19:42:43.561376 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG oslo_db.sqlalchemy.engines [None req-18788f34-22c6-442f-8089-3fbeb2ba51c3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81555) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 13 19:42:43.567587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writer thread running {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 13 19:42:43.684987 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18788f34-22c6-442f-8089-3fbeb2ba51c3 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:43.689224 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bceac0-4b7d-4d84-aef6-8cec9e7ee0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:43.689879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bceac0-4b7d-4d84-aef6-8cec9e7ee0f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:43.690164 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bceac0-4b7d-4d84-aef6-8cec9e7ee0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:43.690437 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bceac0-4b7d-4d84-aef6-8cec9e7ee0f6 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:43.698570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bceac0-4b7d-4d84-aef6-8cec9e7ee0f6 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:43.750264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: WARNING keystone.common.rbac_enforcer.enforcer [None req-23bceac0-4b7d-4d84-aef6-8cec9e7ee0f6 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 19:42:43.750612 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bceac0-4b7d-4d84-aef6-8cec9e7ee0f6 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:43.759968 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 2/4] 10.222.0.59 () {58 vars in 1324 bytes} [Tue Sep 13 19:42:43 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 19:42:43.766691 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abe11e-7127-4ea5-8314-7026fa9d5f44 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:43.783352 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abe11e-7127-4ea5-8314-7026fa9d5f44 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:43.789024 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5da790-b6d0-4362-9f28-47a88de326af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:43.790173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5da790-b6d0-4362-9f28-47a88de326af admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:43.790458 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5da790-b6d0-4362-9f28-47a88de326af admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:43.790734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5da790-b6d0-4362-9f28-47a88de326af admin admin] PATH_INFO: `/v3/projects/a7c8626d92bb447c910575be75fc0558` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:43.792307 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5da790-b6d0-4362-9f28-47a88de326af admin admin] RBAC: Authorizing `identity:get_project(project_id=a7c8626d92bb447c910575be75fc0558)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:43.845030 dv-cinder-828807-6-smb devstack@keystone.service[81554]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ef5da790-b6d0-4362-9f28-47a88de326af admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 13 19:42:43.845375 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5da790-b6d0-4362-9f28-47a88de326af admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:43.849879 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 3/5] 10.222.0.59 () {56 vars in 1207 bytes} [Tue Sep 13 19:42:43 2022] GET /identity/v3/projects/a7c8626d92bb447c910575be75fc0558 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:45.964130 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3a0e5-116f-4d0e-b168-f694595ec5d2 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:45.964572 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3a0e5-116f-4d0e-b168-f694595ec5d2 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:45.964680 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea3a0e5-116f-4d0e-b168-f694595ec5d2 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:45.968797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 3/6] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:42:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:45.974139 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99472921-ee10-4b0c-b884-86c000b566e3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:45.974563 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99472921-ee10-4b0c-b884-86c000b566e3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:45.974695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99472921-ee10-4b0c-b884-86c000b566e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:45.994327 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-99472921-ee10-4b0c-b884-86c000b566e3 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:45.995837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-99472921-ee10-4b0c-b884-86c000b566e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:46.004120 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 4/7] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:45 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 13 19:42:46.271022 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3a0e5-116f-4d0e-b168-f694595ec5d2 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:46.283006 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea3a0e5-116f-4d0e-b168-f694595ec5d2 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:46.287180 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296f1a8-8b85-4518-a62f-2c64598053f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:46.287778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296f1a8-8b85-4518-a62f-2c64598053f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:46.288058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296f1a8-8b85-4518-a62f-2c64598053f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:46.288330 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296f1a8-8b85-4518-a62f-2c64598053f1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:46.296427 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296f1a8-8b85-4518-a62f-2c64598053f1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:46.298218 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2296f1a8-8b85-4518-a62f-2c64598053f1 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:46.306877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 4/8] 10.222.0.59 () {58 vars in 1324 bytes} [Tue Sep 13 19:42:46 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 19:42:46.312759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99472921-ee10-4b0c-b884-86c000b566e3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:46.321808 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99472921-ee10-4b0c-b884-86c000b566e3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:46.326132 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96896678-4f8b-4348-b3f0-3991cb794d95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:46.326751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96896678-4f8b-4348-b3f0-3991cb794d95 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:46.327035 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96896678-4f8b-4348-b3f0-3991cb794d95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:46.327312 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96896678-4f8b-4348-b3f0-3991cb794d95 admin admin] PATH_INFO: `/v3/users/7e2932bd7e7b4ca08c435ee8928789ee` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:46.328620 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96896678-4f8b-4348-b3f0-3991cb794d95 admin admin] RBAC: Authorizing `identity:get_user(user_id=7e2932bd7e7b4ca08c435ee8928789ee)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:46.330521 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96896678-4f8b-4348-b3f0-3991cb794d95 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:46.332034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 5/9] 10.222.0.59 () {56 vars in 1198 bytes} [Tue Sep 13 19:42:46 2022] GET /identity/v3/users/7e2932bd7e7b4ca08c435ee8928789ee => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:48.506031 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b05318-0136-4e16-8aab-fe96c41c77d0 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:48.506612 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b05318-0136-4e16-8aab-fe96c41c77d0 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:48.506612 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b05318-0136-4e16-8aab-fe96c41c77d0 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:48.507950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 5/10] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:42:48.513910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e1851-b674-4885-823f-e0b230e99f82 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:48.514354 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e1851-b674-4885-823f-e0b230e99f82 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:48.514441 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e1851-b674-4885-823f-e0b230e99f82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:48.536937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0c4e1851-b674-4885-823f-e0b230e99f82 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:48.538143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0c4e1851-b674-4885-823f-e0b230e99f82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:48.586222 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e0e1b-c2b1-4fc0-b410-d8e79666b5b3 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:48.586510 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e0e1b-c2b1-4fc0-b410-d8e79666b5b3 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:48.586790 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e0e1b-c2b1-4fc0-b410-d8e79666b5b3 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:48.588133 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 6/11] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:42:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:42:48.593798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819a1b6-9be9-4315-be15-e3f753461500 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:48.594083 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819a1b6-9be9-4315-be15-e3f753461500 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:48.594360 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b819a1b6-9be9-4315-be15-e3f753461500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:48.617937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 6/12] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:42:48.636028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG passlib.handlers.bcrypt [None req-b819a1b6-9be9-4315-be15-e3f753461500 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81555) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 13 19:42:48.636659 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG passlib.handlers.bcrypt [None req-b819a1b6-9be9-4315-be15-e3f753461500 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81555) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 13 19:42:48.685930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-b819a1b6-9be9-4315-be15-e3f753461500 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:48.687508 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b819a1b6-9be9-4315-be15-e3f753461500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:48.785798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 7/13] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:42:48.881051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e1851-b674-4885-823f-e0b230e99f82 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:48.905325 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:48.984460 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e1851-b674-4885-823f-e0b230e99f82 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:49.018444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f0270-2540-4506-8a20-514972afa23f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:49.019073 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f0270-2540-4506-8a20-514972afa23f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:49.019356 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f0270-2540-4506-8a20-514972afa23f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:49.019631 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823f0270-2540-4506-8a20-514972afa23f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:49.030891 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823f0270-2540-4506-8a20-514972afa23f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:42:49.039504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-823f0270-2540-4506-8a20-514972afa23f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:42:49.039504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:49.039504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:49.039504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:49.039504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:49.039504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:49.039504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:49.039504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:49.039504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:49.039504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:49.039504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:49.039504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:49.039504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:42:49.039504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:42:49.039504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:42:49.039504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:42:49.040626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:42:49.040626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:42:49.040626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:42:49.040626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:42:49.040626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:49.040626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:49.040626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:49.040626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:49.040626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:49.040626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:49.040626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:49.040626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:49.040626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:49.040626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:49.040626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:49.040626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:49.041546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:49.041546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:49.041546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:49.041546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:49.041546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:42:49.041546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:42:49.041546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:42:49.041546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:42:49.041546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:42:49.041546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:42:49.041546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:42:49.041546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:42:49.041546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 7/14] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:42:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:49.046985 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819a1b6-9be9-4315-be15-e3f753461500 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:49.051167 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f0270-2540-4506-8a20-514972afa23f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:49.131479 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:49.149040 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823f0270-2540-4506-8a20-514972afa23f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:49.150119 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b819a1b6-9be9-4315-be15-e3f753461500 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:49.152518 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:49.182606 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511b18f-1cd3-4987-ac2f-df1ce0393fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:49.183241 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511b18f-1cd3-4987-ac2f-df1ce0393fb1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:49.183522 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511b18f-1cd3-4987-ac2f-df1ce0393fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:49.183795 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9511b18f-1cd3-4987-ac2f-df1ce0393fb1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:49.188085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5c22f-38d6-4784-b8d7-2d68556dd1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:49.188939 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5c22f-38d6-4784-b8d7-2d68556dd1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:49.189220 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5c22f-38d6-4784-b8d7-2d68556dd1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:49.189493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac5c22f-38d6-4784-b8d7-2d68556dd1e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:49.190373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5c22f-38d6-4784-b8d7-2d68556dd1e6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:49.190682 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5c22f-38d6-4784-b8d7-2d68556dd1e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:49.192140 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac5c22f-38d6-4784-b8d7-2d68556dd1e6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:49.204540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 8/15] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:42:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:49.210158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5c22f-38d6-4784-b8d7-2d68556dd1e6 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:49.249964 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511b18f-1cd3-4987-ac2f-df1ce0393fb1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:49.251438 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9511b18f-1cd3-4987-ac2f-df1ce0393fb1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:49.308416 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac5c22f-38d6-4784-b8d7-2d68556dd1e6 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:49.328920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:49.341901 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efee53-f335-4c93-9946-d2c3136bb0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:49.342799 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efee53-f335-4c93-9946-d2c3136bb0c2 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:49.343077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efee53-f335-4c93-9946-d2c3136bb0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:49.343404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5efee53-f335-4c93-9946-d2c3136bb0c2 None admin] PATH_INFO: `/v3/users/7e2932bd7e7b4ca08c435ee8928789ee` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:49.344875 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5efee53-f335-4c93-9946-d2c3136bb0c2 None admin] RBAC: Authorizing `identity:get_user(user_id=7e2932bd7e7b4ca08c435ee8928789ee)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:49.346374 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5efee53-f335-4c93-9946-d2c3136bb0c2 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:49.346877 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 8/16] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:42:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:42:49.347921 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 9/17] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:42:49 2022] GET /identity/v3/users/7e2932bd7e7b4ca08c435ee8928789ee => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:49.352466 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511b18f-1cd3-4987-ac2f-df1ce0393fb1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:49.353201 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efee53-f335-4c93-9946-d2c3136bb0c2 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:49.388017 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:49.449584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9511b18f-1cd3-4987-ac2f-df1ce0393fb1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:49.453036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5efee53-f335-4c93-9946-d2c3136bb0c2 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:49.482683 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11c64a-04ed-43e3-a896-8140c4a0c143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:49.483302 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11c64a-04ed-43e3-a896-8140c4a0c143 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:49.483580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11c64a-04ed-43e3-a896-8140c4a0c143 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:49.483850 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11c64a-04ed-43e3-a896-8140c4a0c143 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:49.487194 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c65e2-93c6-49f2-b5b8-e58fd9f50205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:49.487818 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c65e2-93c6-49f2-b5b8-e58fd9f50205 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:49.488099 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c65e2-93c6-49f2-b5b8-e58fd9f50205 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:49.488371 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c65e2-93c6-49f2-b5b8-e58fd9f50205 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:49.489479 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c65e2-93c6-49f2-b5b8-e58fd9f50205 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:49.490954 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c65e2-93c6-49f2-b5b8-e58fd9f50205 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:49.492487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 10/18] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:49.493772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11c64a-04ed-43e3-a896-8140c4a0c143 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:49.495213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b11c64a-04ed-43e3-a896-8140c4a0c143 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:49.498614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c65e2-93c6-49f2-b5b8-e58fd9f50205 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:49.510550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-4b11c64a-04ed-43e3-a896-8140c4a0c143 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:49.510550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:49.510550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:49.510550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:49.510550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:49.510550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:49.510550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:49.510550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:49.510550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:49.510550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:49.510550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:49.510550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:49.510550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:49.510550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:49.510550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:49.510550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:49.511717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:49.511717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:49.511717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:49.511717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:49.511717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:49.511717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:49.511717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:49.511717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:49.511717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:49.511717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:49.511717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:49.511717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:49.511717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:49.511717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:49.511717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:49.511717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:49.511717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:49.512572 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:49.512572 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:49.512572 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:42:49.512572 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 9/19] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:49.517462 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11c64a-04ed-43e3-a896-8140c4a0c143 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:49.554125 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:49.603130 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c65e2-93c6-49f2-b5b8-e58fd9f50205 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:49.604597 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:49.619169 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b11c64a-04ed-43e3-a896-8140c4a0c143 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:49.637541 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bb7b8-e6c6-4e0e-bb50-62ba804934df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:49.638175 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bb7b8-e6c6-4e0e-bb50-62ba804934df None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:49.638454 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bb7b8-e6c6-4e0e-bb50-62ba804934df None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:49.638728 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bb7b8-e6c6-4e0e-bb50-62ba804934df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:49.639442 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94bb7b8-e6c6-4e0e-bb50-62ba804934df None admin] RBAC: Adding query filter params (role.id=cd02ef2043de492a8bff6c165485f255, scope.domain.id=default, user.id=7e2932bd7e7b4ca08c435ee8928789ee) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:49.639744 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94bb7b8-e6c6-4e0e-bb50-62ba804934df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:49.641197 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94bb7b8-e6c6-4e0e-bb50-62ba804934df None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:49.649067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 11/20] 10.222.0.59 () {56 vars in 1322 bytes} [Tue Sep 13 19:42:49 2022] GET /identity/v3/role_assignments?user.id=7e2932bd7e7b4ca08c435ee8928789ee&scope.domain.id=default&role.id=cd02ef2043de492a8bff6c165485f255 => generated 233 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:49.654697 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba11a8b-e7ec-464f-89a3-48c08a8a15e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:49.655420 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba11a8b-e7ec-464f-89a3-48c08a8a15e2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:49.655768 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba11a8b-e7ec-464f-89a3-48c08a8a15e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:49.656109 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba11a8b-e7ec-464f-89a3-48c08a8a15e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:49.656864 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba11a8b-e7ec-464f-89a3-48c08a8a15e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:49.657169 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba11a8b-e7ec-464f-89a3-48c08a8a15e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:49.658652 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba11a8b-e7ec-464f-89a3-48c08a8a15e2 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:49.678694 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 10/21] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:51.996852 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae3b86-4c23-4acd-be14-3c090ea714f0 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:51.997355 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae3b86-4c23-4acd-be14-3c090ea714f0 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:51.997462 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae3b86-4c23-4acd-be14-3c090ea714f0 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:51.999046 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 12/22] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:42:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:52.004142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379994a-2a03-4023-8c98-7fb9cdcaece6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:52.004956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379994a-2a03-4023-8c98-7fb9cdcaece6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:52.005418 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7379994a-2a03-4023-8c98-7fb9cdcaece6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:52.034708 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7379994a-2a03-4023-8c98-7fb9cdcaece6 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:52.036295 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7379994a-2a03-4023-8c98-7fb9cdcaece6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:52.123651 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 11/23] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:42:52.319628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7dd2c-7f46-4c07-81c7-3f2d5dadc22b None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:52.320268 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7dd2c-7f46-4c07-81c7-3f2d5dadc22b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:52.320766 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef7dd2c-7f46-4c07-81c7-3f2d5dadc22b None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:52.322345 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 13/24] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:42:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:52.327944 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790f867-6cba-45b9-8f56-ae620d657052 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:52.328467 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790f867-6cba-45b9-8f56-ae620d657052 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:52.328936 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4790f867-6cba-45b9-8f56-ae620d657052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:52.354669 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4790f867-6cba-45b9-8f56-ae620d657052 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:52.356716 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4790f867-6cba-45b9-8f56-ae620d657052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:52.380304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:52.451994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 12/25] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:42:52.570423 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7dd2c-7f46-4c07-81c7-3f2d5dadc22b None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:52.690727 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747da54-05bc-44ac-82a1-378b1bba9107 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:52.691358 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747da54-05bc-44ac-82a1-378b1bba9107 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:52.691853 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6747da54-05bc-44ac-82a1-378b1bba9107 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:52.693639 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 13/26] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:42:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:52.698765 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20af26-dc20-43e8-adaa-655a23b225b6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:52.699285 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20af26-dc20-43e8-adaa-655a23b225b6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:52.699779 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a20af26-dc20-43e8-adaa-655a23b225b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:52.719430 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef7dd2c-7f46-4c07-81c7-3f2d5dadc22b None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:52.723991 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0a20af26-dc20-43e8-adaa-655a23b225b6 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:52.726416 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0a20af26-dc20-43e8-adaa-655a23b225b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:52.800201 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3786b9d-4102-4a05-b1c4-3af7d2861b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:52.801149 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3786b9d-4102-4a05-b1c4-3af7d2861b32 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:52.801643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3786b9d-4102-4a05-b1c4-3af7d2861b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:52.802125 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3786b9d-4102-4a05-b1c4-3af7d2861b32 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:52.823622 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3786b9d-4102-4a05-b1c4-3af7d2861b32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:42:52.834174 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-e3786b9d-4102-4a05-b1c4-3af7d2861b32 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:42:52.834174 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:52.834174 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:52.834174 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:52.834174 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:52.834174 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:52.834174 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:52.834174 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:52.834174 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:52.834174 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:52.834174 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:52.834174 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:52.834174 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:42:52.834174 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:42:52.834174 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:42:52.834174 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:42:52.835092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:42:52.835092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:42:52.835092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:42:52.835092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:42:52.835092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:52.835092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:52.835092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:52.835092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:52.835092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:52.835092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:52.835092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:52.835092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:52.835092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:52.835092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:52.835092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:52.835092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:52.835878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:52.835878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:52.835878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:52.835878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:52.835878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:42:52.835878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:42:52.835878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:42:52.835878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:42:52.835878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:42:52.835878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:42:52.835878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:42:52.835878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:42:52.839337 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 14/27] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:42:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:52.841012 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3786b9d-4102-4a05-b1c4-3af7d2861b32 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:52.853992 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 14/28] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:42:52.855632 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8886e-df3c-4bef-b95e-7c798cdaec5b None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:52.856107 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8886e-df3c-4bef-b95e-7c798cdaec5b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:52.856538 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af8886e-df3c-4bef-b95e-7c798cdaec5b None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:52.858423 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 15/29] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:42:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:52.859315 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8886e-df3c-4bef-b95e-7c798cdaec5b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:52.872126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:52.954929 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:52.957148 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3786b9d-4102-4a05-b1c4-3af7d2861b32 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:52.974295 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af8886e-df3c-4bef-b95e-7c798cdaec5b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:52.996669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb58d996-1979-4145-a92e-555f452aaaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:52.997315 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58d996-1979-4145-a92e-555f452aaaef None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:52.997891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58d996-1979-4145-a92e-555f452aaaef None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:52.997891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb58d996-1979-4145-a92e-555f452aaaef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:53.018866 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58d996-1979-4145-a92e-555f452aaaef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:53.020834 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb58d996-1979-4145-a92e-555f452aaaef None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:53.037355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf73885-aab9-410c-82c6-967a9abcfd1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:53.038055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf73885-aab9-410c-82c6-967a9abcfd1e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:53.038504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf73885-aab9-410c-82c6-967a9abcfd1e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:53.038996 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf73885-aab9-410c-82c6-967a9abcfd1e None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:53.039789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-fb58d996-1979-4145-a92e-555f452aaaef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:53.039789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:53.039789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:53.039789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:53.039789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:53.039789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:53.039789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:53.039789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:53.039789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:53.039789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:53.039789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:53.039789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:53.039789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:42:53.039789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:42:53.039789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:42:53.039789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:42:53.040636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:53.040636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:53.040636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:53.040636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:53.040636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:53.040636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:53.040636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:53.040636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:53.040636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:53.040636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:53.040636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:53.040636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:53.040636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:53.040636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:53.040636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:53.040636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:53.040636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:42:53.041474 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:42:53.041474 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:42:53.041474 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:42:53.041635 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf73885-aab9-410c-82c6-967a9abcfd1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:53.041635 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf73885-aab9-410c-82c6-967a9abcfd1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:53.041635 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf73885-aab9-410c-82c6-967a9abcfd1e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:53.044017 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 15/30] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:53.045417 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fe1c2-80c1-46cb-a11a-dcc72b24ee7c None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:53.045927 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fe1c2-80c1-46cb-a11a-dcc72b24ee7c None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:53.046417 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3fe1c2-80c1-46cb-a11a-dcc72b24ee7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:53.073243 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 16/31] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:42:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:53.075712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf73885-aab9-410c-82c6-967a9abcfd1e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:53.087578 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-be3fe1c2-80c1-46cb-a11a-dcc72b24ee7c None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:53.092118 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-be3fe1c2-80c1-46cb-a11a-dcc72b24ee7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:53.207076 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 16/32] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:42:53.208240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fe1c2-80c1-46cb-a11a-dcc72b24ee7c None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:53.219245 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:53.269414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf73885-aab9-410c-82c6-967a9abcfd1e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:53.319224 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3fe1c2-80c1-46cb-a11a-dcc72b24ee7c None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:53.325110 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584196fb-20e9-4608-bfa8-06cd10aaefa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:53.326085 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584196fb-20e9-4608-bfa8-06cd10aaefa6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:53.326571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584196fb-20e9-4608-bfa8-06cd10aaefa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:53.327034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584196fb-20e9-4608-bfa8-06cd10aaefa6 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:53.327905 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584196fb-20e9-4608-bfa8-06cd10aaefa6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:53.328396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584196fb-20e9-4608-bfa8-06cd10aaefa6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:53.330070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584196fb-20e9-4608-bfa8-06cd10aaefa6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:53.342587 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 17/33] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:42:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:53.343745 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584196fb-20e9-4608-bfa8-06cd10aaefa6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:53.353926 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:53.358562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3283ad-04bc-49ea-b75f-f4e3f20ca89c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:53.359418 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3283ad-04bc-49ea-b75f-f4e3f20ca89c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:53.359926 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3283ad-04bc-49ea-b75f-f4e3f20ca89c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:53.360396 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3283ad-04bc-49ea-b75f-f4e3f20ca89c None admin] PATH_INFO: `/v3/users/7e2932bd7e7b4ca08c435ee8928789ee` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:53.361780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3283ad-04bc-49ea-b75f-f4e3f20ca89c None admin] RBAC: Authorizing `identity:get_user(user_id=7e2932bd7e7b4ca08c435ee8928789ee)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:53.363472 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3283ad-04bc-49ea-b75f-f4e3f20ca89c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:53.365581 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 17/34] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:42:53 2022] GET /identity/v3/users/7e2932bd7e7b4ca08c435ee8928789ee => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:53.366541 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3283ad-04bc-49ea-b75f-f4e3f20ca89c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:53.471964 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:53.502890 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584196fb-20e9-4608-bfa8-06cd10aaefa6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:53.527974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3283ad-04bc-49ea-b75f-f4e3f20ca89c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:53.552294 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8dc5ee-286c-4829-9b16-c8fb7ba17c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:53.553263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8dc5ee-286c-4829-9b16-c8fb7ba17c90 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:53.553769 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8dc5ee-286c-4829-9b16-c8fb7ba17c90 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:53.554264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8dc5ee-286c-4829-9b16-c8fb7ba17c90 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:53.555140 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8dc5ee-286c-4829-9b16-c8fb7ba17c90 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:53.556812 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8dc5ee-286c-4829-9b16-c8fb7ba17c90 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:53.588437 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008622e-b0e6-4fdf-9ce0-db8f98353669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:53.589417 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008622e-b0e6-4fdf-9ce0-db8f98353669 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:53.590067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008622e-b0e6-4fdf-9ce0-db8f98353669 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:53.590579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6008622e-b0e6-4fdf-9ce0-db8f98353669 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:53.591431 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008622e-b0e6-4fdf-9ce0-db8f98353669 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:53.593136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6008622e-b0e6-4fdf-9ce0-db8f98353669 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:53.767553 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 18/35] 10.222.0.59 () {60 vars in 1131 bytes} [Tue Sep 13 19:42:53 2022] POST /identity/v3/roles => generated 219 bytes in 424 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:42:53.769039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8dc5ee-286c-4829-9b16-c8fb7ba17c90 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:53.830470 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 18/36] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Sep 13 19:42:53 2022] POST /identity/v3/projects => generated 301 bytes in 464 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:42:53.834855 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008622e-b0e6-4fdf-9ce0-db8f98353669 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:53.873996 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:53.933350 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8dc5ee-286c-4829-9b16-c8fb7ba17c90 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:54.003635 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe38009-0cff-4e3d-99b1-94c9150783ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:54.004316 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe38009-0cff-4e3d-99b1-94c9150783ee None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:54.004604 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe38009-0cff-4e3d-99b1-94c9150783ee None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:54.004885 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe38009-0cff-4e3d-99b1-94c9150783ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:54.010601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe38009-0cff-4e3d-99b1-94c9150783ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:54.013133 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe38009-0cff-4e3d-99b1-94c9150783ee None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:54.015133 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 19/37] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:54.020687 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe38009-0cff-4e3d-99b1-94c9150783ee None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:54.118117 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6008622e-b0e6-4fdf-9ce0-db8f98353669 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:54.150703 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:54.156672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe38009-0cff-4e3d-99b1-94c9150783ee None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:54.161467 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b0c901-2a85-42e1-a85c-e9c8b3bd9b53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:54.162338 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0c901-2a85-42e1-a85c-e9c8b3bd9b53 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:54.162781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0c901-2a85-42e1-a85c-e9c8b3bd9b53 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:54.165511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b0c901-2a85-42e1-a85c-e9c8b3bd9b53 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:54.165511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0c901-2a85-42e1-a85c-e9c8b3bd9b53 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:54.165511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b0c901-2a85-42e1-a85c-e9c8b3bd9b53 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:54.192953 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c6eb9-b414-467b-bbe1-e1c4e147aa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:54.193616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c6eb9-b414-467b-bbe1-e1c4e147aa37 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:54.193958 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c6eb9-b414-467b-bbe1-e1c4e147aa37 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:54.194238 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c6eb9-b414-467b-bbe1-e1c4e147aa37 None admin] PATH_INFO: `/v3/domains/default/users/7e2932bd7e7b4ca08c435ee8928789ee/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:54.196246 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c6eb9-b414-467b-bbe1-e1c4e147aa37 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=7e2932bd7e7b4ca08c435ee8928789ee, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:54.197708 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c6eb9-b414-467b-bbe1-e1c4e147aa37 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:54.200616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:54.259747 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 19/38] 10.222.0.59 () {60 vars in 1131 bytes} [Tue Sep 13 19:42:53 2022] POST /identity/v3/roles => generated 225 bytes in 428 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:42:54.261061 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e70c3-de8d-4360-8fca-a1b5beeee94e None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:54.261349 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e70c3-de8d-4360-8fca-a1b5beeee94e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:54.262583 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1e70c3-de8d-4360-8fca-a1b5beeee94e None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:54.263776 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 20/39] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:42:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:54.264812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c46654-bd55-4c59-98f1-6509642cea57 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:54.265098 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c46654-bd55-4c59-98f1-6509642cea57 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:54.265374 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c46654-bd55-4c59-98f1-6509642cea57 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:54.266750 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 21/40] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:42:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:54.269796 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a53630-5cfa-4820-b1ff-d61ecf23436a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:54.270094 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a53630-5cfa-4820-b1ff-d61ecf23436a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:54.270341 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a53630-5cfa-4820-b1ff-d61ecf23436a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:54.283989 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 20/41] 10.222.0.59 () {58 vars in 1361 bytes} [Tue Sep 13 19:42:54 2022] PUT /identity/v3/domains/default/users/7e2932bd7e7b4ca08c435ee8928789ee/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:42:54.290166 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad4218-d10a-448e-a267-1450c6cea983 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:54.290166 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad4218-d10a-448e-a267-1450c6cea983 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:54.290166 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad4218-d10a-448e-a267-1450c6cea983 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:54.303450 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-74a53630-5cfa-4820-b1ff-d61ecf23436a None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:54.305432 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-74a53630-5cfa-4820-b1ff-d61ecf23436a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:54.400945 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 22/42] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:42:54.423707 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-47ad4218-d10a-448e-a267-1450c6cea983 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:54.425484 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-47ad4218-d10a-448e-a267-1450c6cea983 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:54.505450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 21/43] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:42:54.678333 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a53630-5cfa-4820-b1ff-d61ecf23436a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:54.770959 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad4218-d10a-448e-a267-1450c6cea983 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:54.780242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a53630-5cfa-4820-b1ff-d61ecf23436a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:54.799007 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:54.822303 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80498c57-ccf9-4051-841b-ecec6268d31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:54.822950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80498c57-ccf9-4051-841b-ecec6268d31b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:54.823232 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80498c57-ccf9-4051-841b-ecec6268d31b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:54.823505 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80498c57-ccf9-4051-841b-ecec6268d31b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:54.824648 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80498c57-ccf9-4051-841b-ecec6268d31b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:54.826152 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80498c57-ccf9-4051-841b-ecec6268d31b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:54.827885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 23/44] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:54.834055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80498c57-ccf9-4051-841b-ecec6268d31b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:54.882740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad4218-d10a-448e-a267-1450c6cea983 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:54.909263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:54.920489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdf87a9-55c2-4c31-9155-1a4089cd836a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:54.921136 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf87a9-55c2-4c31-9155-1a4089cd836a None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:54.921390 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf87a9-55c2-4c31-9155-1a4089cd836a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:54.921662 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdf87a9-55c2-4c31-9155-1a4089cd836a None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:54.922391 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf87a9-55c2-4c31-9155-1a4089cd836a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:54.923812 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdf87a9-55c2-4c31-9155-1a4089cd836a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:54.946422 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80498c57-ccf9-4051-841b-ecec6268d31b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:54.980141 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb62284-92ae-4541-b60a-70be9b38ddc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:54.981418 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb62284-92ae-4541-b60a-70be9b38ddc2 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:54.981726 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb62284-92ae-4541-b60a-70be9b38ddc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:54.982005 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb62284-92ae-4541-b60a-70be9b38ddc2 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:54.982660 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb62284-92ae-4541-b60a-70be9b38ddc2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:54.984098 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb62284-92ae-4541-b60a-70be9b38ddc2 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:55.022467 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 22/45] 10.222.0.59 () {60 vars in 1131 bytes} [Tue Sep 13 19:42:54 2022] POST /identity/v3/roles => generated 223 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:42:55.094833 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 24/46] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Sep 13 19:42:54 2022] POST /identity/v3/projects => generated 312 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:42:56.495917 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b6fcb-bdc4-412d-916d-8c7c7b330d26 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:56.496437 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b6fcb-bdc4-412d-916d-8c7c7b330d26 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:56.496520 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b6fcb-bdc4-412d-916d-8c7c7b330d26 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:56.497874 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 23/47] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:42:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:42:56.503081 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571e370-63df-4e1e-9cc5-3c827e2694e2 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:56.503477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571e370-63df-4e1e-9cc5-3c827e2694e2 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:56.503635 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7571e370-63df-4e1e-9cc5-3c827e2694e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:56.522176 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-7571e370-63df-4e1e-9cc5-3c827e2694e2 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:56.523343 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7571e370-63df-4e1e-9cc5-3c827e2694e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:56.552524 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:56.588793 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 25/48] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:42:56.855719 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b6fcb-bdc4-412d-916d-8c7c7b330d26 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:56.958543 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b6fcb-bdc4-412d-916d-8c7c7b330d26 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:56.990754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9d8f7-f5c0-4112-b5bc-68c187493070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:56.991381 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9d8f7-f5c0-4112-b5bc-68c187493070 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:56.991661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9d8f7-f5c0-4112-b5bc-68c187493070 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:56.991933 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc9d8f7-f5c0-4112-b5bc-68c187493070 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:57.002836 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc9d8f7-f5c0-4112-b5bc-68c187493070 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:42:57.007780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-5fc9d8f7-f5c0-4112-b5bc-68c187493070 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:42:57.007780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:42:57.007780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:42:57.007780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:42:57.007780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:42:57.007780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:42:57.007780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:42:57.007780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:42:57.007780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:42:57.007780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:42:57.007780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:42:57.007780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:42:57.007780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:42:57.007780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:42:57.007780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:42:57.007780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:42:57.008744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:42:57.008744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:42:57.008744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:42:57.008744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:42:57.008744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:42:57.008744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:42:57.008744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:42:57.008744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:42:57.008744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:42:57.008744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:42:57.008744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:42:57.008744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:42:57.008744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:42:57.008744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:42:57.008744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:42:57.008744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:42:57.009534 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:42:57.009534 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:42:57.009534 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:42:57.009534 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:42:57.009534 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:42:57.009534 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:42:57.009534 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:42:57.009534 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:42:57.009534 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:42:57.009534 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:42:57.009534 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:42:57.009534 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:42:57.009534 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 24/49] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:42:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:42:57.015573 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571e370-63df-4e1e-9cc5-3c827e2694e2 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:57.110463 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7571e370-63df-4e1e-9cc5-3c827e2694e2 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:57.144633 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1178272-b410-4575-9292-aea94bf18268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:57.145267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1178272-b410-4575-9292-aea94bf18268 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:57.145547 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1178272-b410-4575-9292-aea94bf18268 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:57.145854 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1178272-b410-4575-9292-aea94bf18268 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:57.146540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1178272-b410-4575-9292-aea94bf18268 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:57.146842 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1178272-b410-4575-9292-aea94bf18268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:57.148275 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1178272-b410-4575-9292-aea94bf18268 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:57.157800 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 26/50] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:42:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:57.163719 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9d8f7-f5c0-4112-b5bc-68c187493070 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:57.208549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:57.259639 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9fea2-972c-4639-ac4b-09bb90d4d6ca None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:57.259932 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9fea2-972c-4639-ac4b-09bb90d4d6ca None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:57.260217 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9fea2-972c-4639-ac4b-09bb90d4d6ca None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:57.260852 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc9d8f7-f5c0-4112-b5bc-68c187493070 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:57.261964 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 27/51] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:42:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:42:57.267352 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614b528-2235-4695-acb6-6a7cf020c2f3 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:57.267644 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614b528-2235-4695-acb6-6a7cf020c2f3 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:57.267928 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d614b528-2235-4695-acb6-6a7cf020c2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:57.285591 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-d614b528-2235-4695-acb6-6a7cf020c2f3 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:42:57.286842 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d614b528-2235-4695-acb6-6a7cf020c2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:42:57.297021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654d0c0-0cda-418b-bece-ae8b139ad14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:57.297645 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654d0c0-0cda-418b-bece-ae8b139ad14b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:57.297966 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654d0c0-0cda-418b-bece-ae8b139ad14b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:57.298242 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d654d0c0-0cda-418b-bece-ae8b139ad14b None admin] PATH_INFO: `/v3/users/7e2932bd7e7b4ca08c435ee8928789ee` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:57.299365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654d0c0-0cda-418b-bece-ae8b139ad14b None admin] RBAC: Authorizing `identity:get_user(user_id=7e2932bd7e7b4ca08c435ee8928789ee)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:57.300821 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d654d0c0-0cda-418b-bece-ae8b139ad14b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:57.302452 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 25/52] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:42:57 2022] GET /identity/v3/users/7e2932bd7e7b4ca08c435ee8928789ee => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:57.307854 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654d0c0-0cda-418b-bece-ae8b139ad14b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:57.311337 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:57.355244 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 28/53] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:42:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:42:57.407864 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d654d0c0-0cda-418b-bece-ae8b139ad14b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:57.420992 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:57.442059 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1c1be-ba8c-4e37-b89f-9fcf07ae1eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:57.442682 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1c1be-ba8c-4e37-b89f-9fcf07ae1eca None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:57.442965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1c1be-ba8c-4e37-b89f-9fcf07ae1eca None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:57.443240 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c1c1be-ba8c-4e37-b89f-9fcf07ae1eca None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:57.444353 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1c1be-ba8c-4e37-b89f-9fcf07ae1eca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:57.445831 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c1c1be-ba8c-4e37-b89f-9fcf07ae1eca None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:57.447400 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 26/54] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:42:57.453343 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614b528-2235-4695-acb6-6a7cf020c2f3 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:57.554272 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d614b528-2235-4695-acb6-6a7cf020c2f3 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:57.589161 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852ae6f-9003-4d8e-a6b9-132b44f5427b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:57.589839 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852ae6f-9003-4d8e-a6b9-132b44f5427b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:57.590148 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852ae6f-9003-4d8e-a6b9-132b44f5427b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:57.590421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4852ae6f-9003-4d8e-a6b9-132b44f5427b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:57.591145 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852ae6f-9003-4d8e-a6b9-132b44f5427b None admin] RBAC: Adding query filter params (role.id=cd02ef2043de492a8bff6c165485f255, scope.domain.id=default, user.id=7e2932bd7e7b4ca08c435ee8928789ee) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:42:57.591458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852ae6f-9003-4d8e-a6b9-132b44f5427b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:57.592889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4852ae6f-9003-4d8e-a6b9-132b44f5427b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:57.598621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 29/55] 10.222.0.59 () {56 vars in 1322 bytes} [Tue Sep 13 19:42:57 2022] GET /identity/v3/role_assignments?user.id=7e2932bd7e7b4ca08c435ee8928789ee&scope.domain.id=default&role.id=cd02ef2043de492a8bff6c165485f255 => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:57.625947 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1c1be-ba8c-4e37-b89f-9fcf07ae1eca None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:57.735493 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c1c1be-ba8c-4e37-b89f-9fcf07ae1eca None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:57.772734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3324de25-662b-4fcc-9978-2d76a5386bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:57.773824 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324de25-662b-4fcc-9978-2d76a5386bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:57.773929 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324de25-662b-4fcc-9978-2d76a5386bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:57.774133 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3324de25-662b-4fcc-9978-2d76a5386bf1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:57.775734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324de25-662b-4fcc-9978-2d76a5386bf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:57.776660 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3324de25-662b-4fcc-9978-2d76a5386bf1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:57.778979 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 27/56] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:42:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:42:57.784943 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852ae6f-9003-4d8e-a6b9-132b44f5427b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:42:57.811142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:42:57.988941 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4852ae6f-9003-4d8e-a6b9-132b44f5427b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:42:58.021511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e1b97d-0e0a-4294-9308-94adbf7d4423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:42:58.022142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1b97d-0e0a-4294-9308-94adbf7d4423 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:42:58.022426 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1b97d-0e0a-4294-9308-94adbf7d4423 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:42:58.022702 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e1b97d-0e0a-4294-9308-94adbf7d4423 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:42:58.023345 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1b97d-0e0a-4294-9308-94adbf7d4423 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:42:58.024771 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e1b97d-0e0a-4294-9308-94adbf7d4423 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:42:58.096860 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 30/57] 10.222.0.59 () {60 vars in 1140 bytes} [Tue Sep 13 19:42:57 2022] POST /identity/v3/projects => generated 298 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:00.222984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faedce6-313c-4820-9b44-bf83de06b064 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:00.223492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faedce6-313c-4820-9b44-bf83de06b064 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:00.223492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faedce6-313c-4820-9b44-bf83de06b064 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:00.224781 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 28/58] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:00.229999 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c20ce6-8de9-4360-973b-85f5d68c5f16 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:00.230413 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c20ce6-8de9-4360-973b-85f5d68c5f16 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:00.230559 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c20ce6-8de9-4360-973b-85f5d68c5f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:00.248645 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-f2c20ce6-8de9-4360-973b-85f5d68c5f16 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:00.249845 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f2c20ce6-8de9-4360-973b-85f5d68c5f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:00.316016 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 31/59] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:00.581405 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faedce6-313c-4820-9b44-bf83de06b064 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:00.629946 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:00.679789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faedce6-313c-4820-9b44-bf83de06b064 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:00.710726 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fc280a-f054-4c62-88a4-70c4a8897164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:00.711331 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc280a-f054-4c62-88a4-70c4a8897164 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:00.711610 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc280a-f054-4c62-88a4-70c4a8897164 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:00.711883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fc280a-f054-4c62-88a4-70c4a8897164 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:00.712997 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc280a-f054-4c62-88a4-70c4a8897164 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:00.714446 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fc280a-f054-4c62-88a4-70c4a8897164 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:00.716488 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 29/60] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:00.721896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c20ce6-8de9-4360-973b-85f5d68c5f16 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:00.729826 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:00.817042 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c20ce6-8de9-4360-973b-85f5d68c5f16 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:00.849136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb51bd6-9483-4cd8-a480-c045827ce882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:00.849671 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb51bd6-9483-4cd8-a480-c045827ce882 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:00.849979 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb51bd6-9483-4cd8-a480-c045827ce882 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:00.850248 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb51bd6-9483-4cd8-a480-c045827ce882 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:00.850881 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb51bd6-9483-4cd8-a480-c045827ce882 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:00.852309 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb51bd6-9483-4cd8-a480-c045827ce882 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:00.964728 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 32/61] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Sep 13 19:43:00 2022] POST /identity/v3/users => generated 275 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:04.242179 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97c4e5-e2e0-4259-8089-9dfdcd0a9219 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:04.243196 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97c4e5-e2e0-4259-8089-9dfdcd0a9219 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:04.243687 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d97c4e5-e2e0-4259-8089-9dfdcd0a9219 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:04.245251 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 30/62] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:04.250994 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff6cad-5071-42f6-b3f7-c37a56a9f0c1 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:04.251815 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff6cad-5071-42f6-b3f7-c37a56a9f0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:04.252394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff6cad-5071-42f6-b3f7-c37a56a9f0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:04.274341 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-25ff6cad-5071-42f6-b3f7-c37a56a9f0c1 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:04.275858 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-25ff6cad-5071-42f6-b3f7-c37a56a9f0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:04.364802 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:04.376663 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 33/63] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:04.436875 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a450e7-e15d-4dcc-b43c-5b27c897b62f None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:04.437495 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a450e7-e15d-4dcc-b43c-5b27c897b62f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:04.437999 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a450e7-e15d-4dcc-b43c-5b27c897b62f None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:04.439577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 31/64] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:04.444885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575bfd3-0821-408b-9ba1-4841aee1f31c None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:04.445172 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575bfd3-0821-408b-9ba1-4841aee1f31c None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:04.445450 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f575bfd3-0821-408b-9ba1-4841aee1f31c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:04.458053 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87546c-8d66-432a-b1e7-5415044e8585 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:04.458335 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87546c-8d66-432a-b1e7-5415044e8585 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:04.458776 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f87546c-8d66-432a-b1e7-5415044e8585 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:04.460521 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 32/65] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:04.465879 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa89d7c-f90a-48c4-8dd4-bb7843c8665c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:04.466327 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa89d7c-f90a-48c4-8dd4-bb7843c8665c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:04.466744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa89d7c-f90a-48c4-8dd4-bb7843c8665c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:04.475169 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-f575bfd3-0821-408b-9ba1-4841aee1f31c None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:04.476587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f575bfd3-0821-408b-9ba1-4841aee1f31c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:04.496778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-eaa89d7c-f90a-48c4-8dd4-bb7843c8665c None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:04.498379 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-eaa89d7c-f90a-48c4-8dd4-bb7843c8665c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:04.565406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 34/66] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:04.650957 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 33/67] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:43:04.688274 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a087ac3-0353-4500-8f2b-7cdc7c08e810 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:04.688942 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a087ac3-0353-4500-8f2b-7cdc7c08e810 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:04.689415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a087ac3-0353-4500-8f2b-7cdc7c08e810 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:04.691055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 35/68] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:04.696349 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a6aa2-c7c3-422e-8866-48123f40fb49 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:04.696643 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a6aa2-c7c3-422e-8866-48123f40fb49 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:04.696925 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a6aa2-c7c3-422e-8866-48123f40fb49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:04.716620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a087ac3-0353-4500-8f2b-7cdc7c08e810 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:04.732080 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-eb2a6aa2-c7c3-422e-8866-48123f40fb49 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:04.733280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-eb2a6aa2-c7c3-422e-8866-48123f40fb49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:04.820193 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:04.843136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a087ac3-0353-4500-8f2b-7cdc7c08e810 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:04.866466 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 34/69] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:04.868196 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a6aa2-c7c3-422e-8866-48123f40fb49 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:04.891218 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:04.918452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa6bfc-3f29-44b5-8a22-c2d4fbb5c799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:04.919558 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa6bfc-3f29-44b5-8a22-c2d4fbb5c799 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:04.922183 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa6bfc-3f29-44b5-8a22-c2d4fbb5c799 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:04.923317 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fa6bfc-3f29-44b5-8a22-c2d4fbb5c799 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:04.947261 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fa6bfc-3f29-44b5-8a22-c2d4fbb5c799 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:04.952419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-b8fa6bfc-3f29-44b5-8a22-c2d4fbb5c799 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:04.952419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:04.952419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:04.952419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:04.952419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:04.952419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:04.952419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:04.952419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:04.952419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:04.952419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:04.952419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:04.952419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:04.952419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:04.952419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:04.952419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:04.952419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:04.953284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:04.953284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:04.953284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:04.953284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:04.953284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:04.953284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:04.953284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:04.953284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:04.953284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:04.953284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:04.953284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:04.953284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:04.953284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:04.953284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:04.953284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:04.953284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:04.954102 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:04.954102 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:04.954102 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:04.954102 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:04.954102 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:04.954102 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:04.954102 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:04.954102 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:04.954102 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:04.954102 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:04.954102 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:04.954102 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:43:04.961516 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 36/70] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:43:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:43:04.968407 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa6bfc-3f29-44b5-8a22-c2d4fbb5c799 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:05.041340 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a6aa2-c7c3-422e-8866-48123f40fb49 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:05.078956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6537d8f-d84c-4fe9-8f54-3d51b46e3093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:05.079798 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6537d8f-d84c-4fe9-8f54-3d51b46e3093 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:05.080214 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6537d8f-d84c-4fe9-8f54-3d51b46e3093 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:05.080643 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6537d8f-d84c-4fe9-8f54-3d51b46e3093 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:05.091146 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6537d8f-d84c-4fe9-8f54-3d51b46e3093 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:05.096134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-b6537d8f-d84c-4fe9-8f54-3d51b46e3093 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:05.096134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:05.096134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:05.096134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:05.096134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:05.096134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:05.096134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:05.096134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:05.096134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:05.096134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:05.096134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:05.096134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:05.096134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:05.096134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:05.096134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:05.096134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:05.097217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:05.097217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:05.097217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:05.097217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:05.097217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:05.097217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:05.097217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:05.097217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:05.097217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:05.097217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:05.097217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:05.097217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:05.097217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:05.097217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:05.097217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:05.097217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:05.098380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:05.098380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:05.098380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:05.098380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:05.098380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:05.098380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:05.098380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:05.098380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:05.098380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:05.098380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:05.098380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:05.098380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:43:05.100437 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 35/71] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:05.101417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6537d8f-d84c-4fe9-8f54-3d51b46e3093 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:05.102554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fa6bfc-3f29-44b5-8a22-c2d4fbb5c799 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:05.143797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:05.150365 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04588d-1b9a-43f3-acf0-1de29ea169b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:05.151036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04588d-1b9a-43f3-acf0-1de29ea169b8 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:05.151322 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04588d-1b9a-43f3-acf0-1de29ea169b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:05.151606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb04588d-1b9a-43f3-acf0-1de29ea169b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:05.152844 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04588d-1b9a-43f3-acf0-1de29ea169b8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:05.153157 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04588d-1b9a-43f3-acf0-1de29ea169b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:05.154563 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb04588d-1b9a-43f3-acf0-1de29ea169b8 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:05.162759 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 37/72] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:05.163557 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04588d-1b9a-43f3-acf0-1de29ea169b8 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:05.208716 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6537d8f-d84c-4fe9-8f54-3d51b46e3093 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:05.210790 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:05.243277 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fe3d2f-99e8-4341-9c26-e0cbc4c98f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:05.243892 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe3d2f-99e8-4341-9c26-e0cbc4c98f3e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:05.244164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe3d2f-99e8-4341-9c26-e0cbc4c98f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:05.244445 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fe3d2f-99e8-4341-9c26-e0cbc4c98f3e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:05.254283 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fe3d2f-99e8-4341-9c26-e0cbc4c98f3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:05.259075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-a0fe3d2f-99e8-4341-9c26-e0cbc4c98f3e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:05.259075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:05.259075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:05.259075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:05.259075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:05.259075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:05.259075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:05.259075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:05.259075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:05.259075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:05.259075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:05.259075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:05.259075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:05.259075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:05.259075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:05.259075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:05.259938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:05.259938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:05.259938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:05.259938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:05.259938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:05.259938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:05.259938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:05.259938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:05.259938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:05.259938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:05.259938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:05.259938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:05.259938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:05.259938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:05.259938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:05.259938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:05.261921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:05.261921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:05.261921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:05.261921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:05.261921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:05.261921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:05.261921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:05.261921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:05.261921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:05.261921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:05.261921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:05.261921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:43:05.261921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 36/73] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Sep 13 19:43:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:05.261921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83247a-24ee-495d-8823-7378892b3480 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:05.262627 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83247a-24ee-495d-8823-7378892b3480 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:05.262627 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee83247a-24ee-495d-8823-7378892b3480 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:05.265730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 37/74] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:05.265730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83247a-24ee-495d-8823-7378892b3480 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:05.270640 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb04588d-1b9a-43f3-acf0-1de29ea169b8 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:05.305738 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983753ec-77d7-4016-8f0e-f5b34bf42621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:05.306353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983753ec-77d7-4016-8f0e-f5b34bf42621 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:05.306643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983753ec-77d7-4016-8f0e-f5b34bf42621 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:05.306919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983753ec-77d7-4016-8f0e-f5b34bf42621 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:05.307584 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983753ec-77d7-4016-8f0e-f5b34bf42621 None admin] RBAC: Adding query filter params (name=member) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:05.307896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983753ec-77d7-4016-8f0e-f5b34bf42621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:05.309325 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983753ec-77d7-4016-8f0e-f5b34bf42621 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:05.317208 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 38/75] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:05.322545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983753ec-77d7-4016-8f0e-f5b34bf42621 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:05.358525 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:05.364855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee83247a-24ee-495d-8823-7378892b3480 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:05.398581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c7d02-cad9-455c-8268-f1285db53a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:05.399199 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c7d02-cad9-455c-8268-f1285db53a33 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:05.399475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c7d02-cad9-455c-8268-f1285db53a33 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:05.399742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997c7d02-cad9-455c-8268-f1285db53a33 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:05.410509 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997c7d02-cad9-455c-8268-f1285db53a33 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:05.415273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-997c7d02-cad9-455c-8268-f1285db53a33 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:05.415273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:05.415273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:05.415273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:05.415273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:05.415273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:05.415273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:05.415273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:05.415273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:05.415273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:05.415273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:05.415273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:05.415273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:05.415273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:05.415273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:05.415273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:05.416102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:05.416102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:05.416102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:05.416102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:05.416102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:05.416102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:05.416102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:05.416102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:05.416102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:05.416102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:05.416102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:05.416102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:05.416102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:05.416102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:05.416102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:05.416102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:05.416883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:05.416883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:05.416883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:05.416883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:05.416883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:05.416883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:05.416883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:05.416883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:05.416883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:05.416883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:05.416883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:05.416883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:43:05.416883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 38/76] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:05.417521 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c7d02-cad9-455c-8268-f1285db53a33 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:05.423754 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983753ec-77d7-4016-8f0e-f5b34bf42621 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:05.430778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:05.457144 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3ac0b-e56c-4003-8eb6-7918577e06b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:05.457887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3ac0b-e56c-4003-8eb6-7918577e06b5 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:05.458169 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3ac0b-e56c-4003-8eb6-7918577e06b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:05.458445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3ac0b-e56c-4003-8eb6-7918577e06b5 None admin] PATH_INFO: `/v3/users/7e2932bd7e7b4ca08c435ee8928789ee` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:05.459587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3ac0b-e56c-4003-8eb6-7918577e06b5 None admin] RBAC: Authorizing `identity:get_user(user_id=7e2932bd7e7b4ca08c435ee8928789ee)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:05.461040 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c3ac0b-e56c-4003-8eb6-7918577e06b5 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:05.462647 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 39/77] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:05 2022] GET /identity/v3/users/7e2932bd7e7b4ca08c435ee8928789ee => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:05.463743 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca335e2-3ac3-4c55-9509-ef7a2b6b90c2 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:05.464026 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca335e2-3ac3-4c55-9509-ef7a2b6b90c2 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:05.464302 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca335e2-3ac3-4c55-9509-ef7a2b6b90c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:05.482763 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-1ca335e2-3ac3-4c55-9509-ef7a2b6b90c2 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:05.483946 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1ca335e2-3ac3-4c55-9509-ef7a2b6b90c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:05.520916 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997c7d02-cad9-455c-8268-f1285db53a33 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:05.548924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 40/78] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:05.549951 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca335e2-3ac3-4c55-9509-ef7a2b6b90c2 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:05.554264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc8af4-60e7-4828-8659-87d5917130a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:05.554873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc8af4-60e7-4828-8659-87d5917130a9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:05.555159 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc8af4-60e7-4828-8659-87d5917130a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:05.555440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dc8af4-60e7-4828-8659-87d5917130a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:05.556109 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc8af4-60e7-4828-8659-87d5917130a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:05.556418 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc8af4-60e7-4828-8659-87d5917130a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:05.557846 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dc8af4-60e7-4828-8659-87d5917130a9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:05.566105 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 39/79] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:43:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:05.566742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc8af4-60e7-4828-8659-87d5917130a9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:05.586915 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:05.663578 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca335e2-3ac3-4c55-9509-ef7a2b6b90c2 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:05.666439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:05.670478 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dc8af4-60e7-4828-8659-87d5917130a9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:05.699998 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4cbc5-8f45-4b9b-9d49-80d00b9d3a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:05.701030 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4cbc5-8f45-4b9b-9d49-80d00b9d3a75 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:05.701440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4cbc5-8f45-4b9b-9d49-80d00b9d3a75 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:05.701887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4cbc5-8f45-4b9b-9d49-80d00b9d3a75 None admin] PATH_INFO: `/v3/users/65d1c5d78251465898ee3d921a10e221` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:05.705431 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d6dba-f60e-4e27-811b-368c0a3c58a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:05.706068 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d6dba-f60e-4e27-811b-368c0a3c58a3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:05.706356 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d6dba-f60e-4e27-811b-368c0a3c58a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:05.706634 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d6dba-f60e-4e27-811b-368c0a3c58a3 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:05.707370 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d6dba-f60e-4e27-811b-368c0a3c58a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:05.707684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d6dba-f60e-4e27-811b-368c0a3c58a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:05.709063 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d6dba-f60e-4e27-811b-368c0a3c58a3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:05.722137 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 40/80] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:05.722281 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4cbc5-8f45-4b9b-9d49-80d00b9d3a75 None admin] RBAC: Authorizing `identity:get_user(user_id=65d1c5d78251465898ee3d921a10e221)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:05.722357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d6dba-f60e-4e27-811b-368c0a3c58a3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:05.722422 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4cbc5-8f45-4b9b-9d49-80d00b9d3a75 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:05.722422 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 41/81] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:05 2022] GET /identity/v3/users/65d1c5d78251465898ee3d921a10e221 => generated 275 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:05.722422 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4cbc5-8f45-4b9b-9d49-80d00b9d3a75 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:05.808679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:05.827589 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d6dba-f60e-4e27-811b-368c0a3c58a3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:05.828901 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4cbc5-8f45-4b9b-9d49-80d00b9d3a75 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:05.860811 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49f193-6340-4642-91a3-d4162df0c590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:05.861411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49f193-6340-4642-91a3-d4162df0c590 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:05.861720 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49f193-6340-4642-91a3-d4162df0c590 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:05.861974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec1a4e-35d3-4be9-991a-7d3ad5de3240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:05.862076 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c49f193-6340-4642-91a3-d4162df0c590 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:05.862599 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec1a4e-35d3-4be9-991a-7d3ad5de3240 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:05.862875 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec1a4e-35d3-4be9-991a-7d3ad5de3240 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:05.863146 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ec1a4e-35d3-4be9-991a-7d3ad5de3240 None admin] PATH_INFO: `/v3/users/65d1c5d78251465898ee3d921a10e221` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:05.864256 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec1a4e-35d3-4be9-991a-7d3ad5de3240 None admin] RBAC: Authorizing `identity:get_user(user_id=65d1c5d78251465898ee3d921a10e221)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:05.865738 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ec1a4e-35d3-4be9-991a-7d3ad5de3240 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:05.867300 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 42/82] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:05 2022] GET /identity/v3/users/65d1c5d78251465898ee3d921a10e221 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:05.870655 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec1a4e-35d3-4be9-991a-7d3ad5de3240 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:05.901984 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:05.932785 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49f193-6340-4642-91a3-d4162df0c590 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:05.934746 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c49f193-6340-4642-91a3-d4162df0c590 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:05.970641 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ec1a4e-35d3-4be9-991a-7d3ad5de3240 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:06.003087 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430334e-f8d1-401b-9e9b-7b3ddb364620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:06.003707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430334e-f8d1-401b-9e9b-7b3ddb364620 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:06.003987 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430334e-f8d1-401b-9e9b-7b3ddb364620 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:06.004257 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7430334e-f8d1-401b-9e9b-7b3ddb364620 None admin] PATH_INFO: `/v3/users/65d1c5d78251465898ee3d921a10e221` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:06.005350 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430334e-f8d1-401b-9e9b-7b3ddb364620 None admin] RBAC: Authorizing `identity:get_user(user_id=65d1c5d78251465898ee3d921a10e221)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:06.006862 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7430334e-f8d1-401b-9e9b-7b3ddb364620 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:06.008418 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 43/83] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:05 2022] GET /identity/v3/users/65d1c5d78251465898ee3d921a10e221 => generated 275 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:06.009176 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430334e-f8d1-401b-9e9b-7b3ddb364620 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:06.016526 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:06.035400 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 41/84] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:06.036219 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49f193-6340-4642-91a3-d4162df0c590 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:06.106175 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:06.109845 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7430334e-f8d1-401b-9e9b-7b3ddb364620 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:06.143444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a707ccc-17cb-4c28-bce5-ba93947e181b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:06.144054 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a707ccc-17cb-4c28-bce5-ba93947e181b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:06.144331 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a707ccc-17cb-4c28-bce5-ba93947e181b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:06.144601 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a707ccc-17cb-4c28-bce5-ba93947e181b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:06.149799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c49f193-6340-4642-91a3-d4162df0c590 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:06.181935 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da357d-5de4-4a33-aae0-c731724e6f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:06.182553 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da357d-5de4-4a33-aae0-c731724e6f38 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:06.182877 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da357d-5de4-4a33-aae0-c731724e6f38 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:06.183103 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6da357d-5de4-4a33-aae0-c731724e6f38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:06.184722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da357d-5de4-4a33-aae0-c731724e6f38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:06.186207 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6da357d-5de4-4a33-aae0-c731724e6f38 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:06.187757 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 42/85] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:06.188544 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da357d-5de4-4a33-aae0-c731724e6f38 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:06.214465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a707ccc-17cb-4c28-bce5-ba93947e181b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:06.215948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a707ccc-17cb-4c28-bce5-ba93947e181b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:06.235860 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:06.285886 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6da357d-5de4-4a33-aae0-c731724e6f38 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:06.310974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:06.315542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 44/86] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:06.316223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a707ccc-17cb-4c28-bce5-ba93947e181b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:06.323022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c85d4-f68e-4bff-80dd-2a784c143479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:06.323626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c85d4-f68e-4bff-80dd-2a784c143479 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:06.323909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c85d4-f68e-4bff-80dd-2a784c143479 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:06.324278 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217c85d4-f68e-4bff-80dd-2a784c143479 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:06.391214 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c85d4-f68e-4bff-80dd-2a784c143479 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:06.392692 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217c85d4-f68e-4bff-80dd-2a784c143479 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:06.413035 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a707ccc-17cb-4c28-bce5-ba93947e181b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:06.439533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:06.447689 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212ba04-7e94-426c-a12f-ab68562e059d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:06.448344 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212ba04-7e94-426c-a12f-ab68562e059d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:06.448624 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212ba04-7e94-426c-a12f-ab68562e059d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:06.448896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2212ba04-7e94-426c-a12f-ab68562e059d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:06.490163 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 43/87] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:06.490998 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c85d4-f68e-4bff-80dd-2a784c143479 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:06.512921 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:06.516458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212ba04-7e94-426c-a12f-ab68562e059d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:06.517957 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2212ba04-7e94-426c-a12f-ab68562e059d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:06.589212 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217c85d4-f68e-4bff-80dd-2a784c143479 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:06.615840 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 45/88] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:06.616708 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212ba04-7e94-426c-a12f-ab68562e059d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:06.626370 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6670b-cc2c-4180-9567-018ff2331742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:06.627003 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6670b-cc2c-4180-9567-018ff2331742 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:06.627285 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6670b-cc2c-4180-9567-018ff2331742 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:06.627561 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e6670b-cc2c-4180-9567-018ff2331742 None admin] PATH_INFO: `/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:06.628676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6670b-cc2c-4180-9567-018ff2331742 None admin] RBAC: Authorizing `identity:get_project(project_id=de921f56e9d94e6c9a4cd2ca6b60f924)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:06.630166 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e6670b-cc2c-4180-9567-018ff2331742 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:06.631782 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 44/89] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:06 2022] GET /identity/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:06.632535 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6670b-cc2c-4180-9567-018ff2331742 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:06.651193 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:06.711441 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:06.715527 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2212ba04-7e94-426c-a12f-ab68562e059d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:06.732903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e6670b-cc2c-4180-9567-018ff2331742 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:06.749071 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966e7f4-f303-42d7-b90c-7ad98b17f3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:06.749681 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966e7f4-f303-42d7-b90c-7ad98b17f3eb None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:06.749994 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966e7f4-f303-42d7-b90c-7ad98b17f3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:06.750267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0966e7f4-f303-42d7-b90c-7ad98b17f3eb None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:06.750911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966e7f4-f303-42d7-b90c-7ad98b17f3eb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:06.752337 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0966e7f4-f303-42d7-b90c-7ad98b17f3eb None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:06.766042 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45242ad0-dd85-4a46-ba1f-04250256607f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:06.766661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45242ad0-dd85-4a46-ba1f-04250256607f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:06.766935 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45242ad0-dd85-4a46-ba1f-04250256607f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:06.767202 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45242ad0-dd85-4a46-ba1f-04250256607f None admin] PATH_INFO: `/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:06.768288 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45242ad0-dd85-4a46-ba1f-04250256607f None admin] RBAC: Authorizing `identity:get_project(project_id=de921f56e9d94e6c9a4cd2ca6b60f924)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:06.769749 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45242ad0-dd85-4a46-ba1f-04250256607f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:06.771350 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 45/90] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:06 2022] GET /identity/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924 => generated 298 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:06.776198 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45242ad0-dd85-4a46-ba1f-04250256607f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:06.853886 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:06.865260 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 46/91] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Sep 13 19:43:06 2022] POST /identity/v3/users => generated 289 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:06.865260 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966e7f4-f303-42d7-b90c-7ad98b17f3eb None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:06.871651 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45242ad0-dd85-4a46-ba1f-04250256607f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:06.912748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d2c67-84c7-4444-be79-ce3c732f7c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:06.913397 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d2c67-84c7-4444-be79-ce3c732f7c8c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:06.913675 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d2c67-84c7-4444-be79-ce3c732f7c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:06.913981 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100d2c67-84c7-4444-be79-ce3c732f7c8c None admin] PATH_INFO: `/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:06.915166 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d2c67-84c7-4444-be79-ce3c732f7c8c None admin] RBAC: Authorizing `identity:get_project(project_id=de921f56e9d94e6c9a4cd2ca6b60f924)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:06.916652 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100d2c67-84c7-4444-be79-ce3c732f7c8c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:06.918981 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 46/92] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:06 2022] GET /identity/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:06.919789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d2c67-84c7-4444-be79-ce3c732f7c8c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:07.001131 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0966e7f4-f303-42d7-b90c-7ad98b17f3eb None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:07.034819 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100d2c67-84c7-4444-be79-ce3c732f7c8c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:07.045898 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05accb2-c655-41c2-bd9e-7822b1f3fe04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:07.047202 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05accb2-c655-41c2-bd9e-7822b1f3fe04 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:07.047202 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05accb2-c655-41c2-bd9e-7822b1f3fe04 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:07.047202 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05accb2-c655-41c2-bd9e-7822b1f3fe04 None admin] PATH_INFO: `/v3/projects/9c0d8481ab4d4d138bba32386b76ddb8` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:07.048221 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05accb2-c655-41c2-bd9e-7822b1f3fe04 None admin] RBAC: Authorizing `identity:get_project(project_id=9c0d8481ab4d4d138bba32386b76ddb8)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:07.049811 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05accb2-c655-41c2-bd9e-7822b1f3fe04 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:07.051457 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 47/93] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:06 2022] GET /identity/v3/projects/9c0d8481ab4d4d138bba32386b76ddb8 => generated 312 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:07.052965 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05accb2-c655-41c2-bd9e-7822b1f3fe04 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:07.073268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98080236-e052-4d43-8ff2-d783c05dd48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:07.073946 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98080236-e052-4d43-8ff2-d783c05dd48e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:07.074769 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98080236-e052-4d43-8ff2-d783c05dd48e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:07.075046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98080236-e052-4d43-8ff2-d783c05dd48e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:07.075785 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98080236-e052-4d43-8ff2-d783c05dd48e None admin] RBAC: Adding query filter params (role.id=cd02ef2043de492a8bff6c165485f255, scope.project.id=de921f56e9d94e6c9a4cd2ca6b60f924, user.id=7e2932bd7e7b4ca08c435ee8928789ee) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:07.076091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98080236-e052-4d43-8ff2-d783c05dd48e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:07.077671 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98080236-e052-4d43-8ff2-d783c05dd48e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:07.083795 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:07.085315 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 47/94] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:06 2022] GET /identity/v3/role_assignments?user.id=7e2932bd7e7b4ca08c435ee8928789ee&scope.project.id=de921f56e9d94e6c9a4cd2ca6b60f924&role.id=cd02ef2043de492a8bff6c165485f255 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:07.086586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98080236-e052-4d43-8ff2-d783c05dd48e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:07.107611 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:07.196084 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05accb2-c655-41c2-bd9e-7822b1f3fe04 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:07.216175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98080236-e052-4d43-8ff2-d783c05dd48e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:07.238718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb5ea7-9390-4051-9e51-9e4bd6f547a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:07.239619 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb5ea7-9390-4051-9e51-9e4bd6f547a2 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:07.240003 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb5ea7-9390-4051-9e51-9e4bd6f547a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:07.240344 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb5ea7-9390-4051-9e51-9e4bd6f547a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:07.241166 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb5ea7-9390-4051-9e51-9e4bd6f547a2 None admin] RBAC: Adding query filter params (role.id=033268df62114ee6bf4c0512568f2609, scope.project.id=de921f56e9d94e6c9a4cd2ca6b60f924, user.id=65d1c5d78251465898ee3d921a10e221) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:07.241544 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb5ea7-9390-4051-9e51-9e4bd6f547a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:07.243301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb5ea7-9390-4051-9e51-9e4bd6f547a2 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:07.250975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 48/95] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:07 2022] GET /identity/v3/role_assignments?user.id=65d1c5d78251465898ee3d921a10e221&scope.project.id=de921f56e9d94e6c9a4cd2ca6b60f924&role.id=033268df62114ee6bf4c0512568f2609 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:07.251789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb5ea7-9390-4051-9e51-9e4bd6f547a2 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:07.262385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8ca33-35c5-4f7f-beff-f46977f2d180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:07.263018 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8ca33-35c5-4f7f-beff-f46977f2d180 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:07.264054 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8ca33-35c5-4f7f-beff-f46977f2d180 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:07.264331 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8ca33-35c5-4f7f-beff-f46977f2d180 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:07.265143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8ca33-35c5-4f7f-beff-f46977f2d180 None admin] RBAC: Adding query filter params (role.id=d520f560be6d45539a966c6de2a934e7, scope.project.id=de921f56e9d94e6c9a4cd2ca6b60f924, user.id=65d1c5d78251465898ee3d921a10e221) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:07.265455 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8ca33-35c5-4f7f-beff-f46977f2d180 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:07.267454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8ca33-35c5-4f7f-beff-f46977f2d180 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:07.275667 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 48/96] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:07 2022] GET /identity/v3/role_assignments?user.id=65d1c5d78251465898ee3d921a10e221&scope.project.id=de921f56e9d94e6c9a4cd2ca6b60f924&role.id=d520f560be6d45539a966c6de2a934e7 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:07.401138 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:07.417774 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb5ea7-9390-4051-9e51-9e4bd6f547a2 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:07.462556 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7707dd-e9c8-4709-a6ff-ad7608198e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:07.463199 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7707dd-e9c8-4709-a6ff-ad7608198e5c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:07.463482 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7707dd-e9c8-4709-a6ff-ad7608198e5c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:07.463757 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7707dd-e9c8-4709-a6ff-ad7608198e5c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:07.464507 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7707dd-e9c8-4709-a6ff-ad7608198e5c None admin] RBAC: Adding query filter params (role.id=033268df62114ee6bf4c0512568f2609, scope.project.id=9c0d8481ab4d4d138bba32386b76ddb8, user.id=65d1c5d78251465898ee3d921a10e221) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:07.464869 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7707dd-e9c8-4709-a6ff-ad7608198e5c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:07.466419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7707dd-e9c8-4709-a6ff-ad7608198e5c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:07.472870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 49/97] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:07 2022] GET /identity/v3/role_assignments?user.id=65d1c5d78251465898ee3d921a10e221&scope.project.id=9c0d8481ab4d4d138bba32386b76ddb8&role.id=033268df62114ee6bf4c0512568f2609 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:09.764861 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995a5ba-e67f-4a88-9cb7-2d55398c038f None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:09.765385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995a5ba-e67f-4a88-9cb7-2d55398c038f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:09.765462 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995a5ba-e67f-4a88-9cb7-2d55398c038f None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:09.766945 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 49/98] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:09.776295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2378d1-9265-48d2-a927-dffc6e5d949c None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:09.776740 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2378d1-9265-48d2-a927-dffc6e5d949c None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:09.776916 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2378d1-9265-48d2-a927-dffc6e5d949c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:09.801471 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-fe2378d1-9265-48d2-a927-dffc6e5d949c None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:09.802722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-fe2378d1-9265-48d2-a927-dffc6e5d949c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:09.896738 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 50/99] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:10.205663 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63dcbc-9aff-44be-bfc2-5780c05b3a1a None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:10.206035 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63dcbc-9aff-44be-bfc2-5780c05b3a1a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:10.206204 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63dcbc-9aff-44be-bfc2-5780c05b3a1a None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:10.207739 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 50/100] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:10.213726 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3cd09-a528-4497-a468-bf438b44061f None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:10.214023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3cd09-a528-4497-a468-bf438b44061f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:10.214302 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b3cd09-a528-4497-a468-bf438b44061f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:10.245896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-36b3cd09-a528-4497-a468-bf438b44061f None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:10.247547 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-36b3cd09-a528-4497-a468-bf438b44061f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:10.317224 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79c24c-ff59-40d3-9723-7c189aa3cfa7 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:10.317512 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79c24c-ff59-40d3-9723-7c189aa3cfa7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:10.317811 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79c24c-ff59-40d3-9723-7c189aa3cfa7 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:10.319419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 51/101] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:10.339012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26701ff6-4559-43d9-856b-fce2344284e2 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:10.339297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26701ff6-4559-43d9-856b-fce2344284e2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:10.339646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26701ff6-4559-43d9-856b-fce2344284e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:10.339962 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 51/102] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:43:10.359007 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0b28e-43b3-43d6-a960-d2acb39941ad None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:10.359609 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0b28e-43b3-43d6-a960-d2acb39941ad None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:10.360092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad0b28e-43b3-43d6-a960-d2acb39941ad None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:10.361661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 52/103] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:43:10.366954 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972772d2-86c3-4595-b13b-8136ba34f36e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:10.367461 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972772d2-86c3-4595-b13b-8136ba34f36e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:10.367945 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972772d2-86c3-4595-b13b-8136ba34f36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:10.404040 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-26701ff6-4559-43d9-856b-fce2344284e2 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:10.405254 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-26701ff6-4559-43d9-856b-fce2344284e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:10.414777 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-972772d2-86c3-4595-b13b-8136ba34f36e None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:10.416284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-972772d2-86c3-4595-b13b-8136ba34f36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:10.421624 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:10.488801 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 52/104] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:43:10.490197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26701ff6-4559-43d9-856b-fce2344284e2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:10.513755 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:10.573234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 53/105] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:43:10.656446 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26701ff6-4559-43d9-856b-fce2344284e2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:10.702519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a432b-bd85-449d-9337-e4670f8ec0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:10.703217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a432b-bd85-449d-9337-e4670f8ec0cf None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:10.703507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a432b-bd85-449d-9337-e4670f8ec0cf None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:10.703791 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7a432b-bd85-449d-9337-e4670f8ec0cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:10.725349 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7a432b-bd85-449d-9337-e4670f8ec0cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:10.730847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-5c7a432b-bd85-449d-9337-e4670f8ec0cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:10.730847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:10.730847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:10.730847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:10.730847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:10.730847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:10.730847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:10.730847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:10.730847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:10.730847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:10.730847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:10.730847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:10.730847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:10.730847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:10.730847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:10.730847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:10.731721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:10.731721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:10.731721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:10.731721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:10.731721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:10.731721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:10.731721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:10.731721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:10.731721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:10.731721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:10.731721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:10.731721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:10.731721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:10.731721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:10.731721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:10.731721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:10.733236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:10.733236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:10.733236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:10.733236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:10.733236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:10.733236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:10.733236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:10.733236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:10.733236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:10.733236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:10.733236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:10.733236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:43:10.733236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 53/106] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:43:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:10.737927 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972772d2-86c3-4595-b13b-8136ba34f36e None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:10.781165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a432b-bd85-449d-9337-e4670f8ec0cf None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:10.842709 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972772d2-86c3-4595-b13b-8136ba34f36e None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:10.898033 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ea1c0-9fe4-4b3d-bca5-f50d3b7b3a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:10.898671 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ea1c0-9fe4-4b3d-bca5-f50d3b7b3a24 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:10.898956 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ea1c0-9fe4-4b3d-bca5-f50d3b7b3a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:10.899235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ea1c0-9fe4-4b3d-bca5-f50d3b7b3a24 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:10.899922 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ea1c0-9fe4-4b3d-bca5-f50d3b7b3a24 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:10.900232 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ea1c0-9fe4-4b3d-bca5-f50d3b7b3a24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:10.901623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ea1c0-9fe4-4b3d-bca5-f50d3b7b3a24 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:10.918788 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 54/107] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:10.919670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ea1c0-9fe4-4b3d-bca5-f50d3b7b3a24 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:10.929157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:10.946106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:10.991632 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7a432b-bd85-449d-9337-e4670f8ec0cf None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:11.030786 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ec405-6529-430f-8b48-72a18f296adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:11.031483 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ec405-6529-430f-8b48-72a18f296adf None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:11.031716 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ec405-6529-430f-8b48-72a18f296adf None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:11.031998 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53ec405-6529-430f-8b48-72a18f296adf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:11.043157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53ec405-6529-430f-8b48-72a18f296adf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:11.048098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-e53ec405-6529-430f-8b48-72a18f296adf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:11.048098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:11.048098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:11.048098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:11.048098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:11.048098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:11.048098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:11.048098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:11.048098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:11.048098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:11.048098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:11.048098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:11.048098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:11.048098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:11.048098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:11.048098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:11.049155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:11.049155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:11.049155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:11.049155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:11.049155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:11.049155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:11.049155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:11.049155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:11.049155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:11.049155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:11.049155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:11.049155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:11.049155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:11.049155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:11.049155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:11.049155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:11.049978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:11.049978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:11.049978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:11.049978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:11.049978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:11.049978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:11.049978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:11.049978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:11.049978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:11.049978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:11.049978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:11.049978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:43:11.049978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 54/108] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:43:11.050637 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ec405-6529-430f-8b48-72a18f296adf None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:11.073209 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ea1c0-9fe4-4b3d-bca5-f50d3b7b3a24 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:11.107006 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a35875e-c01a-478e-8e53-2887619b5af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:11.107830 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35875e-c01a-478e-8e53-2887619b5af7 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:11.108116 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35875e-c01a-478e-8e53-2887619b5af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:11.108388 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a35875e-c01a-478e-8e53-2887619b5af7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:11.118137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a35875e-c01a-478e-8e53-2887619b5af7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:11.123975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-6a35875e-c01a-478e-8e53-2887619b5af7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:11.123975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:11.123975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:11.123975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:11.123975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:11.123975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:11.123975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:11.123975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:11.123975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:11.123975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:11.123975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:11.123975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:11.123975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:11.123975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:11.123975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:11.123975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:11.125464 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:11.125464 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:11.125464 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:11.125464 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:11.125464 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:11.125464 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:11.125464 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:11.125464 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:11.125464 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:11.125464 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:11.125464 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:11.125464 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:11.125464 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:11.125464 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:11.125464 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:11.125464 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:11.126282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:11.126282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:11.126282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:11.126282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:11.126282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:11.126282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:11.126282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:11.126282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:11.126282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:11.126282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:11.126282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:11.126282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:43:11.126282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 55/109] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Sep 13 19:43:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:11.126282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80849c53-c9be-47f6-b93e-e470e50f91bd None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:11.126978 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80849c53-c9be-47f6-b93e-e470e50f91bd None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:11.126978 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80849c53-c9be-47f6-b93e-e470e50f91bd None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:11.128685 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 56/110] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:11.129747 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80849c53-c9be-47f6-b93e-e470e50f91bd None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:11.158519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53ec405-6529-430f-8b48-72a18f296adf None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:11.186313 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:11.191924 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abe6b9-98d0-4f42-b4f4-06eef4afa355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:11.192463 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:11.192578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abe6b9-98d0-4f42-b4f4-06eef4afa355 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:11.192816 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abe6b9-98d0-4f42-b4f4-06eef4afa355 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:11.193152 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33abe6b9-98d0-4f42-b4f4-06eef4afa355 None admin] PATH_INFO: `/v3/users/7e2932bd7e7b4ca08c435ee8928789ee` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:11.194308 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abe6b9-98d0-4f42-b4f4-06eef4afa355 None admin] RBAC: Authorizing `identity:get_user(user_id=7e2932bd7e7b4ca08c435ee8928789ee)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:11.195772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33abe6b9-98d0-4f42-b4f4-06eef4afa355 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:11.197421 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 55/111] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:11 2022] GET /identity/v3/users/7e2932bd7e7b4ca08c435ee8928789ee => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:11.198223 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abe6b9-98d0-4f42-b4f4-06eef4afa355 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:11.233652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80849c53-c9be-47f6-b93e-e470e50f91bd None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:11.268640 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2ffc2f-2f8e-44da-a90c-b08510fb982b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:11.269274 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ffc2f-2f8e-44da-a90c-b08510fb982b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:11.269584 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ffc2f-2f8e-44da-a90c-b08510fb982b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:11.269893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2ffc2f-2f8e-44da-a90c-b08510fb982b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:11.280856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2ffc2f-2f8e-44da-a90c-b08510fb982b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:11.286255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-ac2ffc2f-2f8e-44da-a90c-b08510fb982b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:43:11.286255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:11.286255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:11.286255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:11.286255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:11.286255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:11.286255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:11.286255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:11.286255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:11.286255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:11.286255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:11.286255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:11.286255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:11.286255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:11.286255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:11.286255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:11.287291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:11.287291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:11.287291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:11.287291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:11.287291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:11.287291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:11.287291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:11.287291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:11.287291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:11.287291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:11.287291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:11.287291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:11.287291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:11.287291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:11.287291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:11.287291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:11.288248 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:11.288248 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:11.288248 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:11.288248 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:11.288248 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:11.288248 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:11.288248 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:11.288248 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:11.288248 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:11.288248 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:11.288248 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:43:11.288248 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:43:11.288248 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 57/112] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:11.289036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0df2b6-b217-4c63-b5db-995220265452 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:11.289036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0df2b6-b217-4c63-b5db-995220265452 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:11.289036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0df2b6-b217-4c63-b5db-995220265452 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:11.290353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 58/113] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:11.290940 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0df2b6-b217-4c63-b5db-995220265452 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:11.304695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33abe6b9-98d0-4f42-b4f4-06eef4afa355 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:11.337419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e290279f-54af-4bbb-97ab-760758e98fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:11.338057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290279f-54af-4bbb-97ab-760758e98fff None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:11.338345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290279f-54af-4bbb-97ab-760758e98fff None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:11.338626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e290279f-54af-4bbb-97ab-760758e98fff None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:11.339285 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290279f-54af-4bbb-97ab-760758e98fff None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:11.340166 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290279f-54af-4bbb-97ab-760758e98fff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:11.341551 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e290279f-54af-4bbb-97ab-760758e98fff None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:11.349296 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 56/114] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:11.350523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191d114-013b-4690-87c4-f3f06972f1d4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:11.350819 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191d114-013b-4690-87c4-f3f06972f1d4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:11.351097 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f191d114-013b-4690-87c4-f3f06972f1d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:11.368501 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f191d114-013b-4690-87c4-f3f06972f1d4 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:11.369700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f191d114-013b-4690-87c4-f3f06972f1d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:11.397306 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0df2b6-b217-4c63-b5db-995220265452 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:11.421583 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:11.425397 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:11.432602 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10576dcb-7b87-47ce-96c0-8e9c1fe32091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:11.433249 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10576dcb-7b87-47ce-96c0-8e9c1fe32091 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:11.433540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10576dcb-7b87-47ce-96c0-8e9c1fe32091 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:11.433858 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10576dcb-7b87-47ce-96c0-8e9c1fe32091 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:11.434535 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10576dcb-7b87-47ce-96c0-8e9c1fe32091 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:11.434849 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10576dcb-7b87-47ce-96c0-8e9c1fe32091 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:11.436406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10576dcb-7b87-47ce-96c0-8e9c1fe32091 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:11.436518 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 57/115] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:11.437041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191d114-013b-4690-87c4-f3f06972f1d4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:11.444764 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 59/116] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:43:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:11.445486 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10576dcb-7b87-47ce-96c0-8e9c1fe32091 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:11.544593 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f191d114-013b-4690-87c4-f3f06972f1d4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:11.556432 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10576dcb-7b87-47ce-96c0-8e9c1fe32091 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:11.577989 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141ef3f8-24b9-4b69-b792-7cd2dda10d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:11.578620 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ef3f8-24b9-4b69-b792-7cd2dda10d7e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:11.578906 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ef3f8-24b9-4b69-b792-7cd2dda10d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:11.579179 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141ef3f8-24b9-4b69-b792-7cd2dda10d7e None admin] PATH_INFO: `/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:11.580296 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ef3f8-24b9-4b69-b792-7cd2dda10d7e None admin] RBAC: Authorizing `identity:get_project(project_id=de921f56e9d94e6c9a4cd2ca6b60f924)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:11.581763 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141ef3f8-24b9-4b69-b792-7cd2dda10d7e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:11.583419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 58/117] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:11 2022] GET /identity/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:11.583419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51dc39-af4a-472a-afe6-8e6748c5910a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:11.583419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51dc39-af4a-472a-afe6-8e6748c5910a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:11.583419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51dc39-af4a-472a-afe6-8e6748c5910a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:11.602804 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70379f02-0a54-46c9-a0c4-85691149b015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:11.602960 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-be51dc39-af4a-472a-afe6-8e6748c5910a None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:11.603416 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70379f02-0a54-46c9-a0c4-85691149b015 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:11.603706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70379f02-0a54-46c9-a0c4-85691149b015 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:11.603988 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70379f02-0a54-46c9-a0c4-85691149b015 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:11.604165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-be51dc39-af4a-472a-afe6-8e6748c5910a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:11.604655 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70379f02-0a54-46c9-a0c4-85691149b015 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:11.604966 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70379f02-0a54-46c9-a0c4-85691149b015 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:11.606781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70379f02-0a54-46c9-a0c4-85691149b015 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:11.616636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 60/118] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:11.617536 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70379f02-0a54-46c9-a0c4-85691149b015 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:11.661267 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:11.668256 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:11.675433 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 59/119] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:11.676518 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51dc39-af4a-472a-afe6-8e6748c5910a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:11.735268 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70379f02-0a54-46c9-a0c4-85691149b015 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:11.770789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7438a-bdf7-408c-9c47-0dd2cef17c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:11.771424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7438a-bdf7-408c-9c47-0dd2cef17c0e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:11.771709 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7438a-bdf7-408c-9c47-0dd2cef17c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:11.771989 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed7438a-bdf7-408c-9c47-0dd2cef17c0e None admin] PATH_INFO: `/v3/users/65d1c5d78251465898ee3d921a10e221` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:11.773122 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7438a-bdf7-408c-9c47-0dd2cef17c0e None admin] RBAC: Authorizing `identity:get_user(user_id=65d1c5d78251465898ee3d921a10e221)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:11.774742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed7438a-bdf7-408c-9c47-0dd2cef17c0e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:11.781398 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 61/120] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:11 2022] GET /identity/v3/users/65d1c5d78251465898ee3d921a10e221 => generated 275 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:11.781398 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7438a-bdf7-408c-9c47-0dd2cef17c0e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:11.781623 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be51dc39-af4a-472a-afe6-8e6748c5910a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:11.816174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5cfa6-2352-4115-88b9-24854c89bb3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:11.816730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5cfa6-2352-4115-88b9-24854c89bb3a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:11.817016 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5cfa6-2352-4115-88b9-24854c89bb3a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:11.817292 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd5cfa6-2352-4115-88b9-24854c89bb3a None admin] PATH_INFO: `/v3/users/65d1c5d78251465898ee3d921a10e221` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:11.818442 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5cfa6-2352-4115-88b9-24854c89bb3a None admin] RBAC: Authorizing `identity:get_user(user_id=65d1c5d78251465898ee3d921a10e221)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:11.819901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd5cfa6-2352-4115-88b9-24854c89bb3a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:11.821622 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 60/121] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:11 2022] GET /identity/v3/users/65d1c5d78251465898ee3d921a10e221 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:11.822269 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5cfa6-2352-4115-88b9-24854c89bb3a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:11.881970 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:11.901756 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed7438a-bdf7-408c-9c47-0dd2cef17c0e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:11.916697 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:11.927083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd5cfa6-2352-4115-88b9-24854c89bb3a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:11.938075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0f9b7-64b0-45ef-9dfb-0f19bfb00465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:11.938735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0f9b7-64b0-45ef-9dfb-0f19bfb00465 None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:11.939014 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0f9b7-64b0-45ef-9dfb-0f19bfb00465 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:11.939287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0f9b7-64b0-45ef-9dfb-0f19bfb00465 None admin] PATH_INFO: `/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924/users/7e2932bd7e7b4ca08c435ee8928789ee/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:11.941285 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0f9b7-64b0-45ef-9dfb-0f19bfb00465 None admin] RBAC: Authorizing `identity:create_grant(project_id=de921f56e9d94e6c9a4cd2ca6b60f924, user_id=7e2932bd7e7b4ca08c435ee8928789ee, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:11.942890 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0f9b7-64b0-45ef-9dfb-0f19bfb00465 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:11.962029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12884a2-c30f-45b0-9a14-e549202b9620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:11.962656 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12884a2-c30f-45b0-9a14-e549202b9620 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:11.962937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12884a2-c30f-45b0-9a14-e549202b9620 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:11.963210 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12884a2-c30f-45b0-9a14-e549202b9620 None admin] PATH_INFO: `/v3/users/23fdca6ff03147df837f0c57b10a3d60` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:11.976272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12884a2-c30f-45b0-9a14-e549202b9620 None admin] RBAC: Authorizing `identity:get_user(user_id=23fdca6ff03147df837f0c57b10a3d60)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:11.977802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12884a2-c30f-45b0-9a14-e549202b9620 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:11.979391 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 61/122] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:11 2022] GET /identity/v3/users/23fdca6ff03147df837f0c57b10a3d60 => generated 289 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:11.980240 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12884a2-c30f-45b0-9a14-e549202b9620 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:12.010329 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 62/123] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Sep 13 19:43:11 2022] PUT /identity/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924/users/7e2932bd7e7b4ca08c435ee8928789ee/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:43:12.012101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0f9b7-64b0-45ef-9dfb-0f19bfb00465 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:12.091077 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12884a2-c30f-45b0-9a14-e549202b9620 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:12.106798 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:12.128175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c3bcb-5e15-4c51-8980-1a74c9bc8634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:12.128821 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c3bcb-5e15-4c51-8980-1a74c9bc8634 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:12.129104 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c3bcb-5e15-4c51-8980-1a74c9bc8634 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:12.129378 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83c3bcb-5e15-4c51-8980-1a74c9bc8634 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:12.138848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0f9b7-64b0-45ef-9dfb-0f19bfb00465 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:12.142524 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83c3bcb-5e15-4c51-8980-1a74c9bc8634 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:12.148153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-e83c3bcb-5e15-4c51-8980-1a74c9bc8634 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:12.148153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:12.148153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:12.148153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:12.148153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:12.148153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:12.148153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:12.148153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:12.148153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:12.148153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:12.148153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:12.148153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:12.148153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:12.148153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:12.148153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:12.148153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:12.149178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:12.149178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:12.149178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:12.149178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:12.149178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:12.149178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:12.149178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:12.149178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:12.149178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:12.149178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:12.149178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:12.149178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:12.149178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:12.149178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:12.149178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:12.149178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:12.150011 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:12.150011 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:12.150011 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:12.150011 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:12.150011 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:12.150011 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:12.150011 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:12.150011 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:12.150011 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:12.150011 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:12.150011 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:12.150011 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:43:12.157831 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 62/124] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:12.157831 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c3bcb-5e15-4c51-8980-1a74c9bc8634 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:12.188312 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99482d6-df77-4ffd-9a72-624e0a329d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:12.188312 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99482d6-df77-4ffd-9a72-624e0a329d0a None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:12.188312 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99482d6-df77-4ffd-9a72-624e0a329d0a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:12.188312 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99482d6-df77-4ffd-9a72-624e0a329d0a None admin] PATH_INFO: `/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:12.189278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99482d6-df77-4ffd-9a72-624e0a329d0a None admin] RBAC: Authorizing `identity:get_project(project_id=de921f56e9d94e6c9a4cd2ca6b60f924)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:12.191154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99482d6-df77-4ffd-9a72-624e0a329d0a None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:12.193090 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 63/125] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:12 2022] GET /identity/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:12.193881 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99482d6-df77-4ffd-9a72-624e0a329d0a None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:12.238333 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:12.269873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83c3bcb-5e15-4c51-8980-1a74c9bc8634 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:12.297876 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99482d6-df77-4ffd-9a72-624e0a329d0a None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:12.304093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a8065-e187-487e-9501-bc2d6825e3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:12.304720 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a8065-e187-487e-9501-bc2d6825e3a0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:12.305005 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a8065-e187-487e-9501-bc2d6825e3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:12.305278 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01a8065-e187-487e-9501-bc2d6825e3a0 None admin] PATH_INFO: `/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:12.306408 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a8065-e187-487e-9501-bc2d6825e3a0 None admin] RBAC: Authorizing `identity:get_project(project_id=de921f56e9d94e6c9a4cd2ca6b60f924)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:12.307881 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01a8065-e187-487e-9501-bc2d6825e3a0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:12.310084 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 63/126] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:12 2022] GET /identity/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:12.310843 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a8065-e187-487e-9501-bc2d6825e3a0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:12.339640 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16832d30-e04a-432f-870e-2bd333d8afe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:12.340286 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16832d30-e04a-432f-870e-2bd333d8afe4 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:12.340566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16832d30-e04a-432f-870e-2bd333d8afe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:12.340865 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16832d30-e04a-432f-870e-2bd333d8afe4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:12.342177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16832d30-e04a-432f-870e-2bd333d8afe4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:12.343911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16832d30-e04a-432f-870e-2bd333d8afe4 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:12.345720 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 64/127] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:12.346318 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16832d30-e04a-432f-870e-2bd333d8afe4 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:12.362632 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:12.423040 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01a8065-e187-487e-9501-bc2d6825e3a0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:12.454115 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16832d30-e04a-432f-870e-2bd333d8afe4 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:12.458683 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2951a-cea0-4987-923c-8235a4b0ae6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:12.459537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2951a-cea0-4987-923c-8235a4b0ae6e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:12.460017 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2951a-cea0-4987-923c-8235a4b0ae6e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:12.460491 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2951a-cea0-4987-923c-8235a4b0ae6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:12.464980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:12.500412 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a96009-b796-4a60-8cd4-98845ff102dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:12.501029 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a96009-b796-4a60-8cd4-98845ff102dc None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:12.501755 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a96009-b796-4a60-8cd4-98845ff102dc None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:12.502043 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a96009-b796-4a60-8cd4-98845ff102dc None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:12.502716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a96009-b796-4a60-8cd4-98845ff102dc None admin] RBAC: Adding query filter params (name=member) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:12.503020 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a96009-b796-4a60-8cd4-98845ff102dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:12.505113 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a96009-b796-4a60-8cd4-98845ff102dc None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:12.514355 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 65/128] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:12.515141 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a96009-b796-4a60-8cd4-98845ff102dc None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:12.534948 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2951a-cea0-4987-923c-8235a4b0ae6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:12.536501 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2951a-cea0-4987-923c-8235a4b0ae6e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:12.582008 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:12.626403 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a96009-b796-4a60-8cd4-98845ff102dc None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:12.641614 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 64/129] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:12.642647 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2951a-cea0-4987-923c-8235a4b0ae6e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:12.669612 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27a1ef-a48e-4e2d-ace0-04783e51a27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:12.670395 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27a1ef-a48e-4e2d-ace0-04783e51a27e None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:12.670680 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27a1ef-a48e-4e2d-ace0-04783e51a27e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:12.671053 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e27a1ef-a48e-4e2d-ace0-04783e51a27e None admin] PATH_INFO: `/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924/users/65d1c5d78251465898ee3d921a10e221/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:12.672888 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27a1ef-a48e-4e2d-ace0-04783e51a27e None admin] RBAC: Authorizing `identity:create_grant(project_id=de921f56e9d94e6c9a4cd2ca6b60f924, user_id=65d1c5d78251465898ee3d921a10e221, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:12.674411 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e27a1ef-a48e-4e2d-ace0-04783e51a27e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:12.746212 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2951a-cea0-4987-923c-8235a4b0ae6e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:12.770344 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 66/130] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Sep 13 19:43:12 2022] PUT /identity/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924/users/65d1c5d78251465898ee3d921a10e221/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:43:12.771414 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27a1ef-a48e-4e2d-ace0-04783e51a27e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:12.796805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f14e35-22d5-4831-80eb-e07876715d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:12.797533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f14e35-22d5-4831-80eb-e07876715d63 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:12.797858 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f14e35-22d5-4831-80eb-e07876715d63 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:12.798140 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f14e35-22d5-4831-80eb-e07876715d63 None admin] PATH_INFO: `/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924/users/65d1c5d78251465898ee3d921a10e221/roles/d520f560be6d45539a966c6de2a934e7` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:12.801427 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f14e35-22d5-4831-80eb-e07876715d63 None admin] RBAC: Authorizing `identity:create_grant(project_id=de921f56e9d94e6c9a4cd2ca6b60f924, user_id=65d1c5d78251465898ee3d921a10e221, role_id=d520f560be6d45539a966c6de2a934e7)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:12.803120 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f14e35-22d5-4831-80eb-e07876715d63 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:12.812710 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:12.877939 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 65/131] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Sep 13 19:43:12 2022] PUT /identity/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924/users/65d1c5d78251465898ee3d921a10e221/roles/d520f560be6d45539a966c6de2a934e7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:43:12.878931 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f14e35-22d5-4831-80eb-e07876715d63 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:12.890264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:12.919164 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e27a1ef-a48e-4e2d-ace0-04783e51a27e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:12.988286 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e4f19-ce12-4c53-b303-29847858da75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:12.989079 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e4f19-ce12-4c53-b303-29847858da75 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:12.989472 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e4f19-ce12-4c53-b303-29847858da75 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:12.990493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e4f19-ce12-4c53-b303-29847858da75 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:12.991314 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e4f19-ce12-4c53-b303-29847858da75 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:12.993264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e4f19-ce12-4c53-b303-29847858da75 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:13.035046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f14e35-22d5-4831-80eb-e07876715d63 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:13.072744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527be41-d5e6-43cb-a38f-9b5290535049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:13.073645 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527be41-d5e6-43cb-a38f-9b5290535049 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:13.074712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527be41-d5e6-43cb-a38f-9b5290535049 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:13.075238 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a527be41-d5e6-43cb-a38f-9b5290535049 None admin] PATH_INFO: `/v3/users/65d1c5d78251465898ee3d921a10e221` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:13.076654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527be41-d5e6-43cb-a38f-9b5290535049 None admin] RBAC: Authorizing `identity:get_user(user_id=65d1c5d78251465898ee3d921a10e221)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:13.078321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a527be41-d5e6-43cb-a38f-9b5290535049 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:13.080217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 66/132] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:12 2022] GET /identity/v3/users/65d1c5d78251465898ee3d921a10e221 => generated 275 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:13.081209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527be41-d5e6-43cb-a38f-9b5290535049 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:13.105083 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 67/133] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Sep 13 19:43:12 2022] POST /identity/v3/projects => generated 302 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:13.106902 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e4f19-ce12-4c53-b303-29847858da75 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:13.198171 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:13.241991 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a527be41-d5e6-43cb-a38f-9b5290535049 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:13.294692 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:13.321930 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b95819-57b9-4c2f-84fa-e81edb11927c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:13.322167 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e4f19-ce12-4c53-b303-29847858da75 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:13.323093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b95819-57b9-4c2f-84fa-e81edb11927c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:13.323631 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b95819-57b9-4c2f-84fa-e81edb11927c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:13.324666 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b95819-57b9-4c2f-84fa-e81edb11927c None admin] PATH_INFO: `/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:13.326067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b95819-57b9-4c2f-84fa-e81edb11927c None admin] RBAC: Authorizing `identity:get_project(project_id=de921f56e9d94e6c9a4cd2ca6b60f924)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:13.327745 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b95819-57b9-4c2f-84fa-e81edb11927c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:13.334071 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 67/134] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:13 2022] GET /identity/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924 => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:13.340900 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b95819-57b9-4c2f-84fa-e81edb11927c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:13.377051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3add352-95f7-4857-87f7-104292ee5dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:13.377749 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3add352-95f7-4857-87f7-104292ee5dff None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:13.378044 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3add352-95f7-4857-87f7-104292ee5dff None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:13.378326 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3add352-95f7-4857-87f7-104292ee5dff None admin] PATH_INFO: `/v3/projects/9c0d8481ab4d4d138bba32386b76ddb8` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:13.380428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3add352-95f7-4857-87f7-104292ee5dff None admin] RBAC: Authorizing `identity:get_project(project_id=9c0d8481ab4d4d138bba32386b76ddb8)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:13.383754 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3add352-95f7-4857-87f7-104292ee5dff None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:13.387709 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 68/135] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:13 2022] GET /identity/v3/projects/9c0d8481ab4d4d138bba32386b76ddb8 => generated 312 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:13.393162 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3add352-95f7-4857-87f7-104292ee5dff None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:13.528753 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b95819-57b9-4c2f-84fa-e81edb11927c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:13.591774 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892ad191-374f-44a2-980f-92d576c49243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:13.592902 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ad191-374f-44a2-980f-92d576c49243 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:13.594957 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3add352-95f7-4857-87f7-104292ee5dff None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:13.595447 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ad191-374f-44a2-980f-92d576c49243 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:13.595922 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892ad191-374f-44a2-980f-92d576c49243 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:13.596852 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ad191-374f-44a2-980f-92d576c49243 None admin] RBAC: Adding query filter params (role.id=ec5168a1b302406fb0ec0082a2ed258a, scope.project.id=de921f56e9d94e6c9a4cd2ca6b60f924, user.id=23fdca6ff03147df837f0c57b10a3d60) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:13.598728 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ad191-374f-44a2-980f-92d576c49243 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:13.600524 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892ad191-374f-44a2-980f-92d576c49243 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:13.614926 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 68/136] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:13 2022] GET /identity/v3/role_assignments?user.id=23fdca6ff03147df837f0c57b10a3d60&scope.project.id=de921f56e9d94e6c9a4cd2ca6b60f924&role.id=ec5168a1b302406fb0ec0082a2ed258a => generated 259 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:13.645871 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1edc3954-c058-409e-9837-f9686de6426e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:13.646937 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc3954-c058-409e-9837-f9686de6426e None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:13.647417 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc3954-c058-409e-9837-f9686de6426e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:13.647948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1edc3954-c058-409e-9837-f9686de6426e None admin] PATH_INFO: `/v3/projects/9c0d8481ab4d4d138bba32386b76ddb8/users/65d1c5d78251465898ee3d921a10e221/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:13.650122 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc3954-c058-409e-9837-f9686de6426e None admin] RBAC: Authorizing `identity:create_grant(project_id=9c0d8481ab4d4d138bba32386b76ddb8, user_id=65d1c5d78251465898ee3d921a10e221, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:13.651819 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1edc3954-c058-409e-9837-f9686de6426e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:13.740427 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 69/137] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Sep 13 19:43:13 2022] PUT /identity/v3/projects/9c0d8481ab4d4d138bba32386b76ddb8/users/65d1c5d78251465898ee3d921a10e221/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:43:14.436539 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211eae54-737d-4fe8-8822-53dc0302528c None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:14.437553 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211eae54-737d-4fe8-8822-53dc0302528c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:14.438087 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211eae54-737d-4fe8-8822-53dc0302528c None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:14.439655 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 69/138] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:14.445108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6bf9a-578b-40dd-91e3-251a03be4561 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:14.445979 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6bf9a-578b-40dd-91e3-251a03be4561 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:14.446462 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b6bf9a-578b-40dd-91e3-251a03be4561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:14.474713 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-70b6bf9a-578b-40dd-91e3-251a03be4561 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:14.476333 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-70b6bf9a-578b-40dd-91e3-251a03be4561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:14.485292 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:14.558281 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 70/139] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:14.969559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211eae54-737d-4fe8-8822-53dc0302528c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:14.972543 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:15.076767 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211eae54-737d-4fe8-8822-53dc0302528c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:15.112195 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caaa99a-4f93-42a9-87eb-4ea190e63648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:15.112828 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caaa99a-4f93-42a9-87eb-4ea190e63648 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:15.113119 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caaa99a-4f93-42a9-87eb-4ea190e63648 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:15.113396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0caaa99a-4f93-42a9-87eb-4ea190e63648 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:15.125263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0caaa99a-4f93-42a9-87eb-4ea190e63648 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:15.130165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-0caaa99a-4f93-42a9-87eb-4ea190e63648 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:15.130165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:15.130165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:15.130165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:15.130165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:15.130165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:15.130165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:15.130165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:15.130165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:15.130165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:15.130165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:15.130165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:15.130165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:15.130165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:15.130165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:15.130165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:15.131020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:15.131020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:15.131020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:15.131020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:15.131020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:15.131020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:15.131020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:15.131020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:15.131020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:15.131020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:15.131020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:15.131020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:15.131020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:15.131020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:15.131020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:15.131020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:15.131792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:15.131792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:15.131792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:15.131792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:15.131792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:15.131792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:15.131792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:15.131792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:15.131792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:15.131792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:15.131792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:15.131792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:43:15.131792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 70/140] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:43:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:15.138659 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6bf9a-578b-40dd-91e3-251a03be4561 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:15.252421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b6bf9a-578b-40dd-91e3-251a03be4561 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:15.300103 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335fd30-01ce-46b8-be9c-2a48545b028e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:15.300725 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335fd30-01ce-46b8-be9c-2a48545b028e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:15.301062 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335fd30-01ce-46b8-be9c-2a48545b028e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:15.301350 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335fd30-01ce-46b8-be9c-2a48545b028e None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:15.302052 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335fd30-01ce-46b8-be9c-2a48545b028e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:15.302360 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335fd30-01ce-46b8-be9c-2a48545b028e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:15.303795 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335fd30-01ce-46b8-be9c-2a48545b028e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:15.317366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 71/141] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:15.322886 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caaa99a-4f93-42a9-87eb-4ea190e63648 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:15.387709 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:15.429180 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0caaa99a-4f93-42a9-87eb-4ea190e63648 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:15.465645 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab9799-f921-4207-bdc1-64c60fcaf3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:15.466438 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab9799-f921-4207-bdc1-64c60fcaf3eb None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:15.466625 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab9799-f921-4207-bdc1-64c60fcaf3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:15.466900 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ab9799-f921-4207-bdc1-64c60fcaf3eb None admin] PATH_INFO: `/v3/users/7e2932bd7e7b4ca08c435ee8928789ee` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:15.468088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab9799-f921-4207-bdc1-64c60fcaf3eb None admin] RBAC: Authorizing `identity:get_user(user_id=7e2932bd7e7b4ca08c435ee8928789ee)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:15.469545 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ab9799-f921-4207-bdc1-64c60fcaf3eb None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:15.471145 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 71/142] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:15 2022] GET /identity/v3/users/7e2932bd7e7b4ca08c435ee8928789ee => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:15.476757 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335fd30-01ce-46b8-be9c-2a48545b028e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:15.480869 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:15.595929 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335fd30-01ce-46b8-be9c-2a48545b028e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:15.642864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918b78f-1004-49b5-9d9d-ae29c8f0eaa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:15.643811 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918b78f-1004-49b5-9d9d-ae29c8f0eaa0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:15.644271 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918b78f-1004-49b5-9d9d-ae29c8f0eaa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:15.644721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1918b78f-1004-49b5-9d9d-ae29c8f0eaa0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:15.729898 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918b78f-1004-49b5-9d9d-ae29c8f0eaa0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:15.731975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1918b78f-1004-49b5-9d9d-ae29c8f0eaa0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:15.738750 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:15.857630 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 72/143] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:15.866806 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab9799-f921-4207-bdc1-64c60fcaf3eb None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:15.980632 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ab9799-f921-4207-bdc1-64c60fcaf3eb None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:16.010418 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:16.020089 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe3e53c-9ccd-4bb1-90c4-f2f5072165e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:16.020747 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3e53c-9ccd-4bb1-90c4-f2f5072165e9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:16.021029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3e53c-9ccd-4bb1-90c4-f2f5072165e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:16.021306 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe3e53c-9ccd-4bb1-90c4-f2f5072165e9 None admin] PATH_INFO: `/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:16.023110 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3e53c-9ccd-4bb1-90c4-f2f5072165e9 None admin] RBAC: Authorizing `identity:get_project(project_id=de921f56e9d94e6c9a4cd2ca6b60f924)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:16.029955 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe3e53c-9ccd-4bb1-90c4-f2f5072165e9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:16.029955 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 72/144] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:15 2022] GET /identity/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:16.033237 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918b78f-1004-49b5-9d9d-ae29c8f0eaa0 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:16.161193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1918b78f-1004-49b5-9d9d-ae29c8f0eaa0 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:16.168346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd8fde-38c1-4106-bc57-3b99ab5ca4ed None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:16.168630 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd8fde-38c1-4106-bc57-3b99ab5ca4ed None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:16.168901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edd8fde-38c1-4106-bc57-3b99ab5ca4ed None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:16.170434 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 73/145] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:16.176339 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888f608-b898-4df1-a7a5-08ca10597b97 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:16.176625 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888f608-b898-4df1-a7a5-08ca10597b97 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:16.176902 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6888f608-b898-4df1-a7a5-08ca10597b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:16.183064 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:16.197223 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6888f608-b898-4df1-a7a5-08ca10597b97 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:16.198464 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6888f608-b898-4df1-a7a5-08ca10597b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:16.239944 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a3441-2eab-4cfe-ae69-2a48b1fac5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:16.240624 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a3441-2eab-4cfe-ae69-2a48b1fac5f5 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:16.240904 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a3441-2eab-4cfe-ae69-2a48b1fac5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:16.241221 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a3441-2eab-4cfe-ae69-2a48b1fac5f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:16.242039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a3441-2eab-4cfe-ae69-2a48b1fac5f5 None admin] RBAC: Adding query filter params (role.id=cd02ef2043de492a8bff6c165485f255, scope.project.id=de921f56e9d94e6c9a4cd2ca6b60f924, user.id=7e2932bd7e7b4ca08c435ee8928789ee) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:16.242355 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a3441-2eab-4cfe-ae69-2a48b1fac5f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:16.243812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a3441-2eab-4cfe-ae69-2a48b1fac5f5 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:16.256277 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 73/146] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:16 2022] GET /identity/v3/role_assignments?user.id=7e2932bd7e7b4ca08c435ee8928789ee&scope.project.id=de921f56e9d94e6c9a4cd2ca6b60f924&role.id=cd02ef2043de492a8bff6c165485f255 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:16.257501 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe83d73-88c1-4531-af4a-ce2b3188de85 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:16.257813 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe83d73-88c1-4531-af4a-ce2b3188de85 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:16.258090 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe83d73-88c1-4531-af4a-ce2b3188de85 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:16.259486 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 74/147] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:16.266043 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757ec2b-c5e5-4e72-9688-88a444b2106a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:16.266324 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757ec2b-c5e5-4e72-9688-88a444b2106a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:16.266606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9757ec2b-c5e5-4e72-9688-88a444b2106a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:16.309531 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-9757ec2b-c5e5-4e72-9688-88a444b2106a None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:16.310772 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9757ec2b-c5e5-4e72-9688-88a444b2106a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:16.355551 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 74/148] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:43:16.411483 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 75/149] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:16.624060 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdba2a2-e797-4fa4-89e6-075ea8b9c24a None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:16.624579 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdba2a2-e797-4fa4-89e6-075ea8b9c24a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:16.624579 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdba2a2-e797-4fa4-89e6-075ea8b9c24a None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:16.626179 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 75/150] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:16.643333 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7faff9-6b82-452b-8e96-d73b5fe5c9a1 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:16.643769 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7faff9-6b82-452b-8e96-d73b5fe5c9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:16.643948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7faff9-6b82-452b-8e96-d73b5fe5c9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:16.666199 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-1a7faff9-6b82-452b-8e96-d73b5fe5c9a1 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:16.667357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1a7faff9-6b82-452b-8e96-d73b5fe5c9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:16.717915 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdba2a2-e797-4fa4-89e6-075ea8b9c24a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:16.766064 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 76/151] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:16.857899 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdba2a2-e797-4fa4-89e6-075ea8b9c24a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:16.862779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7faff9-6b82-452b-8e96-d73b5fe5c9a1 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:16.914095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:16.933053 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:16.941117 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac2a78-0fd0-4dc8-8aa8-d93af4658c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:16.941788 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac2a78-0fd0-4dc8-8aa8-d93af4658c1e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:16.942071 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac2a78-0fd0-4dc8-8aa8-d93af4658c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:16.942347 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ac2a78-0fd0-4dc8-8aa8-d93af4658c1e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:16.965809 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ac2a78-0fd0-4dc8-8aa8-d93af4658c1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:16.973297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-a4ac2a78-0fd0-4dc8-8aa8-d93af4658c1e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:16.973297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:16.973297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:16.973297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:16.973297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:16.973297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:16.973297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:16.973297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:16.973297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:16.973297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:16.973297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:16.973297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:16.973297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:16.973297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:16.973297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:16.973297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:16.974209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:16.974209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:16.974209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:16.974209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:16.974209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:16.974209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:16.974209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:16.974209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:16.974209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:16.974209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:16.974209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:16.974209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:16.974209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:16.974209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:16.974209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:16.974209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:16.974984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:16.974984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:16.974984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:16.974984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:16.974984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:16.974984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:16.974984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:16.974984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:16.974984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:16.974984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:16.974984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:16.974984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:43:16.974984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 76/152] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Sep 13 19:43:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:43:16.981804 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac2a78-0fd0-4dc8-8aa8-d93af4658c1e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:17.054415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7faff9-6b82-452b-8e96-d73b5fe5c9a1 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:17.088779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f6abf-6ccd-4b7e-a8aa-efe67a243ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:17.090024 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f6abf-6ccd-4b7e-a8aa-efe67a243ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:17.090307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f6abf-6ccd-4b7e-a8aa-efe67a243ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:17.090581 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f6abf-6ccd-4b7e-a8aa-efe67a243ea3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:17.101324 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f6abf-6ccd-4b7e-a8aa-efe67a243ea3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:17.106267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-758f6abf-6ccd-4b7e-a8aa-efe67a243ea3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:17.106267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:17.106267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:17.106267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:17.106267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:17.106267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:17.106267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:17.106267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:17.106267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:17.106267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:17.106267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:17.106267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:17.106267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:17.106267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:17.106267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:17.106267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:17.108690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:17.108690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:17.108690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:17.108690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:17.108690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:17.108690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:17.108690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:17.108690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:17.108690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:17.108690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:17.108690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:17.108690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:17.108690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:17.108690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:17.108690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:17.108690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:17.114727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:17.114727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:17.114727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:17.114727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:17.114727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:17.114727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:17.114727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:17.114727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:17.114727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:17.114727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:17.114727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:17.114727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:43:17.114727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 77/153] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:43:17.114727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a3d8c-b540-47bd-a9a2-02fcc4fa910b None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:17.115598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a3d8c-b540-47bd-a9a2-02fcc4fa910b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:17.115598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35a3d8c-b540-47bd-a9a2-02fcc4fa910b None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:17.115598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 78/154] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:17.115598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a3d8c-b540-47bd-a9a2-02fcc4fa910b None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:17.128081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ac2a78-0fd0-4dc8-8aa8-d93af4658c1e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:17.164135 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a84aa9-de5e-4c90-b417-f5d45677d705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:17.164766 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a84aa9-de5e-4c90-b417-f5d45677d705 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:17.165053 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a84aa9-de5e-4c90-b417-f5d45677d705 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:17.165324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a84aa9-de5e-4c90-b417-f5d45677d705 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:17.166070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a84aa9-de5e-4c90-b417-f5d45677d705 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:17.166375 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a84aa9-de5e-4c90-b417-f5d45677d705 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:17.167866 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a84aa9-de5e-4c90-b417-f5d45677d705 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:17.181438 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 77/155] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:43:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:17.181438 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1ca50-7bd0-4a71-a635-28df2b557a14 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:17.181438 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1ca50-7bd0-4a71-a635-28df2b557a14 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:17.181438 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad1ca50-7bd0-4a71-a635-28df2b557a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:17.201322 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9ad1ca50-7bd0-4a71-a635-28df2b557a14 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:17.202513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9ad1ca50-7bd0-4a71-a635-28df2b557a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:17.219412 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:17.232213 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35a3d8c-b540-47bd-a9a2-02fcc4fa910b None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:17.255859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:17.270809 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d44fd-afc5-469f-a32b-c0a50d3a4051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:17.271437 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d44fd-afc5-469f-a32b-c0a50d3a4051 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:17.271715 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d44fd-afc5-469f-a32b-c0a50d3a4051 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:17.271983 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d44fd-afc5-469f-a32b-c0a50d3a4051 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:17.273069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d44fd-afc5-469f-a32b-c0a50d3a4051 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:17.274533 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d44fd-afc5-469f-a32b-c0a50d3a4051 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:17.276102 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 79/156] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:17.276900 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d44fd-afc5-469f-a32b-c0a50d3a4051 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:17.278063 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 78/157] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:17.286668 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1ca50-7bd0-4a71-a635-28df2b557a14 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:17.377039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d44fd-afc5-469f-a32b-c0a50d3a4051 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:17.407680 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad1ca50-7bd0-4a71-a635-28df2b557a14 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:17.413568 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a4aaf4-46dc-40b3-a74a-d415f5a3147d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:17.414205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4aaf4-46dc-40b3-a74a-d415f5a3147d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:17.414483 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4aaf4-46dc-40b3-a74a-d415f5a3147d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:17.414758 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a4aaf4-46dc-40b3-a74a-d415f5a3147d None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:17.415448 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4aaf4-46dc-40b3-a74a-d415f5a3147d None admin] RBAC: Adding query filter params (name=member) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:17.415751 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4aaf4-46dc-40b3-a74a-d415f5a3147d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:17.417178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a4aaf4-46dc-40b3-a74a-d415f5a3147d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:17.425702 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 80/158] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:17.426868 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4de0a4-e00d-443d-a6d2-eebe733f5e23 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:17.427243 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4de0a4-e00d-443d-a6d2-eebe733f5e23 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:17.427522 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4de0a4-e00d-443d-a6d2-eebe733f5e23 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:17.428944 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 81/159] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:17.429442 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4de0a4-e00d-443d-a6d2-eebe733f5e23 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:17.451086 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397f4a8c-d2bf-4f9f-b38d-5ad931df428c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:17.451801 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f4a8c-d2bf-4f9f-b38d-5ad931df428c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:17.452025 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f4a8c-d2bf-4f9f-b38d-5ad931df428c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:17.452301 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397f4a8c-d2bf-4f9f-b38d-5ad931df428c None admin] PATH_INFO: `/v3/users/65d1c5d78251465898ee3d921a10e221` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:17.453420 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f4a8c-d2bf-4f9f-b38d-5ad931df428c None admin] RBAC: Authorizing `identity:get_user(user_id=65d1c5d78251465898ee3d921a10e221)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:17.454913 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397f4a8c-d2bf-4f9f-b38d-5ad931df428c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:17.456016 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:17.456504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 79/160] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:17 2022] GET /identity/v3/users/65d1c5d78251465898ee3d921a10e221 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:17.457722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0e89a-3d37-45e1-864e-a49689bc9235 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:17.457993 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0e89a-3d37-45e1-864e-a49689bc9235 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:17.458267 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f0e89a-3d37-45e1-864e-a49689bc9235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:17.475889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-81f0e89a-3d37-45e1-864e-a49689bc9235 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:17.477067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-81f0e89a-3d37-45e1-864e-a49689bc9235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:17.523171 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:17.545839 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4de0a4-e00d-443d-a6d2-eebe733f5e23 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:17.546070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 80/161] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:17.546900 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0e89a-3d37-45e1-864e-a49689bc9235 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:17.581877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ab89a-3036-4d93-aefd-e50f6f753ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:17.582476 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ab89a-3036-4d93-aefd-e50f6f753ef7 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:17.582750 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ab89a-3036-4d93-aefd-e50f6f753ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:17.583015 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291ab89a-3036-4d93-aefd-e50f6f753ef7 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:17.583656 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ab89a-3036-4d93-aefd-e50f6f753ef7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:17.585074 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-291ab89a-3036-4d93-aefd-e50f6f753ef7 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:17.644762 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f0e89a-3d37-45e1-864e-a49689bc9235 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:17.671023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 82/162] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Sep 13 19:43:17 2022] POST /identity/v3/users => generated 283 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:17.678885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ab89a-3036-4d93-aefd-e50f6f753ef7 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:17.685717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9d564-8e98-4c6e-ba36-b62c018714a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:17.686745 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9d564-8e98-4c6e-ba36-b62c018714a8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:17.687264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9d564-8e98-4c6e-ba36-b62c018714a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:17.687759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf9d564-8e98-4c6e-ba36-b62c018714a8 None admin] PATH_INFO: `/v3/users/65d1c5d78251465898ee3d921a10e221` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:17.689334 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf9d564-8e98-4c6e-ba36-b62c018714a8 None admin] RBAC: Authorizing `identity:get_user(user_id=65d1c5d78251465898ee3d921a10e221)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:17.691156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf9d564-8e98-4c6e-ba36-b62c018714a8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:17.693259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 81/163] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:17 2022] GET /identity/v3/users/65d1c5d78251465898ee3d921a10e221 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:17.694305 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9d564-8e98-4c6e-ba36-b62c018714a8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:17.751116 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:17.790053 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:17.818165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf9d564-8e98-4c6e-ba36-b62c018714a8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:17.823714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291ab89a-3036-4d93-aefd-e50f6f753ef7 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:17.857530 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92f1c1-5f76-443b-8508-da02f90146ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:17.859383 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92f1c1-5f76-443b-8508-da02f90146ab None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:17.859383 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92f1c1-5f76-443b-8508-da02f90146ab None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:17.859383 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92f1c1-5f76-443b-8508-da02f90146ab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:17.864964 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec322a57-4d29-403f-8263-2a5743144a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:17.865591 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec322a57-4d29-403f-8263-2a5743144a5c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:17.865941 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec322a57-4d29-403f-8263-2a5743144a5c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:17.866218 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec322a57-4d29-403f-8263-2a5743144a5c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:17.872305 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92f1c1-5f76-443b-8508-da02f90146ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:17.877475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ce92f1c1-5f76-443b-8508-da02f90146ab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:43:17.877475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:17.877475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:17.877475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:17.877475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:17.877475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:17.877475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:17.877475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:17.877475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:17.877475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:17.877475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:17.877475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:17.877475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:17.877475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:17.877475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:17.877475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:17.878586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:17.878586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:17.878586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:17.878586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:17.878586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:17.878586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:17.878586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:17.878586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:17.878586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:17.878586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:17.878586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:17.878586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:17.878586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:17.878586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:17.878586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:17.878586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:17.879417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:17.879417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:17.879417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:17.879417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:17.879417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:17.879417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:17.879417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:17.879417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:17.879417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:17.879417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:17.879417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:43:17.879417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:43:17.879417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 82/164] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:17.879417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92f1c1-5f76-443b-8508-da02f90146ab None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:17.948573 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec322a57-4d29-403f-8263-2a5743144a5c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:17.953085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec322a57-4d29-403f-8263-2a5743144a5c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:18.004598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92f1c1-5f76-443b-8508-da02f90146ab None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:18.015474 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:18.041675 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f6929-9738-49d5-8a1a-62c87f4339f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:18.042891 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f6929-9738-49d5-8a1a-62c87f4339f1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:18.043164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f6929-9738-49d5-8a1a-62c87f4339f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:18.043516 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104f6929-9738-49d5-8a1a-62c87f4339f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:18.052252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:18.082109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 83/165] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:18.082769 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec322a57-4d29-403f-8263-2a5743144a5c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:18.135791 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f6929-9738-49d5-8a1a-62c87f4339f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:18.137627 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104f6929-9738-49d5-8a1a-62c87f4339f1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:18.217058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec322a57-4d29-403f-8263-2a5743144a5c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:18.268935 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 83/166] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:18.269100 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3ca26-9390-488b-855c-cfe98942f292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:18.269210 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f6929-9738-49d5-8a1a-62c87f4339f1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:18.269289 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3ca26-9390-488b-855c-cfe98942f292 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:18.269289 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3ca26-9390-488b-855c-cfe98942f292 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:18.269289 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a3ca26-9390-488b-855c-cfe98942f292 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:18.278010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a3ca26-9390-488b-855c-cfe98942f292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:18.280727 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:18.283894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-40a3ca26-9390-488b-855c-cfe98942f292 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:18.283894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:18.283894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:18.283894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:18.283894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:18.283894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:18.283894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:18.283894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:18.283894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:18.283894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:18.283894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:18.283894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:18.283894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:18.283894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:18.283894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:18.283894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:18.284781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:18.284781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:18.284781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:18.284781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:18.284781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:18.284781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:18.284781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:18.284781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:18.284781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:18.284781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:18.284781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:18.284781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:18.284781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:18.284781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:18.284781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:18.284781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:18.286235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:18.286235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:18.286235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:18.286235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:18.286235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:18.286235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:18.286235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:18.286235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:18.286235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:18.286235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:18.286235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:18.286235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:43:18.286235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 84/167] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:18.286235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3ca26-9390-488b-855c-cfe98942f292 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:18.346111 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:18.395589 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104f6929-9738-49d5-8a1a-62c87f4339f1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:18.421355 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a3ca26-9390-488b-855c-cfe98942f292 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:18.458865 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25064ba4-7c8f-47f4-8a5a-9450d54d197b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:18.459892 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25064ba4-7c8f-47f4-8a5a-9450d54d197b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:18.460450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25064ba4-7c8f-47f4-8a5a-9450d54d197b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:18.460931 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25064ba4-7c8f-47f4-8a5a-9450d54d197b None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:18.461917 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25064ba4-7c8f-47f4-8a5a-9450d54d197b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:18.462426 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25064ba4-7c8f-47f4-8a5a-9450d54d197b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:18.464024 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25064ba4-7c8f-47f4-8a5a-9450d54d197b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:18.473506 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 84/168] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:18.474774 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25064ba4-7c8f-47f4-8a5a-9450d54d197b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:18.495843 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d03b6-8bc1-47f0-9dba-e20beda57442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:18.497016 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d03b6-8bc1-47f0-9dba-e20beda57442 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:18.498224 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d03b6-8bc1-47f0-9dba-e20beda57442 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:18.498868 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353d03b6-8bc1-47f0-9dba-e20beda57442 None admin] PATH_INFO: `/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:18.502808 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d03b6-8bc1-47f0-9dba-e20beda57442 None admin] RBAC: Authorizing `identity:get_project(project_id=de921f56e9d94e6c9a4cd2ca6b60f924)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:18.504495 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353d03b6-8bc1-47f0-9dba-e20beda57442 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:18.506524 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 85/169] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:18 2022] GET /identity/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:18.508650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d03b6-8bc1-47f0-9dba-e20beda57442 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:18.581201 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:18.653716 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25064ba4-7c8f-47f4-8a5a-9450d54d197b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:18.667847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353d03b6-8bc1-47f0-9dba-e20beda57442 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:18.669948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:18.687030 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726bf83-f8f6-4d3f-a9cc-c4f629c3ad52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:18.688237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726bf83-f8f6-4d3f-a9cc-c4f629c3ad52 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:18.688658 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726bf83-f8f6-4d3f-a9cc-c4f629c3ad52 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:18.689079 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726bf83-f8f6-4d3f-a9cc-c4f629c3ad52 None admin] PATH_INFO: `/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:18.690767 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726bf83-f8f6-4d3f-a9cc-c4f629c3ad52 None admin] RBAC: Authorizing `identity:get_project(project_id=de921f56e9d94e6c9a4cd2ca6b60f924)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:18.692589 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726bf83-f8f6-4d3f-a9cc-c4f629c3ad52 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:18.694867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 85/170] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:18 2022] GET /identity/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924 => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:18.695972 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726bf83-f8f6-4d3f-a9cc-c4f629c3ad52 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:18.755214 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ce3b9-a6a1-42e5-9b06-3eaa424ac671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:18.755862 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ce3b9-a6a1-42e5-9b06-3eaa424ac671 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:18.756287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ce3b9-a6a1-42e5-9b06-3eaa424ac671 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:18.756630 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0ce3b9-a6a1-42e5-9b06-3eaa424ac671 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:18.757368 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ce3b9-a6a1-42e5-9b06-3eaa424ac671 None admin] RBAC: Adding query filter params (name=member) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:18.757757 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ce3b9-a6a1-42e5-9b06-3eaa424ac671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:18.759213 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0ce3b9-a6a1-42e5-9b06-3eaa424ac671 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:18.777745 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 86/171] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:18.778772 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ce3b9-a6a1-42e5-9b06-3eaa424ac671 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:18.817645 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726bf83-f8f6-4d3f-a9cc-c4f629c3ad52 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:18.857320 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edfd88-aabf-4334-9b9a-54120a5d1763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:18.858545 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edfd88-aabf-4334-9b9a-54120a5d1763 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:18.859046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edfd88-aabf-4334-9b9a-54120a5d1763 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:18.859899 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0edfd88-aabf-4334-9b9a-54120a5d1763 None admin] PATH_INFO: `/v3/users/23fdca6ff03147df837f0c57b10a3d60` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:18.861327 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0edfd88-aabf-4334-9b9a-54120a5d1763 None admin] RBAC: Authorizing `identity:get_user(user_id=23fdca6ff03147df837f0c57b10a3d60)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:18.863156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0edfd88-aabf-4334-9b9a-54120a5d1763 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:18.864997 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 86/172] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:18 2022] GET /identity/v3/users/23fdca6ff03147df837f0c57b10a3d60 => generated 289 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:18.866227 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edfd88-aabf-4334-9b9a-54120a5d1763 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:18.871427 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:18.999856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0ce3b9-a6a1-42e5-9b06-3eaa424ac671 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:19.003734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0edfd88-aabf-4334-9b9a-54120a5d1763 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:19.044046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7819d0-aed7-4613-bec8-582903787a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:19.045289 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7819d0-aed7-4613-bec8-582903787a8d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:19.045811 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7819d0-aed7-4613-bec8-582903787a8d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:19.046364 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7819d0-aed7-4613-bec8-582903787a8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:19.047744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7819d0-aed7-4613-bec8-582903787a8d None admin] RBAC: Adding query filter params (role.id=033268df62114ee6bf4c0512568f2609, scope.project.id=de921f56e9d94e6c9a4cd2ca6b60f924, user.id=65d1c5d78251465898ee3d921a10e221) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:19.048362 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7819d0-aed7-4613-bec8-582903787a8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:19.050584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7819d0-aed7-4613-bec8-582903787a8d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:19.057491 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 87/173] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:18 2022] GET /identity/v3/role_assignments?user.id=65d1c5d78251465898ee3d921a10e221&scope.project.id=de921f56e9d94e6c9a4cd2ca6b60f924&role.id=033268df62114ee6bf4c0512568f2609 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:19.059378 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7819d0-aed7-4613-bec8-582903787a8d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:19.082646 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8768ea9-7b3a-46ea-9d69-10f89ca1df30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:19.083300 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8768ea9-7b3a-46ea-9d69-10f89ca1df30 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:19.083583 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8768ea9-7b3a-46ea-9d69-10f89ca1df30 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:19.083857 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8768ea9-7b3a-46ea-9d69-10f89ca1df30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:19.084684 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8768ea9-7b3a-46ea-9d69-10f89ca1df30 None admin] RBAC: Adding query filter params (role.id=d520f560be6d45539a966c6de2a934e7, scope.project.id=de921f56e9d94e6c9a4cd2ca6b60f924, user.id=65d1c5d78251465898ee3d921a10e221) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:19.085002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8768ea9-7b3a-46ea-9d69-10f89ca1df30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:19.086846 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8768ea9-7b3a-46ea-9d69-10f89ca1df30 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:19.103701 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 87/174] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:18 2022] GET /identity/v3/role_assignments?user.id=65d1c5d78251465898ee3d921a10e221&scope.project.id=de921f56e9d94e6c9a4cd2ca6b60f924&role.id=d520f560be6d45539a966c6de2a934e7 => generated 608 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:19.104586 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8768ea9-7b3a-46ea-9d69-10f89ca1df30 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:19.161005 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:19.204847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:19.218655 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7819d0-aed7-4613-bec8-582903787a8d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:19.326526 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72759db-995e-4045-9c82-95721a64d9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:19.327192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72759db-995e-4045-9c82-95721a64d9dd None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:19.327525 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72759db-995e-4045-9c82-95721a64d9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:19.327809 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72759db-995e-4045-9c82-95721a64d9dd None admin] PATH_INFO: `/v3/users/65d1c5d78251465898ee3d921a10e221` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:19.329094 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72759db-995e-4045-9c82-95721a64d9dd None admin] RBAC: Authorizing `identity:get_user(user_id=65d1c5d78251465898ee3d921a10e221)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:19.330618 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72759db-995e-4045-9c82-95721a64d9dd None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:19.332292 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 88/175] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:19 2022] GET /identity/v3/users/65d1c5d78251465898ee3d921a10e221 => generated 275 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:19.341179 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72759db-995e-4045-9c82-95721a64d9dd None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:19.362055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8768ea9-7b3a-46ea-9d69-10f89ca1df30 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:19.407882 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6060d-777d-4b15-8732-d225f1c0fdf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:19.408915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6060d-777d-4b15-8732-d225f1c0fdf3 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:19.409407 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6060d-777d-4b15-8732-d225f1c0fdf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:19.409926 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6060d-777d-4b15-8732-d225f1c0fdf3 None admin] PATH_INFO: `/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:19.411324 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6060d-777d-4b15-8732-d225f1c0fdf3 None admin] RBAC: Authorizing `identity:get_project(project_id=de921f56e9d94e6c9a4cd2ca6b60f924)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:19.413033 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6060d-777d-4b15-8732-d225f1c0fdf3 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:19.415295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 88/176] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:19 2022] GET /identity/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924 => generated 298 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:19.424864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6060d-777d-4b15-8732-d225f1c0fdf3 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:19.544401 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:19.551300 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6060d-777d-4b15-8732-d225f1c0fdf3 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:19.587572 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32d209-bbd3-4cd4-90e8-d9255a1d4d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:19.588546 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32d209-bbd3-4cd4-90e8-d9255a1d4d18 None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:19.588997 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32d209-bbd3-4cd4-90e8-d9255a1d4d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:19.589979 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a32d209-bbd3-4cd4-90e8-d9255a1d4d18 None admin] PATH_INFO: `/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924/users/23fdca6ff03147df837f0c57b10a3d60/roles/ec5168a1b302406fb0ec0082a2ed258a` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:19.591279 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72759db-995e-4045-9c82-95721a64d9dd None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:19.592308 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32d209-bbd3-4cd4-90e8-d9255a1d4d18 None admin] RBAC: Authorizing `identity:create_grant(project_id=de921f56e9d94e6c9a4cd2ca6b60f924, user_id=23fdca6ff03147df837f0c57b10a3d60, role_id=ec5168a1b302406fb0ec0082a2ed258a)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:19.594128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a32d209-bbd3-4cd4-90e8-d9255a1d4d18 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:19.640386 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239b3b9-bcdd-4c8d-9e09-e6b2402950ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:19.641010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239b3b9-bcdd-4c8d-9e09-e6b2402950ba None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:19.641293 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239b3b9-bcdd-4c8d-9e09-e6b2402950ba None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:19.641567 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4239b3b9-bcdd-4c8d-9e09-e6b2402950ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:19.649637 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:19.667893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 89/177] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Sep 13 19:43:19 2022] PUT /identity/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924/users/23fdca6ff03147df837f0c57b10a3d60/roles/ec5168a1b302406fb0ec0082a2ed258a => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:43:19.733358 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239b3b9-bcdd-4c8d-9e09-e6b2402950ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:19.734986 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4239b3b9-bcdd-4c8d-9e09-e6b2402950ba None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:19.851907 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 89/178] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:43:19.857771 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32d209-bbd3-4cd4-90e8-d9255a1d4d18 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:20.009907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a32d209-bbd3-4cd4-90e8-d9255a1d4d18 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:20.061190 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad744e-ca1b-429d-89b3-c936fe1235cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:20.062247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad744e-ca1b-429d-89b3-c936fe1235cb None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:20.062736 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad744e-ca1b-429d-89b3-c936fe1235cb None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:20.063226 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad744e-ca1b-429d-89b3-c936fe1235cb None admin] PATH_INFO: `/v3/projects/9c0d8481ab4d4d138bba32386b76ddb8` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:20.064583 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad744e-ca1b-429d-89b3-c936fe1235cb None admin] RBAC: Authorizing `identity:get_project(project_id=9c0d8481ab4d4d138bba32386b76ddb8)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:20.066277 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad744e-ca1b-429d-89b3-c936fe1235cb None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:20.068432 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 90/179] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:19 2022] GET /identity/v3/projects/9c0d8481ab4d4d138bba32386b76ddb8 => generated 312 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:20.074973 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239b3b9-bcdd-4c8d-9e09-e6b2402950ba None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:20.118433 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:20.194161 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4239b3b9-bcdd-4c8d-9e09-e6b2402950ba None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:20.232890 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09b5b83-7043-4fcc-a8d5-a38063a79a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:20.233932 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b5b83-7043-4fcc-a8d5-a38063a79a61 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:20.234416 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b5b83-7043-4fcc-a8d5-a38063a79a61 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:20.234889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09b5b83-7043-4fcc-a8d5-a38063a79a61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:20.235815 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b5b83-7043-4fcc-a8d5-a38063a79a61 None admin] RBAC: Adding query filter params (role.id=033268df62114ee6bf4c0512568f2609, scope.project.id=9c0d8481ab4d4d138bba32386b76ddb8, user.id=65d1c5d78251465898ee3d921a10e221) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:20.236323 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b5b83-7043-4fcc-a8d5-a38063a79a61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:20.238002 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09b5b83-7043-4fcc-a8d5-a38063a79a61 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:20.246179 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 90/180] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:20 2022] GET /identity/v3/role_assignments?user.id=65d1c5d78251465898ee3d921a10e221&scope.project.id=9c0d8481ab4d4d138bba32386b76ddb8&role.id=033268df62114ee6bf4c0512568f2609 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:20.536294 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb117c-98ae-4721-8031-f585e045f7d7 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:20.537030 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb117c-98ae-4721-8031-f585e045f7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:20.537521 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bb117c-98ae-4721-8031-f585e045f7d7 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:20.539393 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 91/181] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:20.545047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d829d-f683-47c9-9019-ac7f9b92c18e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:20.545338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d829d-f683-47c9-9019-ac7f9b92c18e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:20.545612 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698d829d-f683-47c9-9019-ac7f9b92c18e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:20.568086 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-698d829d-f683-47c9-9019-ac7f9b92c18e None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:20.569597 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-698d829d-f683-47c9-9019-ac7f9b92c18e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:20.656415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 91/182] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:20.780572 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac859d-3956-42f8-afc5-a38fc5026dfc None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:20.780886 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac859d-3956-42f8-afc5-a38fc5026dfc None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:20.781362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbac859d-3956-42f8-afc5-a38fc5026dfc None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:20.782783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 92/183] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:20.788875 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037119f-8bab-4b8d-8118-9e76c9730c0c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:20.789798 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037119f-8bab-4b8d-8118-9e76c9730c0c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:20.790278 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b037119f-8bab-4b8d-8118-9e76c9730c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:20.811046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b037119f-8bab-4b8d-8118-9e76c9730c0c None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:20.812499 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b037119f-8bab-4b8d-8118-9e76c9730c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:20.836283 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:20.889739 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 92/184] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:20.891394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d90a21-6575-4cd4-9548-15460058cfc6 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:20.892528 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d90a21-6575-4cd4-9548-15460058cfc6 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:20.892933 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d90a21-6575-4cd4-9548-15460058cfc6 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:20.894461 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 93/185] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:20.902736 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6845d8d-7b62-40bd-843d-7f77871b333a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:20.903180 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6845d8d-7b62-40bd-843d-7f77871b333a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:20.903593 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6845d8d-7b62-40bd-843d-7f77871b333a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:20.923066 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c6845d8d-7b62-40bd-843d-7f77871b333a None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:20.924477 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c6845d8d-7b62-40bd-843d-7f77871b333a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:20.952743 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d90a21-6575-4cd4-9548-15460058cfc6 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:20.982111 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:20.996339 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 93/186] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:21.066361 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d90a21-6575-4cd4-9548-15460058cfc6 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:21.101074 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57df368-1b06-47c6-acc8-125ee80ef712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:21.106514 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57df368-1b06-47c6-acc8-125ee80ef712 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:21.107062 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57df368-1b06-47c6-acc8-125ee80ef712 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:21.107530 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57df368-1b06-47c6-acc8-125ee80ef712 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:21.120499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57df368-1b06-47c6-acc8-125ee80ef712 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:21.127108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-b57df368-1b06-47c6-acc8-125ee80ef712 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:21.127108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:21.127108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:21.127108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:21.127108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:21.127108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:21.127108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:21.127108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:21.127108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:21.127108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:21.127108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:21.127108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:21.127108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:21.127108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:21.127108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:21.127108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:21.127974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:21.127974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:21.127974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:21.127974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:21.127974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:21.127974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:21.127974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:21.127974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:21.127974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:21.127974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:21.127974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:21.127974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:21.127974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:21.127974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:21.127974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:21.127974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:21.128801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:21.128801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:21.128801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:21.128801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:21.128801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:21.128801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:21.128801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:21.128801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:21.128801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:21.128801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:21.128801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:21.128801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:43:21.131146 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 94/187] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:43:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:43:21.139533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6845d8d-7b62-40bd-843d-7f77871b333a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:21.181737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57df368-1b06-47c6-acc8-125ee80ef712 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:21.242030 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:21.256597 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6845d8d-7b62-40bd-843d-7f77871b333a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:21.283152 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:21.293900 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57df368-1b06-47c6-acc8-125ee80ef712 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:21.300481 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2fb28-64c4-4d62-91a2-63dd7c5746e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:21.301633 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2fb28-64c4-4d62-91a2-63dd7c5746e8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:21.302098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2fb28-64c4-4d62-91a2-63dd7c5746e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:21.302523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda2fb28-64c4-4d62-91a2-63dd7c5746e8 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:21.303688 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2fb28-64c4-4d62-91a2-63dd7c5746e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:21.304141 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2fb28-64c4-4d62-91a2-63dd7c5746e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:21.306250 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda2fb28-64c4-4d62-91a2-63dd7c5746e8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:21.317279 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 94/188] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:21.317949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2fb28-64c4-4d62-91a2-63dd7c5746e8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:21.329227 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50788c4f-1384-4c7c-b8f0-0c2d724bd56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:21.330807 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50788c4f-1384-4c7c-b8f0-0c2d724bd56a None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:21.331250 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50788c4f-1384-4c7c-b8f0-0c2d724bd56a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:21.333564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50788c4f-1384-4c7c-b8f0-0c2d724bd56a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:21.333564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50788c4f-1384-4c7c-b8f0-0c2d724bd56a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:21.335118 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50788c4f-1384-4c7c-b8f0-0c2d724bd56a None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:21.336840 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 95/189] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:21.337449 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50788c4f-1384-4c7c-b8f0-0c2d724bd56a None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:21.425838 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda2fb28-64c4-4d62-91a2-63dd7c5746e8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:21.444233 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50788c4f-1384-4c7c-b8f0-0c2d724bd56a None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:21.459814 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79aae2-86b4-44b0-ae4d-5288ccab16d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:21.460444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79aae2-86b4-44b0-ae4d-5288ccab16d3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:21.460726 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79aae2-86b4-44b0-ae4d-5288ccab16d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:21.461055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79aae2-86b4-44b0-ae4d-5288ccab16d3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:21.472122 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79aae2-86b4-44b0-ae4d-5288ccab16d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:21.477467 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-9f79aae2-86b4-44b0-ae4d-5288ccab16d3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:21.477467 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:21.477467 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:21.477467 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:21.477467 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:21.477467 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:21.477467 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:21.477467 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:21.477467 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:21.477467 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:21.477467 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:21.477467 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:21.477467 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:21.477467 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:21.477467 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:21.477467 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:21.478395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:21.478395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:21.478395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:21.478395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:21.478395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:21.478395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:21.478395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:21.478395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:21.478395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:21.478395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:21.478395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:21.478395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:21.478395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:21.478395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:21.478395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:21.478395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:21.479216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:21.479216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:21.479216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:21.479216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:21.479216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:21.479216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:21.479216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:21.479216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:21.479216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:21.479216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:21.479216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:21.479216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:43:21.479216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 95/190] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Sep 13 19:43:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:21.479952 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79aae2-86b4-44b0-ae4d-5288ccab16d3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:21.487633 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cf6a9-4368-4bb2-ab48-fe1749b1e487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:21.488293 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cf6a9-4368-4bb2-ab48-fe1749b1e487 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:21.488571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cf6a9-4368-4bb2-ab48-fe1749b1e487 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:21.488841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8cf6a9-4368-4bb2-ab48-fe1749b1e487 None admin] PATH_INFO: `/v3/users/0c394b9280b04660b9f20510b078e28e` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:21.496189 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:21.503363 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8cf6a9-4368-4bb2-ab48-fe1749b1e487 None admin] RBAC: Authorizing `identity:get_user(user_id=0c394b9280b04660b9f20510b078e28e)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:21.505884 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8cf6a9-4368-4bb2-ab48-fe1749b1e487 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:21.507762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 96/191] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:21 2022] GET /identity/v3/users/0c394b9280b04660b9f20510b078e28e => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:21.508689 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cf6a9-4368-4bb2-ab48-fe1749b1e487 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:21.521529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:21.593557 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79aae2-86b4-44b0-ae4d-5288ccab16d3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:21.614028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8cf6a9-4368-4bb2-ab48-fe1749b1e487 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:21.629469 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df847539-eba1-48be-8446-32adc357a2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:21.630113 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df847539-eba1-48be-8446-32adc357a2b4 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:21.630393 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df847539-eba1-48be-8446-32adc357a2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:21.630665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df847539-eba1-48be-8446-32adc357a2b4 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:21.631345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df847539-eba1-48be-8446-32adc357a2b4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:21.632777 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df847539-eba1-48be-8446-32adc357a2b4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:21.650188 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d9030-26d5-48c2-a8ce-814c7b69b03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:21.651168 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d9030-26d5-48c2-a8ce-814c7b69b03f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:21.651480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d9030-26d5-48c2-a8ce-814c7b69b03f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:21.651881 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39d9030-26d5-48c2-a8ce-814c7b69b03f None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:21.652549 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d9030-26d5-48c2-a8ce-814c7b69b03f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:21.652879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d9030-26d5-48c2-a8ce-814c7b69b03f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:21.654283 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39d9030-26d5-48c2-a8ce-814c7b69b03f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:21.662168 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 97/192] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:43:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:21.666624 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d9030-26d5-48c2-a8ce-814c7b69b03f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:21.734078 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:21.747514 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 96/193] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Sep 13 19:43:21 2022] POST /identity/v3/users => generated 297 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:21.748425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df847539-eba1-48be-8446-32adc357a2b4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:21.780646 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39d9030-26d5-48c2-a8ce-814c7b69b03f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:21.819873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05cc4c2-6a3f-4bee-bb92-40959d7b8017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:21.820759 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cc4c2-6a3f-4bee-bb92-40959d7b8017 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:21.821213 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cc4c2-6a3f-4bee-bb92-40959d7b8017 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:21.821643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05cc4c2-6a3f-4bee-bb92-40959d7b8017 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:21.851722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:21.908046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df847539-eba1-48be-8446-32adc357a2b4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:21.919685 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05cc4c2-6a3f-4bee-bb92-40959d7b8017 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:21.922342 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05cc4c2-6a3f-4bee-bb92-40959d7b8017 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:21.961145 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ab172-4399-4f2b-80d9-648e20102a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:21.962274 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ab172-4399-4f2b-80d9-648e20102a2c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:21.962863 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ab172-4399-4f2b-80d9-648e20102a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:21.963144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ab172-4399-4f2b-80d9-648e20102a2c None admin] PATH_INFO: `/v3/users/0c394b9280b04660b9f20510b078e28e` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:21.964368 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ab172-4399-4f2b-80d9-648e20102a2c None admin] RBAC: Authorizing `identity:get_user(user_id=0c394b9280b04660b9f20510b078e28e)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:21.966629 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ab172-4399-4f2b-80d9-648e20102a2c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:21.968217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 97/194] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:21 2022] GET /identity/v3/users/0c394b9280b04660b9f20510b078e28e => generated 283 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:21.974803 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ab172-4399-4f2b-80d9-648e20102a2c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:22.024244 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:22.067469 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 98/195] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:22.073068 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05cc4c2-6a3f-4bee-bb92-40959d7b8017 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:22.107849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ab172-4399-4f2b-80d9-648e20102a2c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:22.150307 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b7276-5a6a-441b-a171-6f52649a1a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:22.150513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b7276-5a6a-441b-a171-6f52649a1a27 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:22.150764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b7276-5a6a-441b-a171-6f52649a1a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:22.151042 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b7276-5a6a-441b-a171-6f52649a1a27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:22.156343 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:22.203378 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05cc4c2-6a3f-4bee-bb92-40959d7b8017 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:22.233834 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b7276-5a6a-441b-a171-6f52649a1a27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:22.236327 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b7276-5a6a-441b-a171-6f52649a1a27 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:22.249808 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a29027-5f70-4b74-9f61-1d5f27cb3057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:22.250449 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a29027-5f70-4b74-9f61-1d5f27cb3057 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:22.250779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a29027-5f70-4b74-9f61-1d5f27cb3057 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:22.251055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a29027-5f70-4b74-9f61-1d5f27cb3057 None admin] PATH_INFO: `/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:22.252246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a29027-5f70-4b74-9f61-1d5f27cb3057 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb590e1a96a41bbbe00a0a9a82d9126)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:22.253710 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a29027-5f70-4b74-9f61-1d5f27cb3057 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:22.255349 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 99/196] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:22 2022] GET /identity/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:22.261524 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a29027-5f70-4b74-9f61-1d5f27cb3057 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:22.318264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:22.366419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 98/197] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:43:22.372700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b7276-5a6a-441b-a171-6f52649a1a27 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:22.396156 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a29027-5f70-4b74-9f61-1d5f27cb3057 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:22.409665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:22.441517 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a4ec00-08ea-45af-98d4-4e79b23fa7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:22.442424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4ec00-08ea-45af-98d4-4e79b23fa7e4 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:22.442714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4ec00-08ea-45af-98d4-4e79b23fa7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:22.442987 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a4ec00-08ea-45af-98d4-4e79b23fa7e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:22.443723 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4ec00-08ea-45af-98d4-4e79b23fa7e4 None admin] RBAC: Adding query filter params (role.id=cd02ef2043de492a8bff6c165485f255, scope.project.id=dcb590e1a96a41bbbe00a0a9a82d9126, user.id=0c394b9280b04660b9f20510b078e28e) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:22.444039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4ec00-08ea-45af-98d4-4e79b23fa7e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:22.445479 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a4ec00-08ea-45af-98d4-4e79b23fa7e4 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:22.451492 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 100/198] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:22 2022] GET /identity/v3/role_assignments?user.id=0c394b9280b04660b9f20510b078e28e&scope.project.id=dcb590e1a96a41bbbe00a0a9a82d9126&role.id=cd02ef2043de492a8bff6c165485f255 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:22.452831 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154a9f5-f3b8-49ce-80da-1b3d1cda53d7 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:22.453176 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154a9f5-f3b8-49ce-80da-1b3d1cda53d7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:22.453459 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154a9f5-f3b8-49ce-80da-1b3d1cda53d7 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:22.454855 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 101/199] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:22.467031 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686e59b-7ae7-4223-87e6-94d276e484b6 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:22.467362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686e59b-7ae7-4223-87e6-94d276e484b6 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:22.467639 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5686e59b-7ae7-4223-87e6-94d276e484b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:22.489161 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-5686e59b-7ae7-4223-87e6-94d276e484b6 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:22.490566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5686e59b-7ae7-4223-87e6-94d276e484b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:22.492918 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b7276-5a6a-441b-a171-6f52649a1a27 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:22.539437 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465119ff-873e-4d9f-8470-a357e5ac8682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:22.540607 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465119ff-873e-4d9f-8470-a357e5ac8682 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:22.541039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465119ff-873e-4d9f-8470-a357e5ac8682 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:22.541457 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465119ff-873e-4d9f-8470-a357e5ac8682 None admin] PATH_INFO: `/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:22.543988 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465119ff-873e-4d9f-8470-a357e5ac8682 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb590e1a96a41bbbe00a0a9a82d9126)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:22.546043 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465119ff-873e-4d9f-8470-a357e5ac8682 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:22.548490 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 99/200] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:22 2022] GET /identity/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126 => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:22.554933 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465119ff-873e-4d9f-8470-a357e5ac8682 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:22.586754 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 102/201] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:22.717455 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465119ff-873e-4d9f-8470-a357e5ac8682 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:22.720672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:22.757073 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138a43a-4bd8-480a-92a0-5bb143965b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:22.757979 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138a43a-4bd8-480a-92a0-5bb143965b8d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:22.758429 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138a43a-4bd8-480a-92a0-5bb143965b8d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:22.758850 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138a43a-4bd8-480a-92a0-5bb143965b8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:22.759815 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138a43a-4bd8-480a-92a0-5bb143965b8d None admin] RBAC: Adding query filter params (role.id=d520f560be6d45539a966c6de2a934e7, scope.project.id=dcb590e1a96a41bbbe00a0a9a82d9126, user.id=0c394b9280b04660b9f20510b078e28e) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:22.760271 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138a43a-4bd8-480a-92a0-5bb143965b8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:22.762707 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138a43a-4bd8-480a-92a0-5bb143965b8d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:22.772222 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 100/202] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:22 2022] GET /identity/v3/role_assignments?user.id=0c394b9280b04660b9f20510b078e28e&scope.project.id=dcb590e1a96a41bbbe00a0a9a82d9126&role.id=d520f560be6d45539a966c6de2a934e7 => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:23.026218 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686e59b-7ae7-4223-87e6-94d276e484b6 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:23.067610 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:23.149449 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5686e59b-7ae7-4223-87e6-94d276e484b6 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:23.195781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f58e1e-b8f1-4305-8acb-88180484165b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:23.196418 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f58e1e-b8f1-4305-8acb-88180484165b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:23.196692 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f58e1e-b8f1-4305-8acb-88180484165b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:23.196957 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f58e1e-b8f1-4305-8acb-88180484165b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:23.210722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f58e1e-b8f1-4305-8acb-88180484165b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:23.216158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-a4f58e1e-b8f1-4305-8acb-88180484165b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:43:23.216158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:23.216158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:23.216158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:23.216158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:23.216158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:23.216158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:23.216158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:23.216158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:23.216158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:23.216158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:23.216158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:23.216158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:23.216158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:23.216158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:23.216158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:23.217056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:23.217056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:23.217056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:23.217056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:23.217056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:23.217056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:23.217056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:23.217056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:23.217056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:23.217056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:23.217056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:23.217056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:23.217056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:23.217056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:23.217056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:23.217056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:23.217885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:23.217885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:23.217885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:23.217885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:23.217885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:23.217885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:23.217885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:23.217885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:23.217885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:23.217885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:23.217885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:43:23.217885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:43:23.217885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 103/203] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:23.225509 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138a43a-4bd8-480a-92a0-5bb143965b8d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:23.400567 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138a43a-4bd8-480a-92a0-5bb143965b8d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:23.449549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfad4b0-c50b-49df-a508-0e1951d3d67a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:23.450191 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfad4b0-c50b-49df-a508-0e1951d3d67a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:23.450471 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfad4b0-c50b-49df-a508-0e1951d3d67a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:23.450744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfad4b0-c50b-49df-a508-0e1951d3d67a None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:23.451405 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfad4b0-c50b-49df-a508-0e1951d3d67a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:23.451709 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfad4b0-c50b-49df-a508-0e1951d3d67a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:23.453095 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfad4b0-c50b-49df-a508-0e1951d3d67a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:23.461462 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 101/204] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:23.467524 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f58e1e-b8f1-4305-8acb-88180484165b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:23.591357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:23.598135 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f58e1e-b8f1-4305-8acb-88180484165b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:23.647247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3cd83-eaa3-4b20-94ba-215765605ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:23.647889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3cd83-eaa3-4b20-94ba-215765605ac1 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:23.648171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3cd83-eaa3-4b20-94ba-215765605ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:23.648444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c3cd83-eaa3-4b20-94ba-215765605ac1 None admin] PATH_INFO: `/v3/users/23fdca6ff03147df837f0c57b10a3d60` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:23.649581 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3cd83-eaa3-4b20-94ba-215765605ac1 None admin] RBAC: Authorizing `identity:get_user(user_id=23fdca6ff03147df837f0c57b10a3d60)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:23.651110 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c3cd83-eaa3-4b20-94ba-215765605ac1 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:23.652656 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 104/205] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:23 2022] GET /identity/v3/users/23fdca6ff03147df837f0c57b10a3d60 => generated 289 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:23.658192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfad4b0-c50b-49df-a508-0e1951d3d67a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:23.690159 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:23.779475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfad4b0-c50b-49df-a508-0e1951d3d67a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:23.827368 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca2957-6db5-42ce-8421-983bf90476b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:23.828038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca2957-6db5-42ce-8421-983bf90476b2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:23.828320 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca2957-6db5-42ce-8421-983bf90476b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:23.828641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ca2957-6db5-42ce-8421-983bf90476b2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:23.911531 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca2957-6db5-42ce-8421-983bf90476b2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:23.913011 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ca2957-6db5-42ce-8421-983bf90476b2 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:23.951908 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:24.035597 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 102/206] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:24.041316 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3cd83-eaa3-4b20-94ba-215765605ac1 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:24.165111 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c3cd83-eaa3-4b20-94ba-215765605ac1 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:24.203183 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b947e76-5b6f-47ba-a263-0dcb712b7891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:24.203823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b947e76-5b6f-47ba-a263-0dcb712b7891 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:24.204104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b947e76-5b6f-47ba-a263-0dcb712b7891 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:24.204377 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b947e76-5b6f-47ba-a263-0dcb712b7891 None admin] PATH_INFO: `/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:24.205560 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b947e76-5b6f-47ba-a263-0dcb712b7891 None admin] RBAC: Authorizing `identity:get_project(project_id=de921f56e9d94e6c9a4cd2ca6b60f924)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:24.207032 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b947e76-5b6f-47ba-a263-0dcb712b7891 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:24.208973 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 105/207] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:24 2022] GET /identity/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:24.215332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca2957-6db5-42ce-8421-983bf90476b2 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:24.338105 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ca2957-6db5-42ce-8421-983bf90476b2 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:24.377452 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:24.385057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acd8dd-1779-4377-8dad-775dca2999a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:24.386224 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acd8dd-1779-4377-8dad-775dca2999a8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:24.386569 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acd8dd-1779-4377-8dad-775dca2999a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:24.386848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acd8dd-1779-4377-8dad-775dca2999a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:24.387580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acd8dd-1779-4377-8dad-775dca2999a8 None admin] RBAC: Adding query filter params (role.id=ec5168a1b302406fb0ec0082a2ed258a, scope.project.id=de921f56e9d94e6c9a4cd2ca6b60f924, user.id=23fdca6ff03147df837f0c57b10a3d60) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:24.387888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acd8dd-1779-4377-8dad-775dca2999a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:24.389415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acd8dd-1779-4377-8dad-775dca2999a8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:24.398222 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 103/208] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:24 2022] GET /identity/v3/role_assignments?user.id=23fdca6ff03147df837f0c57b10a3d60&scope.project.id=de921f56e9d94e6c9a4cd2ca6b60f924&role.id=ec5168a1b302406fb0ec0082a2ed258a => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:24.760348 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dad8a3-a7c7-4ed6-97f6-2834526429b3 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:24.761872 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dad8a3-a7c7-4ed6-97f6-2834526429b3 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:24.762363 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dad8a3-a7c7-4ed6-97f6-2834526429b3 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:24.764168 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 106/209] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:24.771650 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43168ae3-48d7-4644-8da3-1e928f40025a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:24.771937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43168ae3-48d7-4644-8da3-1e928f40025a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:24.772209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43168ae3-48d7-4644-8da3-1e928f40025a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:24.794317 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-43168ae3-48d7-4644-8da3-1e928f40025a None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:24.795517 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-43168ae3-48d7-4644-8da3-1e928f40025a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:24.838923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2be71f-b807-42b5-8c8a-9b7bf3d6b94d None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:24.839241 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2be71f-b807-42b5-8c8a-9b7bf3d6b94d None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:24.839475 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2be71f-b807-42b5-8c8a-9b7bf3d6b94d None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:24.840808 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 107/210] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:43:24.846772 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de33ed8-86b3-4dec-98b2-e93994c4504d None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:24.847064 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de33ed8-86b3-4dec-98b2-e93994c4504d None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:24.847344 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de33ed8-86b3-4dec-98b2-e93994c4504d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:24.868206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-6de33ed8-86b3-4dec-98b2-e93994c4504d None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:24.869807 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6de33ed8-86b3-4dec-98b2-e93994c4504d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:24.870938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 104/211] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:24.915834 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:24.966267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 108/212] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:25.023231 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db351d-ba37-459a-9a26-5a25ff77b595 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:25.023433 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db351d-ba37-459a-9a26-5a25ff77b595 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:25.023914 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8db351d-ba37-459a-9a26-5a25ff77b595 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:25.025442 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 105/213] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:25.030842 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8996a-4388-4ea0-afdd-4bc31d9e538c None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:25.031124 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8996a-4388-4ea0-afdd-4bc31d9e538c None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:25.031393 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d8996a-4388-4ea0-afdd-4bc31d9e538c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:25.052752 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-86d8996a-4388-4ea0-afdd-4bc31d9e538c None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:25.053931 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-86d8996a-4388-4ea0-afdd-4bc31d9e538c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:25.131934 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 109/214] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:25.171216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db351d-ba37-459a-9a26-5a25ff77b595 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:25.276340 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8db351d-ba37-459a-9a26-5a25ff77b595 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:25.293448 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8996a-4388-4ea0-afdd-4bc31d9e538c None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:25.313450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a9dad-61e1-4fef-a344-179c28ec2035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:25.314123 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a9dad-61e1-4fef-a344-179c28ec2035 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:25.314406 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a9dad-61e1-4fef-a344-179c28ec2035 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:25.314677 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a9dad-61e1-4fef-a344-179c28ec2035 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:25.325595 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a9dad-61e1-4fef-a344-179c28ec2035 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:25.331070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-f34a9dad-61e1-4fef-a344-179c28ec2035 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:25.331070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:25.331070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:25.331070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:25.331070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:25.331070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:25.331070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:25.331070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:25.331070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:25.331070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:25.331070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:25.331070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:25.331070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:25.331070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:25.331070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:25.331070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:25.331978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:25.331978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:25.331978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:25.331978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:25.331978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:25.331978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:25.331978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:25.331978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:25.331978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:25.331978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:25.331978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:25.331978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:25.331978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:25.331978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:25.331978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:25.331978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:25.332797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:25.332797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:25.332797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:25.332797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:25.332797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:25.332797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:25.332797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:25.332797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:25.332797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:25.332797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:25.332797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:25.332797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:43:25.332797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 106/215] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:25.332797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:25.337953 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a9dad-61e1-4fef-a344-179c28ec2035 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:25.410006 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:25.422710 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d8996a-4388-4ea0-afdd-4bc31d9e538c None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:25.446013 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a9dad-61e1-4fef-a344-179c28ec2035 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:25.465875 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5871ee7-ecef-45e8-845d-51eb54fffbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:25.467170 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5871ee7-ecef-45e8-845d-51eb54fffbd6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:25.467882 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5871ee7-ecef-45e8-845d-51eb54fffbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:25.468346 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5871ee7-ecef-45e8-845d-51eb54fffbd6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:25.469614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5871ee7-ecef-45e8-845d-51eb54fffbd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:25.471067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5871ee7-ecef-45e8-845d-51eb54fffbd6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:25.473315 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 110/216] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:25.474148 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5871ee7-ecef-45e8-845d-51eb54fffbd6 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:25.481982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2528f4-a6c3-4122-9402-e3b1389928fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:25.482616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2528f4-a6c3-4122-9402-e3b1389928fe None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:25.482894 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2528f4-a6c3-4122-9402-e3b1389928fe None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:25.483266 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2528f4-a6c3-4122-9402-e3b1389928fe None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:25.483939 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2528f4-a6c3-4122-9402-e3b1389928fe None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:25.484239 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2528f4-a6c3-4122-9402-e3b1389928fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:25.485632 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2528f4-a6c3-4122-9402-e3b1389928fe None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:25.499257 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 107/217] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:25.499257 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2528f4-a6c3-4122-9402-e3b1389928fe None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:25.551062 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:25.596114 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5871ee7-ecef-45e8-845d-51eb54fffbd6 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:25.605039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2528f4-a6c3-4122-9402-e3b1389928fe None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:25.632442 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9db047-ffc1-436a-b50f-bbb5f72ec68f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:25.633075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9db047-ffc1-436a-b50f-bbb5f72ec68f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:25.633350 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9db047-ffc1-436a-b50f-bbb5f72ec68f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:25.633643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9db047-ffc1-436a-b50f-bbb5f72ec68f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:25.637970 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6c8346-4719-4a57-b433-46decc4e9d22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:25.638559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c8346-4719-4a57-b433-46decc4e9d22 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:25.638833 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c8346-4719-4a57-b433-46decc4e9d22 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:25.639097 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c8346-4719-4a57-b433-46decc4e9d22 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:25.639731 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c8346-4719-4a57-b433-46decc4e9d22 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:25.641165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6c8346-4719-4a57-b433-46decc4e9d22 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:25.644138 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9db047-ffc1-436a-b50f-bbb5f72ec68f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:25.648958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-7a9db047-ffc1-436a-b50f-bbb5f72ec68f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:25.648958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:25.648958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:25.648958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:25.648958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:25.648958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:25.648958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:25.648958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:25.648958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:25.648958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:25.648958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:25.648958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:25.648958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:25.648958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:25.648958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:25.648958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:25.650039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:25.650039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:25.650039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:25.650039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:25.650039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:25.650039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:25.650039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:25.650039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:25.650039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:25.650039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:25.650039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:25.650039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:25.650039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:25.650039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:25.650039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:25.650039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:25.654615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:25.654615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:25.654615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:25.654615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:25.654615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:25.654615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:25.654615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:25.654615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:25.654615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:25.654615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:25.654615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:25.654615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:43:25.654615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 111/218] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:43:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:25.654615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9db047-ffc1-436a-b50f-bbb5f72ec68f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:25.671778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:25.730230 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 108/219] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Sep 13 19:43:25 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:25.731728 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676041ee-5b26-4a7e-822a-259cf842a388 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:25.732016 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676041ee-5b26-4a7e-822a-259cf842a388 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:25.732470 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676041ee-5b26-4a7e-822a-259cf842a388 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:25.733540 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 109/220] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:25.734313 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676041ee-5b26-4a7e-822a-259cf842a388 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:25.764991 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9db047-ffc1-436a-b50f-bbb5f72ec68f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:25.803557 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0389f604-b5f8-4292-8070-27f7f828ade9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:25.804130 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389f604-b5f8-4292-8070-27f7f828ade9 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:25.804409 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389f604-b5f8-4292-8070-27f7f828ade9 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:25.804688 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0389f604-b5f8-4292-8070-27f7f828ade9 None admin] PATH_INFO: `/v3/users/172f7a977bc64402b6a4b11cb7aa04f6` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:25.819938 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389f604-b5f8-4292-8070-27f7f828ade9 None admin] RBAC: Authorizing `identity:get_user(user_id=172f7a977bc64402b6a4b11cb7aa04f6)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:25.821453 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0389f604-b5f8-4292-8070-27f7f828ade9 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:25.828335 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 112/221] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:25 2022] GET /identity/v3/users/172f7a977bc64402b6a4b11cb7aa04f6 => generated 297 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:25.828335 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e132b-fac1-4406-9f10-5d5f7934c386 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:25.828335 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e132b-fac1-4406-9f10-5d5f7934c386 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:25.828335 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111e132b-fac1-4406-9f10-5d5f7934c386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:25.845003 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-111e132b-fac1-4406-9f10-5d5f7934c386 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:25.846277 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-111e132b-fac1-4406-9f10-5d5f7934c386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:25.869129 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676041ee-5b26-4a7e-822a-259cf842a388 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:25.870884 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:25.907876 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf57e3f-90fe-4251-af68-1472014140cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:25.908490 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf57e3f-90fe-4251-af68-1472014140cb None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:25.908775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf57e3f-90fe-4251-af68-1472014140cb None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:25.909051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf57e3f-90fe-4251-af68-1472014140cb None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:25.909793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf57e3f-90fe-4251-af68-1472014140cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:25.913209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf57e3f-90fe-4251-af68-1472014140cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:25.913209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf57e3f-90fe-4251-af68-1472014140cb None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:25.920127 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 110/222] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:25.925949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf57e3f-90fe-4251-af68-1472014140cb None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:25.936905 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 113/223] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:25.937804 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e132b-fac1-4406-9f10-5d5f7934c386 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:25.946668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:26.052900 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf57e3f-90fe-4251-af68-1472014140cb None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:26.067614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111e132b-fac1-4406-9f10-5d5f7934c386 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:26.097645 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6433ab7-e4d9-4abb-a863-9d1a1a9c0613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:26.098521 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6433ab7-e4d9-4abb-a863-9d1a1a9c0613 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:26.098803 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6433ab7-e4d9-4abb-a863-9d1a1a9c0613 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:26.099076 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6433ab7-e4d9-4abb-a863-9d1a1a9c0613 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:26.112133 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9415b72-cecf-4fb0-9539-b5a71d89bad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:26.113353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9415b72-cecf-4fb0-9539-b5a71d89bad9 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:26.113634 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9415b72-cecf-4fb0-9539-b5a71d89bad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:26.113950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9415b72-cecf-4fb0-9539-b5a71d89bad9 None admin] PATH_INFO: `/v3/users/0c394b9280b04660b9f20510b078e28e` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:26.115238 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9415b72-cecf-4fb0-9539-b5a71d89bad9 None admin] RBAC: Authorizing `identity:get_user(user_id=0c394b9280b04660b9f20510b078e28e)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:26.116811 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9415b72-cecf-4fb0-9539-b5a71d89bad9 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:26.119175 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 114/224] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:25 2022] GET /identity/v3/users/0c394b9280b04660b9f20510b078e28e => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:26.125022 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9415b72-cecf-4fb0-9539-b5a71d89bad9 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:26.149153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:26.180462 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6433ab7-e4d9-4abb-a863-9d1a1a9c0613 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:26.181963 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6433ab7-e4d9-4abb-a863-9d1a1a9c0613 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:26.204132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:26.231222 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9415b72-cecf-4fb0-9539-b5a71d89bad9 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:26.276824 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0439ee-d871-430f-a903-e9f446155098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:26.277472 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0439ee-d871-430f-a903-e9f446155098 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:26.277817 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0439ee-d871-430f-a903-e9f446155098 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:26.278096 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0439ee-d871-430f-a903-e9f446155098 None admin] PATH_INFO: `/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:26.279240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0439ee-d871-430f-a903-e9f446155098 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb590e1a96a41bbbe00a0a9a82d9126)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:26.280685 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0439ee-d871-430f-a903-e9f446155098 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:26.282378 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 115/225] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:26 2022] GET /identity/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:26.283151 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0439ee-d871-430f-a903-e9f446155098 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:26.304921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 111/226] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:26.305836 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6433ab7-e4d9-4abb-a863-9d1a1a9c0613 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:26.370910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:26.410011 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6433ab7-e4d9-4abb-a863-9d1a1a9c0613 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:26.419844 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0439ee-d871-430f-a903-e9f446155098 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:26.457011 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd81d9-1b71-4177-9ffb-c13cc72c486d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:26.458978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd81d9-1b71-4177-9ffb-c13cc72c486d None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:26.459408 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd81d9-1b71-4177-9ffb-c13cc72c486d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:26.459823 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dd81d9-1b71-4177-9ffb-c13cc72c486d None admin] PATH_INFO: `/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126/users/0c394b9280b04660b9f20510b078e28e/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:26.462335 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd81d9-1b71-4177-9ffb-c13cc72c486d None admin] RBAC: Authorizing `identity:create_grant(project_id=dcb590e1a96a41bbbe00a0a9a82d9126, user_id=0c394b9280b04660b9f20510b078e28e, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:26.463028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d08ce-0de8-4b68-977d-b3c048751421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:26.464292 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d08ce-0de8-4b68-977d-b3c048751421 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:26.464740 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d08ce-0de8-4b68-977d-b3c048751421 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:26.465038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dd81d9-1b71-4177-9ffb-c13cc72c486d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:26.465189 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2d08ce-0de8-4b68-977d-b3c048751421 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:26.476199 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2d08ce-0de8-4b68-977d-b3c048751421 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:26.481907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-8c2d08ce-0de8-4b68-977d-b3c048751421 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:26.481907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:26.481907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:26.481907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:26.481907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:26.481907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:26.481907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:26.481907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:26.481907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:26.481907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:26.481907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:26.481907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:26.481907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:26.481907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:26.481907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:26.481907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:26.483009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:26.483009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:26.483009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:26.483009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:26.483009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:26.483009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:26.483009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:26.483009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:26.483009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:26.483009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:26.483009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:26.483009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:26.483009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:26.483009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:26.483009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:26.483009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:26.483996 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:26.483996 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:26.483996 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:26.483996 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:26.483996 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:26.483996 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:26.483996 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:26.483996 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:26.483996 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:26.483996 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:26.483996 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:26.483996 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:43:26.485629 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 116/227] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Sep 13 19:43:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:26.486500 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d08ce-0de8-4b68-977d-b3c048751421 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:26.493742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:26.539722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 112/228] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Sep 13 19:43:26 2022] PUT /identity/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126/users/0c394b9280b04660b9f20510b078e28e/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:43:26.541076 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd81d9-1b71-4177-9ffb-c13cc72c486d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:26.602006 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2d08ce-0de8-4b68-977d-b3c048751421 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:26.641937 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc076396-f825-4630-8e70-2bdd7b3c4170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:26.642653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc076396-f825-4630-8e70-2bdd7b3c4170 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:26.643102 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc076396-f825-4630-8e70-2bdd7b3c4170 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:26.643505 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc076396-f825-4630-8e70-2bdd7b3c4170 None admin] PATH_INFO: `/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:26.644718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc076396-f825-4630-8e70-2bdd7b3c4170 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb590e1a96a41bbbe00a0a9a82d9126)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:26.646322 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc076396-f825-4630-8e70-2bdd7b3c4170 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:26.648394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 117/229] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:26 2022] GET /identity/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126 => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:26.656000 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc076396-f825-4630-8e70-2bdd7b3c4170 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:26.724713 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dd81d9-1b71-4177-9ffb-c13cc72c486d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:26.747257 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:26.757965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:26.774911 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece2d83-0c5d-495d-a6c6-10f3695506c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:26.775647 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece2d83-0c5d-495d-a6c6-10f3695506c2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:26.775999 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece2d83-0c5d-495d-a6c6-10f3695506c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:26.777404 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece2d83-0c5d-495d-a6c6-10f3695506c2 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:26.778473 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece2d83-0c5d-495d-a6c6-10f3695506c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:26.778855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece2d83-0c5d-495d-a6c6-10f3695506c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:26.780815 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece2d83-0c5d-495d-a6c6-10f3695506c2 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:26.790776 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc076396-f825-4630-8e70-2bdd7b3c4170 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:26.795056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 113/230] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:43:26 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:26.801916 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece2d83-0c5d-495d-a6c6-10f3695506c2 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:26.833802 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd763c-1581-45fa-a08e-e6b9b8d30c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:26.834511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd763c-1581-45fa-a08e-e6b9b8d30c69 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:26.834766 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd763c-1581-45fa-a08e-e6b9b8d30c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:26.835045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbd763c-1581-45fa-a08e-e6b9b8d30c69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:26.835780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd763c-1581-45fa-a08e-e6b9b8d30c69 None admin] RBAC: Adding query filter params (role.id=033268df62114ee6bf4c0512568f2609, scope.project.id=dcb590e1a96a41bbbe00a0a9a82d9126, user.id=172f7a977bc64402b6a4b11cb7aa04f6) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:26.836095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd763c-1581-45fa-a08e-e6b9b8d30c69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:26.837550 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbd763c-1581-45fa-a08e-e6b9b8d30c69 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:26.845038 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 118/231] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:26 2022] GET /identity/v3/role_assignments?user.id=172f7a977bc64402b6a4b11cb7aa04f6&scope.project.id=dcb590e1a96a41bbbe00a0a9a82d9126&role.id=033268df62114ee6bf4c0512568f2609 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:26.940635 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece2d83-0c5d-495d-a6c6-10f3695506c2 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:26.998373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b1d0b-ed46-48ac-a407-2f0e0c4b2604 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:26.999027 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b1d0b-ed46-48ac-a407-2f0e0c4b2604 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:26.999308 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b1d0b-ed46-48ac-a407-2f0e0c4b2604 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:26.999583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b1d0b-ed46-48ac-a407-2f0e0c4b2604 None admin] PATH_INFO: `/v3/users/0c394b9280b04660b9f20510b078e28e` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:27.000755 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b1d0b-ed46-48ac-a407-2f0e0c4b2604 None admin] RBAC: Authorizing `identity:get_user(user_id=0c394b9280b04660b9f20510b078e28e)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:27.002286 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540b1d0b-ed46-48ac-a407-2f0e0c4b2604 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:27.003913 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 114/232] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:26 2022] GET /identity/v3/users/0c394b9280b04660b9f20510b078e28e => generated 283 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:27.009858 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd763c-1581-45fa-a08e-e6b9b8d30c69 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:27.137776 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbd763c-1581-45fa-a08e-e6b9b8d30c69 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:27.174320 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ea385-2e82-4c95-90e6-18ea77ab3701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:27.174880 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ea385-2e82-4c95-90e6-18ea77ab3701 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:27.175168 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ea385-2e82-4c95-90e6-18ea77ab3701 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:27.175445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ea385-2e82-4c95-90e6-18ea77ab3701 None admin] PATH_INFO: `/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:27.176578 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ea385-2e82-4c95-90e6-18ea77ab3701 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb590e1a96a41bbbe00a0a9a82d9126)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:27.178049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2ea385-2e82-4c95-90e6-18ea77ab3701 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:27.179674 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 119/233] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:27 2022] GET /identity/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:27.186037 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b1d0b-ed46-48ac-a407-2f0e0c4b2604 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:27.243349 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:27.291019 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b1d0b-ed46-48ac-a407-2f0e0c4b2604 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:27.327510 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d56b8b-d32c-4ad5-885a-9bcddde092f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:27.328176 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d56b8b-d32c-4ad5-885a-9bcddde092f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:27.328459 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d56b8b-d32c-4ad5-885a-9bcddde092f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:27.328750 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d56b8b-d32c-4ad5-885a-9bcddde092f0 None admin] PATH_INFO: `/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126/users/0c394b9280b04660b9f20510b078e28e/roles/d520f560be6d45539a966c6de2a934e7` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:27.331058 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d56b8b-d32c-4ad5-885a-9bcddde092f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=dcb590e1a96a41bbbe00a0a9a82d9126, user_id=0c394b9280b04660b9f20510b078e28e, role_id=d520f560be6d45539a966c6de2a934e7)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:27.332530 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d56b8b-d32c-4ad5-885a-9bcddde092f0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:27.454117 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 115/234] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Sep 13 19:43:27 2022] PUT /identity/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126/users/0c394b9280b04660b9f20510b078e28e/roles/d520f560be6d45539a966c6de2a934e7 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:43:28.400500 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58987f7c-86cf-49c8-b242-329b74e417f2 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:28.401242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58987f7c-86cf-49c8-b242-329b74e417f2 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:28.401242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58987f7c-86cf-49c8-b242-329b74e417f2 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:28.402829 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 120/235] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:28.413040 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf926418-76b7-4624-9836-185363396446 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:28.413926 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf926418-76b7-4624-9836-185363396446 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:28.414409 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf926418-76b7-4624-9836-185363396446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:28.438613 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-bf926418-76b7-4624-9836-185363396446 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:28.440102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bf926418-76b7-4624-9836-185363396446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:28.516186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 116/236] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:28.521720 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a055b-5aee-4392-8605-d05ffec3a379 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:28.521720 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a055b-5aee-4392-8605-d05ffec3a379 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:28.521720 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a055b-5aee-4392-8605-d05ffec3a379 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:28.522711 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 121/237] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:28.527975 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6511414-366b-45b2-a1c8-8408d32df98b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:28.528480 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6511414-366b-45b2-a1c8-8408d32df98b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:28.528954 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6511414-366b-45b2-a1c8-8408d32df98b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:28.547142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e6511414-366b-45b2-a1c8-8408d32df98b None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:28.548693 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e6511414-366b-45b2-a1c8-8408d32df98b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:28.594813 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:28.625346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 117/238] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:28.904756 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a055b-5aee-4392-8605-d05ffec3a379 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:28.907929 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:29.054892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a055b-5aee-4392-8605-d05ffec3a379 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:29.098962 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a5ee2-a600-4f0c-93d9-1194019905e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:29.099598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a5ee2-a600-4f0c-93d9-1194019905e4 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:29.099871 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a5ee2-a600-4f0c-93d9-1194019905e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:29.100140 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a5ee2-a600-4f0c-93d9-1194019905e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:29.116048 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a5ee2-a600-4f0c-93d9-1194019905e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:29.121616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-ac6a5ee2-a600-4f0c-93d9-1194019905e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:43:29.121616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:29.121616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:29.121616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:29.121616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:29.121616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:29.121616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:29.121616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:29.121616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:29.121616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:29.121616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:29.121616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:29.121616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:29.121616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:29.121616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:29.121616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:29.122542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:29.122542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:29.122542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:29.122542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:29.122542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:29.122542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:29.122542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:29.122542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:29.122542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:29.122542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:29.122542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:29.122542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:29.122542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:29.122542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:29.122542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:29.122542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:29.123387 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:29.123387 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:29.123387 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:29.123387 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:29.123387 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:29.123387 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:29.123387 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:29.123387 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:29.123387 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:29.123387 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:29.123387 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:43:29.123387 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:43:29.123387 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 122/239] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:29.128720 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6511414-366b-45b2-a1c8-8408d32df98b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:29.190515 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a5ee2-a600-4f0c-93d9-1194019905e4 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:29.286121 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:29.286345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6511414-366b-45b2-a1c8-8408d32df98b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:29.327344 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7e74b6-d98d-4abc-ab74-5e116f4a382e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:29.328063 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e74b6-d98d-4abc-ab74-5e116f4a382e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:29.328386 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e74b6-d98d-4abc-ab74-5e116f4a382e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:29.328664 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7e74b6-d98d-4abc-ab74-5e116f4a382e None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:29.329327 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e74b6-d98d-4abc-ab74-5e116f4a382e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:29.329623 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e74b6-d98d-4abc-ab74-5e116f4a382e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:29.330871 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a5ee2-a600-4f0c-93d9-1194019905e4 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:29.331032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7e74b6-d98d-4abc-ab74-5e116f4a382e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:29.340628 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 118/240] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:29.341949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654aca9-0278-4f21-b4b1-475f74133b60 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:29.342230 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654aca9-0278-4f21-b4b1-475f74133b60 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:29.342501 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e654aca9-0278-4f21-b4b1-475f74133b60 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:29.347380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 119/241] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:29.349634 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654aca9-0278-4f21-b4b1-475f74133b60 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:29.373618 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342437a0-26c6-4307-becc-7a370e2c3da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:29.374361 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342437a0-26c6-4307-becc-7a370e2c3da0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:29.375163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342437a0-26c6-4307-becc-7a370e2c3da0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:29.375443 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342437a0-26c6-4307-becc-7a370e2c3da0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:29.376807 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342437a0-26c6-4307-becc-7a370e2c3da0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:29.378278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342437a0-26c6-4307-becc-7a370e2c3da0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:29.380233 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 123/242] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:29.382091 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd531b-ffca-4ae3-9f3c-8be703b966bc None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:29.382647 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd531b-ffca-4ae3-9f3c-8be703b966bc None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:29.382926 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdd531b-ffca-4ae3-9f3c-8be703b966bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:29.390778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:29.408653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-7bdd531b-ffca-4ae3-9f3c-8be703b966bc None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:29.410231 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7bdd531b-ffca-4ae3-9f3c-8be703b966bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:29.460200 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e654aca9-0278-4f21-b4b1-475f74133b60 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:29.498513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae9be2-b288-4e69-81e4-443bdfb6fc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:29.499653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae9be2-b288-4e69-81e4-443bdfb6fc17 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:29.500087 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae9be2-b288-4e69-81e4-443bdfb6fc17 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:29.500494 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae9be2-b288-4e69-81e4-443bdfb6fc17 None admin] PATH_INFO: `/v3/users/c10b2b291b214d42bdda8f9ce951ddad` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:29.505642 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 124/243] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:29.506636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd531b-ffca-4ae3-9f3c-8be703b966bc None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:29.520053 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae9be2-b288-4e69-81e4-443bdfb6fc17 None admin] RBAC: Authorizing `identity:get_user(user_id=c10b2b291b214d42bdda8f9ce951ddad)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:29.521817 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae9be2-b288-4e69-81e4-443bdfb6fc17 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:29.524062 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 120/244] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:29 2022] GET /identity/v3/users/c10b2b291b214d42bdda8f9ce951ddad => generated 297 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:29.533470 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae9be2-b288-4e69-81e4-443bdfb6fc17 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:29.628018 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:29.675257 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:29.678516 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdd531b-ffca-4ae3-9f3c-8be703b966bc None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:29.682701 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae9be2-b288-4e69-81e4-443bdfb6fc17 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:29.718904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb818028-f988-478f-b545-1060c1ad4054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:29.719391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e210da-7930-4c5a-bc38-e360a7a7d458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:29.719730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb818028-f988-478f-b545-1060c1ad4054 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:29.720177 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb818028-f988-478f-b545-1060c1ad4054 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:29.720452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e210da-7930-4c5a-bc38-e360a7a7d458 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:29.720778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb818028-f988-478f-b545-1060c1ad4054 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:29.720898 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e210da-7930-4c5a-bc38-e360a7a7d458 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:29.721246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e210da-7930-4c5a-bc38-e360a7a7d458 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:29.722217 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e210da-7930-4c5a-bc38-e360a7a7d458 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:29.723765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e210da-7930-4c5a-bc38-e360a7a7d458 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:29.790528 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb818028-f988-478f-b545-1060c1ad4054 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:29.792057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb818028-f988-478f-b545-1060c1ad4054 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:29.809826 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 125/245] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Sep 13 19:43:29 2022] POST /identity/v3/users => generated 293 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:29.811090 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb9a78-9ebe-44f9-89dd-d6667f10a55c None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:29.811376 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb9a78-9ebe-44f9-89dd-d6667f10a55c None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:29.811960 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bb9a78-9ebe-44f9-89dd-d6667f10a55c None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:29.817366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 126/246] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:29.817366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb9a78-9ebe-44f9-89dd-d6667f10a55c None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:29.929995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:29.939284 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 121/247] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:29.940548 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee6915-65ab-4765-bf14-03f89a1d5192 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:29.940961 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee6915-65ab-4765-bf14-03f89a1d5192 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:29.941291 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ee6915-65ab-4765-bf14-03f89a1d5192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:29.953471 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bb9a78-9ebe-44f9-89dd-d6667f10a55c None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:29.962677 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-68ee6915-65ab-4765-bf14-03f89a1d5192 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:29.965119 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-68ee6915-65ab-4765-bf14-03f89a1d5192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:29.976974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:30.001406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7417e1-5ac3-4c3d-8d42-39a62692806e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:30.002336 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7417e1-5ac3-4c3d-8d42-39a62692806e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:30.002755 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7417e1-5ac3-4c3d-8d42-39a62692806e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:30.003295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7417e1-5ac3-4c3d-8d42-39a62692806e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:30.020430 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7417e1-5ac3-4c3d-8d42-39a62692806e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:30.025795 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-fa7417e1-5ac3-4c3d-8d42-39a62692806e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:30.025795 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:30.025795 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:30.025795 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:30.025795 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:30.025795 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:30.025795 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:30.025795 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:30.025795 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:30.025795 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:30.025795 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:30.025795 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:30.025795 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:30.025795 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:30.025795 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:30.025795 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:30.026707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:30.026707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:30.026707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:30.026707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:30.026707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:30.026707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:30.026707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:30.026707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:30.026707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:30.026707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:30.026707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:30.026707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:30.026707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:30.026707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:30.026707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:30.026707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:30.027540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:30.027540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:30.027540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:30.027540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:30.027540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:30.027540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:30.027540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:30.027540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:30.027540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:30.027540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:30.027540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:30.027540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:43:30.028157 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 127/248] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:43:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:30.028888 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7417e1-5ac3-4c3d-8d42-39a62692806e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:30.052303 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 122/249] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:30.062603 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee6915-65ab-4765-bf14-03f89a1d5192 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:30.165457 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7417e1-5ac3-4c3d-8d42-39a62692806e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:30.180092 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ee6915-65ab-4765-bf14-03f89a1d5192 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:30.208586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:30.209265 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72233837-1d0d-4c76-a42c-2c24aab4e72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:30.210220 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72233837-1d0d-4c76-a42c-2c24aab4e72a None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:30.210926 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72233837-1d0d-4c76-a42c-2c24aab4e72a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:30.211370 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72233837-1d0d-4c76-a42c-2c24aab4e72a None admin] PATH_INFO: `/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:30.212671 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72233837-1d0d-4c76-a42c-2c24aab4e72a None admin] RBAC: Authorizing `identity:get_project(project_id=dcb590e1a96a41bbbe00a0a9a82d9126)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:30.214369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72233837-1d0d-4c76-a42c-2c24aab4e72a None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:30.217012 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 128/250] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:30 2022] GET /identity/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:30.221729 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8466fbd-f673-4837-9ece-9305bb1be6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:30.225803 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8466fbd-f673-4837-9ece-9305bb1be6df None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:30.225915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72233837-1d0d-4c76-a42c-2c24aab4e72a None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:30.226005 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8466fbd-f673-4837-9ece-9305bb1be6df None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:30.226005 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8466fbd-f673-4837-9ece-9305bb1be6df None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:30.226005 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8466fbd-f673-4837-9ece-9305bb1be6df None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:30.226005 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8466fbd-f673-4837-9ece-9305bb1be6df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:30.226299 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8466fbd-f673-4837-9ece-9305bb1be6df None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:30.235166 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 123/251] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:30.242071 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8466fbd-f673-4837-9ece-9305bb1be6df None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:30.298560 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:30.371794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72233837-1d0d-4c76-a42c-2c24aab4e72a None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:30.372002 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8466fbd-f673-4837-9ece-9305bb1be6df None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:30.409485 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc80cce-b076-4509-a885-a8487d0c5525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:30.410220 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc80cce-b076-4509-a885-a8487d0c5525 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:30.410430 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc80cce-b076-4509-a885-a8487d0c5525 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:30.410690 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc80cce-b076-4509-a885-a8487d0c5525 None admin] PATH_INFO: `/v3/users/0c394b9280b04660b9f20510b078e28e` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:30.411805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc80cce-b076-4509-a885-a8487d0c5525 None admin] RBAC: Authorizing `identity:get_user(user_id=0c394b9280b04660b9f20510b078e28e)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:30.413248 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc80cce-b076-4509-a885-a8487d0c5525 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:30.414996 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 124/252] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:30 2022] GET /identity/v3/users/0c394b9280b04660b9f20510b078e28e => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:30.419264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01626697-284a-4305-9eaf-1f8970c36eaf None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:30.419264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01626697-284a-4305-9eaf-1f8970c36eaf None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:30.419264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01626697-284a-4305-9eaf-1f8970c36eaf None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:30.419264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 125/253] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:30.419264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01626697-284a-4305-9eaf-1f8970c36eaf None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:30.421049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0c6e0-7f60-4f64-a7fd-580ee1c55502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:30.422209 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0c6e0-7f60-4f64-a7fd-580ee1c55502 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:30.422805 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0c6e0-7f60-4f64-a7fd-580ee1c55502 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:30.423284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0c6e0-7f60-4f64-a7fd-580ee1c55502 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:30.424166 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0c6e0-7f60-4f64-a7fd-580ee1c55502 None admin] RBAC: Adding query filter params (role.id=ec5168a1b302406fb0ec0082a2ed258a, scope.project.id=dcb590e1a96a41bbbe00a0a9a82d9126, user.id=c10b2b291b214d42bdda8f9ce951ddad) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:30.424620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0c6e0-7f60-4f64-a7fd-580ee1c55502 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:30.426360 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0c6e0-7f60-4f64-a7fd-580ee1c55502 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:30.433295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 129/254] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:30 2022] GET /identity/v3/role_assignments?user.id=c10b2b291b214d42bdda8f9ce951ddad&scope.project.id=dcb590e1a96a41bbbe00a0a9a82d9126&role.id=ec5168a1b302406fb0ec0082a2ed258a => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:30.434430 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0c6e0-7f60-4f64-a7fd-580ee1c55502 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:30.499320 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:30.597527 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01626697-284a-4305-9eaf-1f8970c36eaf None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:30.623711 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0c6e0-7f60-4f64-a7fd-580ee1c55502 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:30.636935 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:30.661765 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a7d6a-3802-49bd-b4dd-5b1c4dc32120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:30.662405 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a7d6a-3802-49bd-b4dd-5b1c4dc32120 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:30.662685 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a7d6a-3802-49bd-b4dd-5b1c4dc32120 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:30.662957 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a7d6a-3802-49bd-b4dd-5b1c4dc32120 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:30.678516 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141a7d6a-3802-49bd-b4dd-5b1c4dc32120 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:30.684051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-141a7d6a-3802-49bd-b4dd-5b1c4dc32120 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:30.684051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:30.684051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:30.684051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:30.684051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:30.684051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:30.684051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:30.684051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:30.684051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:30.684051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:30.684051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:30.684051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:30.684051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:30.684051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:30.684051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:30.684051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:30.684985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:30.684985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:30.684985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:30.684985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:30.684985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:30.684985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:30.684985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:30.684985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:30.684985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:30.684985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:30.684985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:30.684985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:30.684985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:30.684985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:30.684985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:30.684985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:30.685837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:30.685837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:30.685837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:30.685837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:30.685837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:30.685837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:30.685837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:30.685837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:30.685837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:30.685837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:30.685837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:30.685837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:43:30.685837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 126/255] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:30.686548 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2714fa3-11d6-4800-af47-8c9801438e06 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:30.686625 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2714fa3-11d6-4800-af47-8c9801438e06 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:30.687230 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2714fa3-11d6-4800-af47-8c9801438e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:30.691371 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3975ffc-d568-4c81-bd85-a483bcc63ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:30.691989 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3975ffc-d568-4c81-bd85-a483bcc63ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:30.692263 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3975ffc-d568-4c81-bd85-a483bcc63ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:30.692532 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3975ffc-d568-4c81-bd85-a483bcc63ed7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:30.711482 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d2714fa3-11d6-4800-af47-8c9801438e06 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:30.713283 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d2714fa3-11d6-4800-af47-8c9801438e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:30.789345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 127/256] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:30.790579 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2714fa3-11d6-4800-af47-8c9801438e06 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:30.827572 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3975ffc-d568-4c81-bd85-a483bcc63ed7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:30.828567 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3975ffc-d568-4c81-bd85-a483bcc63ed7 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:30.839788 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:30.913539 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2714fa3-11d6-4800-af47-8c9801438e06 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:30.951421 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eee721-8aa7-457f-a1b0-c88b2c18a3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:30.952411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eee721-8aa7-457f-a1b0-c88b2c18a3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:30.952998 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eee721-8aa7-457f-a1b0-c88b2c18a3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:30.953473 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12eee721-8aa7-457f-a1b0-c88b2c18a3d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:30.954388 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eee721-8aa7-457f-a1b0-c88b2c18a3d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:30.954942 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eee721-8aa7-457f-a1b0-c88b2c18a3d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:30.956545 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12eee721-8aa7-457f-a1b0-c88b2c18a3d9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:30.966382 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 128/257] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:30.979646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eee721-8aa7-457f-a1b0-c88b2c18a3d9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:31.007997 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 130/258] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 574 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:31.014954 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3975ffc-d568-4c81-bd85-a483bcc63ed7 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:31.030296 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:31.200353 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12eee721-8aa7-457f-a1b0-c88b2c18a3d9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:31.207849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:31.211668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3975ffc-d568-4c81-bd85-a483bcc63ed7 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:31.263374 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44515630-a4fb-40ae-830d-1c2fca82fff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:31.264021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44515630-a4fb-40ae-830d-1c2fca82fff5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:31.264307 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44515630-a4fb-40ae-830d-1c2fca82fff5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:31.264577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44515630-a4fb-40ae-830d-1c2fca82fff5 None admin] PATH_INFO: `/v3/users/172f7a977bc64402b6a4b11cb7aa04f6` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:31.270373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44515630-a4fb-40ae-830d-1c2fca82fff5 None admin] RBAC: Authorizing `identity:get_user(user_id=172f7a977bc64402b6a4b11cb7aa04f6)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:31.271850 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44515630-a4fb-40ae-830d-1c2fca82fff5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:31.274965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 129/259] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:30 2022] GET /identity/v3/users/172f7a977bc64402b6a4b11cb7aa04f6 => generated 297 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:31.280304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44515630-a4fb-40ae-830d-1c2fca82fff5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:31.293998 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e0f5d-e18a-4ab0-8fff-203d63528c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:31.294634 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e0f5d-e18a-4ab0-8fff-203d63528c12 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:31.294914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e0f5d-e18a-4ab0-8fff-203d63528c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:31.295183 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e0f5d-e18a-4ab0-8fff-203d63528c12 None admin] PATH_INFO: `/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:31.302429 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e0f5d-e18a-4ab0-8fff-203d63528c12 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb590e1a96a41bbbe00a0a9a82d9126)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:31.303886 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e0f5d-e18a-4ab0-8fff-203d63528c12 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:31.305861 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 131/260] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:31 2022] GET /identity/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126 => generated 302 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:31.312220 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e0f5d-e18a-4ab0-8fff-203d63528c12 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:31.430893 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44515630-a4fb-40ae-830d-1c2fca82fff5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:31.507842 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:31.514389 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d30cf-210a-4abb-9f9e-212315f108a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:31.515037 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d30cf-210a-4abb-9f9e-212315f108a6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:31.515320 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d30cf-210a-4abb-9f9e-212315f108a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:31.515596 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224d30cf-210a-4abb-9f9e-212315f108a6 None admin] PATH_INFO: `/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:31.518567 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e0f5d-e18a-4ab0-8fff-203d63528c12 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:31.522419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d30cf-210a-4abb-9f9e-212315f108a6 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb590e1a96a41bbbe00a0a9a82d9126)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:31.523892 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224d30cf-210a-4abb-9f9e-212315f108a6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:31.525742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 130/261] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:31 2022] GET /identity/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126 => generated 302 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:31.526391 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d30cf-210a-4abb-9f9e-212315f108a6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:31.567650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00fc89-21e1-42ae-9ccd-cab665e7db2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:31.568706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00fc89-21e1-42ae-9ccd-cab665e7db2b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:31.569213 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00fc89-21e1-42ae-9ccd-cab665e7db2b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:31.569684 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00fc89-21e1-42ae-9ccd-cab665e7db2b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:31.570624 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00fc89-21e1-42ae-9ccd-cab665e7db2b None admin] RBAC: Adding query filter params (role.id=cd02ef2043de492a8bff6c165485f255, scope.project.id=dcb590e1a96a41bbbe00a0a9a82d9126, user.id=0c394b9280b04660b9f20510b078e28e) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:31.571153 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00fc89-21e1-42ae-9ccd-cab665e7db2b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:31.573413 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00fc89-21e1-42ae-9ccd-cab665e7db2b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:31.586045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 132/262] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:31 2022] GET /identity/v3/role_assignments?user.id=0c394b9280b04660b9f20510b078e28e&scope.project.id=dcb590e1a96a41bbbe00a0a9a82d9126&role.id=cd02ef2043de492a8bff6c165485f255 => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:31.587243 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00fc89-21e1-42ae-9ccd-cab665e7db2b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:31.607074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:31.686724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224d30cf-210a-4abb-9f9e-212315f108a6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:31.765746 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b69d6-85d0-4096-92ec-1fce4ea8de42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:31.766750 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b69d6-85d0-4096-92ec-1fce4ea8de42 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:31.767232 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b69d6-85d0-4096-92ec-1fce4ea8de42 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:31.767699 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526b69d6-85d0-4096-92ec-1fce4ea8de42 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:31.794664 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526b69d6-85d0-4096-92ec-1fce4ea8de42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:31.805759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-526b69d6-85d0-4096-92ec-1fce4ea8de42 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:31.805759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:31.805759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:31.805759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:31.805759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:31.805759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:31.805759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:31.805759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:31.805759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:31.805759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:31.805759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:31.805759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:31.805759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:31.805759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:31.805759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:31.805759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:31.806705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:31.806705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:31.806705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:31.806705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:31.806705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:31.806705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:31.806705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:31.806705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:31.806705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:31.806705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:31.806705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:31.806705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:31.806705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:31.806705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:31.806705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:31.806705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:31.808103 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:31.808103 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:31.808103 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:31.808103 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:31.808103 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:31.808103 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:31.808103 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:31.808103 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:31.808103 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:31.808103 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:31.808103 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:31.808103 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:43:31.811841 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 131/263] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Sep 13 19:43:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:31.817569 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b69d6-85d0-4096-92ec-1fce4ea8de42 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:31.822556 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00fc89-21e1-42ae-9ccd-cab665e7db2b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:31.904106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716475c-4daf-40e0-a9c3-5e2034785faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:31.905106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716475c-4daf-40e0-a9c3-5e2034785faa None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:31.905805 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716475c-4daf-40e0-a9c3-5e2034785faa None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:31.907424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716475c-4daf-40e0-a9c3-5e2034785faa None admin] PATH_INFO: `/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126/users/172f7a977bc64402b6a4b11cb7aa04f6/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:31.910459 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716475c-4daf-40e0-a9c3-5e2034785faa None admin] RBAC: Authorizing `identity:create_grant(project_id=dcb590e1a96a41bbbe00a0a9a82d9126, user_id=172f7a977bc64402b6a4b11cb7aa04f6, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:31.912905 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c716475c-4daf-40e0-a9c3-5e2034785faa None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:31.966644 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526b69d6-85d0-4096-92ec-1fce4ea8de42 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:31.968684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:31.989080 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:31.993265 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 133/264] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Sep 13 19:43:31 2022] PUT /identity/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126/users/172f7a977bc64402b6a4b11cb7aa04f6/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:43:32.014732 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220d753-fa76-4d2f-be95-9ae52ffdb9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:32.016054 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220d753-fa76-4d2f-be95-9ae52ffdb9a0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:32.016652 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220d753-fa76-4d2f-be95-9ae52ffdb9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:32.016978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8220d753-fa76-4d2f-be95-9ae52ffdb9a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:32.017655 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220d753-fa76-4d2f-be95-9ae52ffdb9a0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:32.017991 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220d753-fa76-4d2f-be95-9ae52ffdb9a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:32.019886 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8220d753-fa76-4d2f-be95-9ae52ffdb9a0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:32.029499 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 132/265] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:43:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:32.035376 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716475c-4daf-40e0-a9c3-5e2034785faa None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:32.149062 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716475c-4daf-40e0-a9c3-5e2034785faa None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:32.186777 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd5b50-851a-4e20-8469-25aa04b34982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:32.187421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd5b50-851a-4e20-8469-25aa04b34982 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:32.187700 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd5b50-851a-4e20-8469-25aa04b34982 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:32.187972 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd5b50-851a-4e20-8469-25aa04b34982 None admin] PATH_INFO: `/v3/users/0c394b9280b04660b9f20510b078e28e` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:32.189106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd5b50-851a-4e20-8469-25aa04b34982 None admin] RBAC: Authorizing `identity:get_user(user_id=0c394b9280b04660b9f20510b078e28e)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:32.190669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aedd5b50-851a-4e20-8469-25aa04b34982 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:32.192816 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 134/266] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:32 2022] GET /identity/v3/users/0c394b9280b04660b9f20510b078e28e => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:32.198234 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220d753-fa76-4d2f-be95-9ae52ffdb9a0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:32.315910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8220d753-fa76-4d2f-be95-9ae52ffdb9a0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:32.359650 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df9d30-dccc-444e-9cfd-cd476ceca664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:32.360263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df9d30-dccc-444e-9cfd-cd476ceca664 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:32.360539 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df9d30-dccc-444e-9cfd-cd476ceca664 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:32.360808 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29df9d30-dccc-444e-9cfd-cd476ceca664 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:32.393914 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:32.437302 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df9d30-dccc-444e-9cfd-cd476ceca664 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:32.438868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29df9d30-dccc-444e-9cfd-cd476ceca664 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:32.549506 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 133/267] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:32.555341 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd5b50-851a-4e20-8469-25aa04b34982 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:32.651720 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:32.687005 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aedd5b50-851a-4e20-8469-25aa04b34982 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:32.739441 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcb5064-9645-4d21-a52c-b8814be88d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:32.740094 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb5064-9645-4d21-a52c-b8814be88d38 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:32.740372 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb5064-9645-4d21-a52c-b8814be88d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:32.740638 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcb5064-9645-4d21-a52c-b8814be88d38 None admin] PATH_INFO: `/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:32.746401 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb5064-9645-4d21-a52c-b8814be88d38 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb590e1a96a41bbbe00a0a9a82d9126)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:32.747874 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcb5064-9645-4d21-a52c-b8814be88d38 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:32.749763 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 135/268] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:32 2022] GET /identity/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:32.755500 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df9d30-dccc-444e-9cfd-cd476ceca664 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:32.819051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98484e45-9fc8-43b8-8dd9-3606183f725e None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:32.819387 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98484e45-9fc8-43b8-8dd9-3606183f725e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:32.819886 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98484e45-9fc8-43b8-8dd9-3606183f725e None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:32.821260 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 136/269] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:32.828394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be71f8-6353-489f-80bb-0daf6aaff4a9 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:32.828847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be71f8-6353-489f-80bb-0daf6aaff4a9 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:32.829126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be71f8-6353-489f-80bb-0daf6aaff4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:32.845237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:32.850036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-88be71f8-6353-489f-80bb-0daf6aaff4a9 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:32.851218 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-88be71f8-6353-489f-80bb-0daf6aaff4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:32.910253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29df9d30-dccc-444e-9cfd-cd476ceca664 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:32.946024 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c4c5f-6bce-460e-ba6f-fdffabced2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:32.946622 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c4c5f-6bce-460e-ba6f-fdffabced2db None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:32.946897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c4c5f-6bce-460e-ba6f-fdffabced2db None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:32.947163 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c4c5f-6bce-460e-ba6f-fdffabced2db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:32.948515 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c4c5f-6bce-460e-ba6f-fdffabced2db None admin] RBAC: Adding query filter params (role.id=d520f560be6d45539a966c6de2a934e7, scope.project.id=dcb590e1a96a41bbbe00a0a9a82d9126, user.id=0c394b9280b04660b9f20510b078e28e) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:32.948812 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c4c5f-6bce-460e-ba6f-fdffabced2db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:32.950277 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c4c5f-6bce-460e-ba6f-fdffabced2db None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:32.956295 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 134/270] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:32 2022] GET /identity/v3/role_assignments?user.id=0c394b9280b04660b9f20510b078e28e&scope.project.id=dcb590e1a96a41bbbe00a0a9a82d9126&role.id=d520f560be6d45539a966c6de2a934e7 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:32.985177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 137/271] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:43:33.023726 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003e120-f3d0-45d9-a437-ace4770c37f9 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:33.024070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003e120-f3d0-45d9-a437-ace4770c37f9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:33.024276 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a003e120-f3d0-45d9-a437-ace4770c37f9 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:33.025847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 135/272] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:33.031855 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40296df6-eb14-491e-87fb-28d310eed5a5 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:33.032478 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40296df6-eb14-491e-87fb-28d310eed5a5 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:33.032973 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40296df6-eb14-491e-87fb-28d310eed5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:33.052308 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-40296df6-eb14-491e-87fb-28d310eed5a5 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:33.053923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-40296df6-eb14-491e-87fb-28d310eed5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:33.145732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:33.159853 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 138/273] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:33.262300 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221039c-6cf9-4446-8ca3-553bd1968353 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:33.262655 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221039c-6cf9-4446-8ca3-553bd1968353 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:33.262858 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221039c-6cf9-4446-8ca3-553bd1968353 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:33.264431 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 136/274] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:33.269857 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba535d-27ad-4846-954c-352baf98fe27 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:33.270351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba535d-27ad-4846-954c-352baf98fe27 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:33.273552 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba535d-27ad-4846-954c-352baf98fe27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:33.292344 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-11ba535d-27ad-4846-954c-352baf98fe27 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:33.293853 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-11ba535d-27ad-4846-954c-352baf98fe27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:33.298173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221039c-6cf9-4446-8ca3-553bd1968353 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:33.373459 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 139/275] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:33.407726 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221039c-6cf9-4446-8ca3-553bd1968353 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:33.435090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:33.443055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d80a73-30ee-4837-8585-33cc1abe0edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:33.443885 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d80a73-30ee-4837-8585-33cc1abe0edc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:33.444335 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d80a73-30ee-4837-8585-33cc1abe0edc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:33.444796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d80a73-30ee-4837-8585-33cc1abe0edc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:33.456342 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d80a73-30ee-4837-8585-33cc1abe0edc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:33.458562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba535d-27ad-4846-954c-352baf98fe27 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:33.461920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-25d80a73-30ee-4837-8585-33cc1abe0edc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:33.461920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:33.461920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:33.461920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:33.461920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:33.461920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:33.461920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:33.461920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:33.461920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:33.461920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:33.461920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:33.461920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:33.461920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:33.461920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:33.461920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:33.461920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:33.463309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:33.463309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:33.463309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:33.463309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:33.463309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:33.463309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:33.463309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:33.463309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:33.463309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:33.463309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:33.463309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:33.463309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:33.463309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:33.463309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:33.463309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:33.463309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:33.464411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:33.464411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:33.464411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:33.464411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:33.464411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:33.464411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:33.464411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:33.464411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:33.464411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:33.464411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:33.464411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:33.464411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:43:33.464411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 137/276] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:33.468475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d80a73-30ee-4837-8585-33cc1abe0edc None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:33.572786 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d80a73-30ee-4837-8585-33cc1abe0edc None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:33.580821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ba535d-27ad-4846-954c-352baf98fe27 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:33.607316 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f3c45-5f31-4134-b771-e314829ef67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:33.607908 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f3c45-5f31-4134-b771-e314829ef67b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:33.608188 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f3c45-5f31-4134-b771-e314829ef67b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:33.608453 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300f3c45-5f31-4134-b771-e314829ef67b None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:33.609109 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f3c45-5f31-4134-b771-e314829ef67b None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:33.609430 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f3c45-5f31-4134-b771-e314829ef67b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:33.610804 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300f3c45-5f31-4134-b771-e314829ef67b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:33.612025 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:33.620467 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 138/277] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:33.622927 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835f848-89b7-49bd-b076-3b3531ec4c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:33.623822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835f848-89b7-49bd-b076-3b3531ec4c87 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:33.625056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835f848-89b7-49bd-b076-3b3531ec4c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:33.625056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835f848-89b7-49bd-b076-3b3531ec4c87 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:33.626360 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f3c45-5f31-4134-b771-e314829ef67b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:33.627080 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835f848-89b7-49bd-b076-3b3531ec4c87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:33.628867 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835f848-89b7-49bd-b076-3b3531ec4c87 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:33.635708 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 140/278] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:33.638095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835f848-89b7-49bd-b076-3b3531ec4c87 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:33.679709 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:33.732223 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300f3c45-5f31-4134-b771-e314829ef67b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:33.756323 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835f848-89b7-49bd-b076-3b3531ec4c87 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:33.765105 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843de26-498b-4f97-89c2-84c6cba9b4bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:33.765749 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843de26-498b-4f97-89c2-84c6cba9b4bc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:33.766035 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843de26-498b-4f97-89c2-84c6cba9b4bc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:33.766303 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7843de26-498b-4f97-89c2-84c6cba9b4bc None admin] PATH_INFO: `/v3/users/1ed3310aa83a4e9fa65a722ef8b36da1` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:33.779827 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843de26-498b-4f97-89c2-84c6cba9b4bc None admin] RBAC: Authorizing `identity:get_user(user_id=1ed3310aa83a4e9fa65a722ef8b36da1)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:33.781286 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7843de26-498b-4f97-89c2-84c6cba9b4bc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:33.787527 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 139/279] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:33 2022] GET /identity/v3/users/1ed3310aa83a4e9fa65a722ef8b36da1 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:33.787527 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843de26-498b-4f97-89c2-84c6cba9b4bc None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:33.799190 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9f6fb-7a95-41dc-b747-1693df7be64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:33.799791 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9f6fb-7a95-41dc-b747-1693df7be64d None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:33.800071 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9f6fb-7a95-41dc-b747-1693df7be64d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:33.800359 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f9f6fb-7a95-41dc-b747-1693df7be64d None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:33.801023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9f6fb-7a95-41dc-b747-1693df7be64d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:33.802467 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f9f6fb-7a95-41dc-b747-1693df7be64d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:33.884445 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7843de26-498b-4f97-89c2-84c6cba9b4bc None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:33.895254 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:33.910797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 141/280] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Sep 13 19:43:33 2022] POST /identity/v3/users => generated 293 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:33.911805 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9f6fb-7a95-41dc-b747-1693df7be64d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:33.932169 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c93204-6cd0-4dc8-bade-7fe73f76e458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:33.932820 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c93204-6cd0-4dc8-bade-7fe73f76e458 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:33.933184 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c93204-6cd0-4dc8-bade-7fe73f76e458 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:33.933458 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c93204-6cd0-4dc8-bade-7fe73f76e458 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:33.948085 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47c93204-6cd0-4dc8-bade-7fe73f76e458 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:33.953878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-47c93204-6cd0-4dc8-bade-7fe73f76e458 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:43:33.953878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:33.953878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:33.953878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:33.953878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:33.953878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:33.953878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:33.953878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:33.953878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:33.953878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:33.953878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:33.953878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:33.953878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:33.953878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:33.953878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:33.953878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:33.954867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:33.954867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:33.954867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:33.954867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:33.954867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:33.954867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:33.954867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:33.954867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:33.954867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:33.954867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:33.954867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:33.954867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:33.954867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:33.954867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:33.954867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:33.954867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:33.961081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:33.961081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:33.961081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:33.961081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:33.961081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:33.961081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:33.961081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:33.961081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:33.961081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:33.961081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:33.961081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:43:33.961081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:43:33.961081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 140/281] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:33.961799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c93204-6cd0-4dc8-bade-7fe73f76e458 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:33.988327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:34.048827 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f9f6fb-7a95-41dc-b747-1693df7be64d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:34.092172 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bdaf3-768c-4558-a9ef-5c12ec71d6e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:34.093635 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bdaf3-768c-4558-a9ef-5c12ec71d6e0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:34.094130 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bdaf3-768c-4558-a9ef-5c12ec71d6e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:34.094555 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15bdaf3-768c-4558-a9ef-5c12ec71d6e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:34.095445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15bdaf3-768c-4558-a9ef-5c12ec71d6e0 None admin] RBAC: Adding query filter params (role.id=033268df62114ee6bf4c0512568f2609, user.id=1ed3310aa83a4e9fa65a722ef8b36da1, scope.system=all) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:34.095903 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15bdaf3-768c-4558-a9ef-5c12ec71d6e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:34.097516 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15bdaf3-768c-4558-a9ef-5c12ec71d6e0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:34.098927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c93204-6cd0-4dc8-bade-7fe73f76e458 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:34.104667 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 142/282] 10.222.0.59 () {56 vars in 1308 bytes} [Tue Sep 13 19:43:33 2022] GET /identity/v3/role_assignments?user.id=1ed3310aa83a4e9fa65a722ef8b36da1&scope.system=all&role.id=033268df62114ee6bf4c0512568f2609 => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:34.145428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a99bf4-e3f2-4e37-adea-b711a8e16b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:34.146362 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a99bf4-e3f2-4e37-adea-b711a8e16b1f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:34.146816 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a99bf4-e3f2-4e37-adea-b711a8e16b1f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:34.147237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a99bf4-e3f2-4e37-adea-b711a8e16b1f None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:34.148063 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a99bf4-e3f2-4e37-adea-b711a8e16b1f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:34.148524 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a99bf4-e3f2-4e37-adea-b711a8e16b1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:34.150233 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a99bf4-e3f2-4e37-adea-b711a8e16b1f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:34.163084 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 141/283] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:34.168667 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bdaf3-768c-4558-a9ef-5c12ec71d6e0 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:34.289075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15bdaf3-768c-4558-a9ef-5c12ec71d6e0 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:34.307664 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:34.330783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01282664-3388-4915-a7a3-abf93600ce06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:34.331664 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01282664-3388-4915-a7a3-abf93600ce06 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:34.332122 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01282664-3388-4915-a7a3-abf93600ce06 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:34.332391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01282664-3388-4915-a7a3-abf93600ce06 None admin] PATH_INFO: `/v3/users/c10b2b291b214d42bdda8f9ce951ddad` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:34.334033 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01282664-3388-4915-a7a3-abf93600ce06 None admin] RBAC: Authorizing `identity:get_user(user_id=c10b2b291b214d42bdda8f9ce951ddad)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:34.335547 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01282664-3388-4915-a7a3-abf93600ce06 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:34.337313 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 143/284] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:34 2022] GET /identity/v3/users/c10b2b291b214d42bdda8f9ce951ddad => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:34.343653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a99bf4-e3f2-4e37-adea-b711a8e16b1f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:34.379971 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:34.464987 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a99bf4-e3f2-4e37-adea-b711a8e16b1f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:34.509661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea8b11-05f7-42e0-b0c1-bcb0d419e085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:34.511106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea8b11-05f7-42e0-b0c1-bcb0d419e085 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:34.511387 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea8b11-05f7-42e0-b0c1-bcb0d419e085 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:34.511659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea8b11-05f7-42e0-b0c1-bcb0d419e085 None admin] PATH_INFO: `/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:34.512896 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea8b11-05f7-42e0-b0c1-bcb0d419e085 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb590e1a96a41bbbe00a0a9a82d9126)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:34.514383 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea8b11-05f7-42e0-b0c1-bcb0d419e085 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:34.516178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 142/285] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:34 2022] GET /identity/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126 => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:34.521967 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01282664-3388-4915-a7a3-abf93600ce06 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:34.651980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01282664-3388-4915-a7a3-abf93600ce06 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:34.699995 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c45deeb-6da2-4d91-9a09-381936467f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:34.700698 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45deeb-6da2-4d91-9a09-381936467f24 None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:34.700985 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45deeb-6da2-4d91-9a09-381936467f24 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:34.701253 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c45deeb-6da2-4d91-9a09-381936467f24 None admin] PATH_INFO: `/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126/users/c10b2b291b214d42bdda8f9ce951ddad/roles/ec5168a1b302406fb0ec0082a2ed258a` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:34.706953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45deeb-6da2-4d91-9a09-381936467f24 None admin] RBAC: Authorizing `identity:create_grant(project_id=dcb590e1a96a41bbbe00a0a9a82d9126, user_id=c10b2b291b214d42bdda8f9ce951ddad, role_id=ec5168a1b302406fb0ec0082a2ed258a)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:34.708391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c45deeb-6da2-4d91-9a09-381936467f24 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:34.799283 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 144/286] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Sep 13 19:43:34 2022] PUT /identity/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126/users/c10b2b291b214d42bdda8f9ce951ddad/roles/ec5168a1b302406fb0ec0082a2ed258a => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:43:34.947574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2810a69-3856-426c-94c6-04145673ad91 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:34.948089 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2810a69-3856-426c-94c6-04145673ad91 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:34.948089 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2810a69-3856-426c-94c6-04145673ad91 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:34.949809 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 143/287] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:34.955530 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23181aa6-6eda-4673-b8d3-96ae97f829b3 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:34.955814 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23181aa6-6eda-4673-b8d3-96ae97f829b3 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:34.956097 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23181aa6-6eda-4673-b8d3-96ae97f829b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:34.986845 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-23181aa6-6eda-4673-b8d3-96ae97f829b3 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:34.988063 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-23181aa6-6eda-4673-b8d3-96ae97f829b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:35.037786 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:35.079851 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 145/288] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:35.445120 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2810a69-3856-426c-94c6-04145673ad91 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:35.569303 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:35.575111 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2810a69-3856-426c-94c6-04145673ad91 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:35.610034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ced896-325a-4d7a-b83b-f690e18048f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:35.610662 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ced896-325a-4d7a-b83b-f690e18048f9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:35.610939 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ced896-325a-4d7a-b83b-f690e18048f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:35.611212 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ced896-325a-4d7a-b83b-f690e18048f9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:35.622324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ced896-325a-4d7a-b83b-f690e18048f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:35.627175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-93ced896-325a-4d7a-b83b-f690e18048f9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:35.627175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:35.627175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:35.627175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:35.627175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:35.627175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:35.627175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:35.627175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:35.627175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:35.627175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:35.627175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:35.627175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:35.627175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:35.627175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:35.627175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:35.627175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:35.628156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:35.628156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:35.628156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:35.628156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:35.628156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:35.628156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:35.628156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:35.628156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:35.628156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:35.628156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:35.628156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:35.628156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:35.628156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:35.628156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:35.628156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:35.628156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:35.628967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:35.628967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:35.628967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:35.628967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:35.628967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:35.628967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:35.628967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:35.628967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:35.628967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:35.628967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:35.628967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:35.628967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:43:35.628967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 144/289] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:35.634363 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23181aa6-6eda-4673-b8d3-96ae97f829b3 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:35.773403 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23181aa6-6eda-4673-b8d3-96ae97f829b3 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:35.824149 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd44290-6d06-43d6-b309-028f686e5674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:35.824999 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd44290-6d06-43d6-b309-028f686e5674 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:35.825376 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd44290-6d06-43d6-b309-028f686e5674 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:35.825768 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd44290-6d06-43d6-b309-028f686e5674 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:35.826524 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd44290-6d06-43d6-b309-028f686e5674 None admin] RBAC: Adding query filter params (name=member) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:35.826823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd44290-6d06-43d6-b309-028f686e5674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:35.828195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd44290-6d06-43d6-b309-028f686e5674 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:35.837459 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 146/290] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:35.843741 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ced896-325a-4d7a-b83b-f690e18048f9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:35.946106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ced896-325a-4d7a-b83b-f690e18048f9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:35.981424 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aae35e-fce2-431f-8855-27cf5ebb3ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:35.982123 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aae35e-fce2-431f-8855-27cf5ebb3ede None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:35.982363 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aae35e-fce2-431f-8855-27cf5ebb3ede None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:35.982613 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74aae35e-fce2-431f-8855-27cf5ebb3ede None admin] PATH_INFO: `/v3/users/172f7a977bc64402b6a4b11cb7aa04f6` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:35.983840 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aae35e-fce2-431f-8855-27cf5ebb3ede None admin] RBAC: Authorizing `identity:get_user(user_id=172f7a977bc64402b6a4b11cb7aa04f6)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:35.985295 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74aae35e-fce2-431f-8855-27cf5ebb3ede None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:35.987185 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 145/291] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:35 2022] GET /identity/v3/users/172f7a977bc64402b6a4b11cb7aa04f6 => generated 297 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:35.992871 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd44290-6d06-43d6-b309-028f686e5674 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:36.040122 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:36.125954 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd44290-6d06-43d6-b309-028f686e5674 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:36.172723 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e86ee2-da05-4fb6-9ea2-b090e4909467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:36.173426 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e86ee2-da05-4fb6-9ea2-b090e4909467 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:36.173721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e86ee2-da05-4fb6-9ea2-b090e4909467 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:36.174000 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e86ee2-da05-4fb6-9ea2-b090e4909467 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:36.262031 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e86ee2-da05-4fb6-9ea2-b090e4909467 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:36.263546 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e86ee2-da05-4fb6-9ea2-b090e4909467 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:36.310872 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:36.393866 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 147/292] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:36.399549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aae35e-fce2-431f-8855-27cf5ebb3ede None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:36.434591 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:36.509530 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74aae35e-fce2-431f-8855-27cf5ebb3ede None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:36.547466 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d95d3-874b-4e06-9a94-cee38e1bf703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:36.548237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d95d3-874b-4e06-9a94-cee38e1bf703 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:36.548581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d95d3-874b-4e06-9a94-cee38e1bf703 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:36.548856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d95d3-874b-4e06-9a94-cee38e1bf703 None admin] PATH_INFO: `/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:36.550064 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d95d3-874b-4e06-9a94-cee38e1bf703 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb590e1a96a41bbbe00a0a9a82d9126)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:36.551501 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d95d3-874b-4e06-9a94-cee38e1bf703 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:36.553202 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 146/293] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:36 2022] GET /identity/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:36.559701 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e86ee2-da05-4fb6-9ea2-b090e4909467 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:36.695175 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e86ee2-da05-4fb6-9ea2-b090e4909467 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:36.743269 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee38d7c-1da5-4af5-96a1-a336800a6f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:36.744282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee38d7c-1da5-4af5-96a1-a336800a6f7a None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:36.744789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee38d7c-1da5-4af5-96a1-a336800a6f7a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:36.745262 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee38d7c-1da5-4af5-96a1-a336800a6f7a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:36.746229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee38d7c-1da5-4af5-96a1-a336800a6f7a None admin] RBAC: Adding query filter params (role.id=033268df62114ee6bf4c0512568f2609, scope.project.id=dcb590e1a96a41bbbe00a0a9a82d9126, user.id=172f7a977bc64402b6a4b11cb7aa04f6) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:36.746741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee38d7c-1da5-4af5-96a1-a336800a6f7a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:36.747161 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb152f49-36b1-4441-960c-7a16af482992 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:36.747721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb152f49-36b1-4441-960c-7a16af482992 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:36.748200 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb152f49-36b1-4441-960c-7a16af482992 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:36.748396 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee38d7c-1da5-4af5-96a1-a336800a6f7a None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:36.750182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 147/294] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:36.751762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:36.755511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 148/295] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:36 2022] GET /identity/v3/role_assignments?user.id=172f7a977bc64402b6a4b11cb7aa04f6&scope.project.id=dcb590e1a96a41bbbe00a0a9a82d9126&role.id=033268df62114ee6bf4c0512568f2609 => generated 608 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:36.756149 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6dbe5-dd6c-43f9-8de3-80f7096b363f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:36.756508 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6dbe5-dd6c-43f9-8de3-80f7096b363f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:36.756856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b6dbe5-dd6c-43f9-8de3-80f7096b363f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:36.796345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-98b6dbe5-dd6c-43f9-8de3-80f7096b363f None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:36.797588 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-98b6dbe5-dd6c-43f9-8de3-80f7096b363f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:36.807067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae9848-3d1f-4b7b-9da3-ad6fd61b87ef None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:36.808032 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae9848-3d1f-4b7b-9da3-ad6fd61b87ef None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:36.808516 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae9848-3d1f-4b7b-9da3-ad6fd61b87ef None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:36.810212 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 149/296] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:43:36.816302 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad1027-95eb-43eb-a4fe-6d1c345f05ac None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:36.816961 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad1027-95eb-43eb-a4fe-6d1c345f05ac None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:36.817443 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad1027-95eb-43eb-a4fe-6d1c345f05ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:36.839040 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-d4ad1027-95eb-43eb-a4fe-6d1c345f05ac None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:36.840582 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d4ad1027-95eb-43eb-a4fe-6d1c345f05ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:36.940875 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 148/297] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:43:36.942429 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de85c9-5d8b-4469-9f63-3a8df9735275 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:36.942712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de85c9-5d8b-4469-9f63-3a8df9735275 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:36.942981 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48de85c9-5d8b-4469-9f63-3a8df9735275 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:36.949268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 149/298] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:36.951141 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97009c16-e9aa-4771-8e65-eb13baff3fae None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:36.951683 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97009c16-e9aa-4771-8e65-eb13baff3fae None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:36.952084 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97009c16-e9aa-4771-8e65-eb13baff3fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:36.958041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 150/299] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:43:36.971540 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-97009c16-e9aa-4771-8e65-eb13baff3fae None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:36.972740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-97009c16-e9aa-4771-8e65-eb13baff3fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:36.991978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:37.045495 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 150/300] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:43:37.243686 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad1027-95eb-43eb-a4fe-6d1c345f05ac None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:37.249584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97009c16-e9aa-4771-8e65-eb13baff3fae None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:37.414237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97009c16-e9aa-4771-8e65-eb13baff3fae None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:37.417194 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ad1027-95eb-43eb-a4fe-6d1c345f05ac None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:37.444497 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:37.450861 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b33e4d-e7b0-481e-8874-50867d68317a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:37.451492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b33e4d-e7b0-481e-8874-50867d68317a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:37.451839 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b33e4d-e7b0-481e-8874-50867d68317a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:37.452071 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b33e4d-e7b0-481e-8874-50867d68317a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:37.459029 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68a6ce-6632-41eb-9495-3f34cdb54b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:37.459029 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68a6ce-6632-41eb-9495-3f34cdb54b1c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:37.459029 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68a6ce-6632-41eb-9495-3f34cdb54b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:37.459029 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e68a6ce-6632-41eb-9495-3f34cdb54b1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:37.459340 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68a6ce-6632-41eb-9495-3f34cdb54b1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:37.459340 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e68a6ce-6632-41eb-9495-3f34cdb54b1c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:37.459340 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 151/301] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:37.459340 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68a6ce-6632-41eb-9495-3f34cdb54b1c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:37.467731 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b33e4d-e7b0-481e-8874-50867d68317a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:37.472686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-c3b33e4d-e7b0-481e-8874-50867d68317a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:43:37.472686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:37.472686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:37.472686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:37.472686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:37.472686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:37.472686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:37.472686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:37.472686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:37.472686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:37.472686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:37.472686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:37.472686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:37.472686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:37.472686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:37.472686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:37.473576 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:37.473576 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:37.473576 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:37.473576 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:37.473576 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:37.473576 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:37.473576 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:37.473576 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:37.473576 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:37.473576 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:37.473576 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:37.473576 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:37.473576 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:37.473576 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:37.473576 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:37.473576 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:37.474487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:37.474487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:37.474487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:37.474487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:37.474487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:37.474487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:37.474487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:37.474487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:37.474487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:37.474487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:37.474487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:43:37.474487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:43:37.474487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 151/302] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:43:37.479298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b33e4d-e7b0-481e-8874-50867d68317a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:37.496078 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:37.569485 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e68a6ce-6632-41eb-9495-3f34cdb54b1c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:37.582518 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b33e4d-e7b0-481e-8874-50867d68317a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:37.606574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3794410-3f84-48e4-817b-d21edbc7afaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:37.607119 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3794410-3f84-48e4-817b-d21edbc7afaa None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:37.607399 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3794410-3f84-48e4-817b-d21edbc7afaa None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:37.607839 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3794410-3f84-48e4-817b-d21edbc7afaa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:37.618100 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df1005-810e-427e-bf23-defcb18f5ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:37.618230 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3794410-3f84-48e4-817b-d21edbc7afaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:37.618725 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df1005-810e-427e-bf23-defcb18f5ff0 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:37.619004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df1005-810e-427e-bf23-defcb18f5ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:37.619301 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95df1005-810e-427e-bf23-defcb18f5ff0 None admin] PATH_INFO: `/v3/groups` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:37.619922 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df1005-810e-427e-bf23-defcb18f5ff0 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:37.621358 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95df1005-810e-427e-bf23-defcb18f5ff0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:37.623554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-a3794410-3f84-48e4-817b-d21edbc7afaa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:37.623554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:37.623554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:37.623554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:37.623554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:37.623554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:37.623554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:37.623554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:37.623554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:37.623554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:37.623554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:37.623554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:37.623554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:37.623554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:37.623554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:37.623554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:37.624506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:37.624506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:37.624506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:37.624506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:37.624506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:37.624506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:37.624506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:37.624506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:37.624506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:37.624506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:37.624506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:37.624506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:37.624506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:37.624506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:37.624506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:37.624506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:37.625327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:37.625327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:37.625327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:37.625327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:37.625327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:37.625327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:37.625327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:37.625327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:37.625327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:37.625327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:37.625327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:37.625327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:43:37.625327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 152/303] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:37.627064 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3794410-3f84-48e4-817b-d21edbc7afaa None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:37.684887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:37.700026 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 152/304] 10.222.0.59 () {60 vars in 1134 bytes} [Tue Sep 13 19:43:37 2022] POST /identity/v3/groups => generated 229 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:43:37.701034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df1005-810e-427e-bf23-defcb18f5ff0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:37.738477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3794410-3f84-48e4-817b-d21edbc7afaa None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:37.779111 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77684ef-7762-47b2-ad3c-5e7994dcc1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:37.780003 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77684ef-7762-47b2-ad3c-5e7994dcc1e6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:37.780426 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77684ef-7762-47b2-ad3c-5e7994dcc1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:37.780842 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77684ef-7762-47b2-ad3c-5e7994dcc1e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:37.781677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77684ef-7762-47b2-ad3c-5e7994dcc1e6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:37.782224 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77684ef-7762-47b2-ad3c-5e7994dcc1e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:37.783818 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77684ef-7762-47b2-ad3c-5e7994dcc1e6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:37.794224 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 153/305] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:37.802962 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77684ef-7762-47b2-ad3c-5e7994dcc1e6 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:37.831015 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:37.860554 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95df1005-810e-427e-bf23-defcb18f5ff0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:37.907071 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f5b95d-8bd6-4f45-b8ac-f161b601fec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:37.907914 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5b95d-8bd6-4f45-b8ac-f161b601fec0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:37.908368 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5b95d-8bd6-4f45-b8ac-f161b601fec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:37.908804 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f5b95d-8bd6-4f45-b8ac-f161b601fec0 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:37.909628 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5b95d-8bd6-4f45-b8ac-f161b601fec0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:37.909962 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5b95d-8bd6-4f45-b8ac-f161b601fec0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:37.911351 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f5b95d-8bd6-4f45-b8ac-f161b601fec0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:37.921509 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 153/306] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:37.922809 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8236f-2d59-4293-a520-303112342038 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:37.923093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8236f-2d59-4293-a520-303112342038 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:37.923411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec8236f-2d59-4293-a520-303112342038 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:37.924583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 154/307] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:37.927156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8236f-2d59-4293-a520-303112342038 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:37.937518 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77684ef-7762-47b2-ad3c-5e7994dcc1e6 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:37.957993 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:37.976472 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9da0b1-f182-47f1-9298-e58b96265cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:37.977109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9da0b1-f182-47f1-9298-e58b96265cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:37.977390 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9da0b1-f182-47f1-9298-e58b96265cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:37.977663 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9da0b1-f182-47f1-9298-e58b96265cb9 None admin] PATH_INFO: `/v3/users/a9fa4458abb54054bc3c572f6672379d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:37.992407 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9da0b1-f182-47f1-9298-e58b96265cb9 None admin] RBAC: Authorizing `identity:get_user(user_id=a9fa4458abb54054bc3c572f6672379d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:37.994001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9da0b1-f182-47f1-9298-e58b96265cb9 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:37.996063 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 154/308] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:37 2022] GET /identity/v3/users/a9fa4458abb54054bc3c572f6672379d => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:37.997302 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d4fad-1373-4c94-97e5-4c62ac578164 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:37.997658 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d4fad-1373-4c94-97e5-4c62ac578164 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:37.998034 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d4fad-1373-4c94-97e5-4c62ac578164 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:38.016098 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-522d4fad-1373-4c94-97e5-4c62ac578164 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:38.017299 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-522d4fad-1373-4c94-97e5-4c62ac578164 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:38.042589 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec8236f-2d59-4293-a520-303112342038 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:38.078373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fcd0b-1dee-4e6f-8603-d1c6a420840d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:38.079008 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fcd0b-1dee-4e6f-8603-d1c6a420840d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:38.079285 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fcd0b-1dee-4e6f-8603-d1c6a420840d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:38.079573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245fcd0b-1dee-4e6f-8603-d1c6a420840d None admin] PATH_INFO: `/v3/users/1ed3310aa83a4e9fa65a722ef8b36da1` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:38.080666 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fcd0b-1dee-4e6f-8603-d1c6a420840d None admin] RBAC: Authorizing `identity:get_user(user_id=1ed3310aa83a4e9fa65a722ef8b36da1)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:38.082136 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245fcd0b-1dee-4e6f-8603-d1c6a420840d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:38.088774 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 155/309] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:37 2022] GET /identity/v3/users/1ed3310aa83a4e9fa65a722ef8b36da1 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:38.088774 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fcd0b-1dee-4e6f-8603-d1c6a420840d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:38.090730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 155/310] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:38.091470 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d4fad-1373-4c94-97e5-4c62ac578164 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:38.092437 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:38.212042 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d4fad-1373-4c94-97e5-4c62ac578164 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:38.212916 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245fcd0b-1dee-4e6f-8603-d1c6a420840d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:38.219661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:38.250745 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a6259-1627-4ec0-898d-7ca9ee306267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:38.251351 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a6259-1627-4ec0-898d-7ca9ee306267 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:38.251625 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a6259-1627-4ec0-898d-7ca9ee306267 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:38.251978 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f78881-8d07-461b-9f0d-6a77b43c37bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:38.252653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f78881-8d07-461b-9f0d-6a77b43c37bd None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:38.252927 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f78881-8d07-461b-9f0d-6a77b43c37bd None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:38.253194 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f78881-8d07-461b-9f0d-6a77b43c37bd None admin] PATH_INFO: `/v3/system/users/1ed3310aa83a4e9fa65a722ef8b36da1/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:38.253990 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4a6259-1627-4ec0-898d-7ca9ee306267 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:38.254794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f78881-8d07-461b-9f0d-6a77b43c37bd None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=1ed3310aa83a4e9fa65a722ef8b36da1, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:38.254915 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a6259-1627-4ec0-898d-7ca9ee306267 None admin] RBAC: Adding query filter params (role.id=ec5168a1b302406fb0ec0082a2ed258a, user.id=a9fa4458abb54054bc3c572f6672379d, scope.system=all) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:38.255386 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a6259-1627-4ec0-898d-7ca9ee306267 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:38.256642 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f78881-8d07-461b-9f0d-6a77b43c37bd None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:38.257246 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4a6259-1627-4ec0-898d-7ca9ee306267 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:38.265727 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 156/311] 10.222.0.59 () {56 vars in 1308 bytes} [Tue Sep 13 19:43:38 2022] GET /identity/v3/role_assignments?user.id=a9fa4458abb54054bc3c572f6672379d&scope.system=all&role.id=ec5168a1b302406fb0ec0082a2ed258a => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:38.361937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a6259-1627-4ec0-898d-7ca9ee306267 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:38.404686 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 156/312] 10.222.0.59 () {58 vars in 1334 bytes} [Tue Sep 13 19:43:38 2022] PUT /identity/v3/system/users/1ed3310aa83a4e9fa65a722ef8b36da1/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:43:38.443473 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:38.483879 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4a6259-1627-4ec0-898d-7ca9ee306267 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:38.523610 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d3d5e-4364-40ba-9ce1-cb57cee2a48d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:38.524250 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d3d5e-4364-40ba-9ce1-cb57cee2a48d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:38.524526 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d3d5e-4364-40ba-9ce1-cb57cee2a48d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:38.524795 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779d3d5e-4364-40ba-9ce1-cb57cee2a48d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:38.536815 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-779d3d5e-4364-40ba-9ce1-cb57cee2a48d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:38.542987 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-779d3d5e-4364-40ba-9ce1-cb57cee2a48d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:43:38.542987 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:38.542987 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:38.542987 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:38.542987 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:38.542987 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:38.542987 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:38.542987 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:38.542987 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:38.542987 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:38.542987 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:38.542987 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:38.542987 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:38.542987 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:38.542987 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:38.542987 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:38.543937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:38.543937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:38.543937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:38.543937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:38.543937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:38.543937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:38.543937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:38.543937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:38.543937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:38.543937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:38.543937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:38.543937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:38.543937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:38.543937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:38.543937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:38.543937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:38.544921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:38.544921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:38.544921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:38.544921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:38.544921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:38.544921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:38.544921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:38.544921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:38.544921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:38.544921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:38.544921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:43:38.544921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:43:38.544921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 157/313] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:43:38.550479 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f78881-8d07-461b-9f0d-6a77b43c37bd None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:38.663553 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f78881-8d07-461b-9f0d-6a77b43c37bd None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:38.700404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb33a2-7708-4e3e-b0e3-93834ce66a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:38.701017 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb33a2-7708-4e3e-b0e3-93834ce66a83 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:38.701298 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb33a2-7708-4e3e-b0e3-93834ce66a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:38.701570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eb33a2-7708-4e3e-b0e3-93834ce66a83 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:38.702269 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb33a2-7708-4e3e-b0e3-93834ce66a83 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:38.702572 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb33a2-7708-4e3e-b0e3-93834ce66a83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:38.704013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eb33a2-7708-4e3e-b0e3-93834ce66a83 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:38.712693 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 157/314] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:38.718156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d3d5e-4364-40ba-9ce1-cb57cee2a48d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:38.821864 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779d3d5e-4364-40ba-9ce1-cb57cee2a48d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:38.848807 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:38.857116 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0826de-8ced-4686-96e1-66fec7592a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:38.857775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0826de-8ced-4686-96e1-66fec7592a8c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:38.858053 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0826de-8ced-4686-96e1-66fec7592a8c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:38.860638 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0826de-8ced-4686-96e1-66fec7592a8c None admin] PATH_INFO: `/v3/users/c10b2b291b214d42bdda8f9ce951ddad` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:38.860638 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0826de-8ced-4686-96e1-66fec7592a8c None admin] RBAC: Authorizing `identity:get_user(user_id=c10b2b291b214d42bdda8f9ce951ddad)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:38.860891 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0826de-8ced-4686-96e1-66fec7592a8c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:38.862777 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 158/315] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:38 2022] GET /identity/v3/users/c10b2b291b214d42bdda8f9ce951ddad => generated 297 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:38.868221 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb33a2-7708-4e3e-b0e3-93834ce66a83 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:38.902729 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:38.973376 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eb33a2-7708-4e3e-b0e3-93834ce66a83 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:39.012011 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2827715-d3af-4c30-a4b9-e04bee560ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:39.012621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2827715-d3af-4c30-a4b9-e04bee560ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:39.012896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2827715-d3af-4c30-a4b9-e04bee560ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:39.013159 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2827715-d3af-4c30-a4b9-e04bee560ab6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:39.088585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2827715-d3af-4c30-a4b9-e04bee560ab6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:39.090184 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2827715-d3af-4c30-a4b9-e04bee560ab6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:39.120869 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:39.191533 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 158/316] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:43:39.197495 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0826de-8ced-4686-96e1-66fec7592a8c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:39.307683 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0826de-8ced-4686-96e1-66fec7592a8c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:39.342662 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4441a95-c62f-417c-b7cf-d5aa5c183970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:39.343286 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4441a95-c62f-417c-b7cf-d5aa5c183970 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:39.343560 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4441a95-c62f-417c-b7cf-d5aa5c183970 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:39.343829 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4441a95-c62f-417c-b7cf-d5aa5c183970 None admin] PATH_INFO: `/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:39.344934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4441a95-c62f-417c-b7cf-d5aa5c183970 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb590e1a96a41bbbe00a0a9a82d9126)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:39.346580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4441a95-c62f-417c-b7cf-d5aa5c183970 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:39.348502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 159/317] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:39 2022] GET /identity/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126 => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:39.354392 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2827715-d3af-4c30-a4b9-e04bee560ab6 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:39.460458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2827715-d3af-4c30-a4b9-e04bee560ab6 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:39.494181 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:39.498364 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3242fc7-62fe-4aea-a9e5-c451f9787157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:39.498898 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3242fc7-62fe-4aea-a9e5-c451f9787157 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:39.499430 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3242fc7-62fe-4aea-a9e5-c451f9787157 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:39.499708 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3242fc7-62fe-4aea-a9e5-c451f9787157 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:39.500435 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3242fc7-62fe-4aea-a9e5-c451f9787157 None admin] RBAC: Adding query filter params (role.id=ec5168a1b302406fb0ec0082a2ed258a, scope.project.id=dcb590e1a96a41bbbe00a0a9a82d9126, user.id=c10b2b291b214d42bdda8f9ce951ddad) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:39.500744 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3242fc7-62fe-4aea-a9e5-c451f9787157 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:39.502230 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3242fc7-62fe-4aea-a9e5-c451f9787157 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:39.508371 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 159/318] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:43:39 2022] GET /identity/v3/role_assignments?user.id=c10b2b291b214d42bdda8f9ce951ddad&scope.project.id=dcb590e1a96a41bbbe00a0a9a82d9126&role.id=ec5168a1b302406fb0ec0082a2ed258a => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:39.964417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2cf77-8535-4d26-ade8-d2e6e5d7b07e None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:39.964721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2cf77-8535-4d26-ade8-d2e6e5d7b07e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:39.964975 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed2cf77-8535-4d26-ade8-d2e6e5d7b07e None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:39.966511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 160/319] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:39.971537 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc66d9-cce7-4cad-9e31-49dda6592604 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:39.971830 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc66d9-cce7-4cad-9e31-49dda6592604 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:39.972107 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfc66d9-cce7-4cad-9e31-49dda6592604 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:39.990953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-dbfc66d9-cce7-4cad-9e31-49dda6592604 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:39.992155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-dbfc66d9-cce7-4cad-9e31-49dda6592604 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:40.060613 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 160/320] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:40.327426 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2cf77-8535-4d26-ade8-d2e6e5d7b07e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:40.394476 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:40.437802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed2cf77-8535-4d26-ade8-d2e6e5d7b07e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:40.472834 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233339d2-8ad7-402a-992e-abc08f400393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:40.473462 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233339d2-8ad7-402a-992e-abc08f400393 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:40.473765 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233339d2-8ad7-402a-992e-abc08f400393 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:40.474042 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233339d2-8ad7-402a-992e-abc08f400393 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:40.475186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233339d2-8ad7-402a-992e-abc08f400393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:40.476625 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233339d2-8ad7-402a-992e-abc08f400393 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:40.478373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 161/321] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:43:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:40.483776 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc66d9-cce7-4cad-9e31-49dda6592604 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:40.499093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58117735-5a23-45f9-a8f1-8959a0b78d97 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:40.499650 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58117735-5a23-45f9-a8f1-8959a0b78d97 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:40.499650 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58117735-5a23-45f9-a8f1-8959a0b78d97 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:40.501090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 162/322] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:43:40.506075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf84f8f-0c95-415e-ba42-eb66c20223c4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:40.506236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf84f8f-0c95-415e-ba42-eb66c20223c4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:40.506487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf84f8f-0c95-415e-ba42-eb66c20223c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:40.525721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-bcf84f8f-0c95-415e-ba42-eb66c20223c4 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:40.526916 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bcf84f8f-0c95-415e-ba42-eb66c20223c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:40.590613 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfc66d9-cce7-4cad-9e31-49dda6592604 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:40.602605 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 163/323] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:43:40.621459 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:40.630179 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82283300-a378-431c-a978-0795d407dc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:40.630791 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82283300-a378-431c-a978-0795d407dc82 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:40.631070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82283300-a378-431c-a978-0795d407dc82 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:40.633969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82283300-a378-431c-a978-0795d407dc82 None admin] PATH_INFO: `/v3/groups` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:40.633969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82283300-a378-431c-a978-0795d407dc82 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:40.633969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82283300-a378-431c-a978-0795d407dc82 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:40.690749 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e84d3-4c6e-420c-9bf2-fb836c0a0f40 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:40.691036 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e84d3-4c6e-420c-9bf2-fb836c0a0f40 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:40.691313 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27e84d3-4c6e-420c-9bf2-fb836c0a0f40 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:40.692704 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 164/324] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:43:40.698255 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be577e6c-84f4-44f1-bcc4-09798e1e99f0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:40.698538 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be577e6c-84f4-44f1-bcc4-09798e1e99f0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:40.698816 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be577e6c-84f4-44f1-bcc4-09798e1e99f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:40.716634 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-be577e6c-84f4-44f1-bcc4-09798e1e99f0 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:40.717866 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-be577e6c-84f4-44f1-bcc4-09798e1e99f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:40.755036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 161/325] 10.222.0.59 () {60 vars in 1134 bytes} [Tue Sep 13 19:43:40 2022] POST /identity/v3/groups => generated 226 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:43:40.781385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:40.792656 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 165/326] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:43:40.874623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82283300-a378-431c-a978-0795d407dc82 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:40.978851 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82283300-a378-431c-a978-0795d407dc82 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:41.012790 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59e90b-aa5a-4bf2-8ba1-5a736dc0dd6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:41.013506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59e90b-aa5a-4bf2-8ba1-5a736dc0dd6e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:41.013719 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59e90b-aa5a-4bf2-8ba1-5a736dc0dd6e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:41.013997 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f59e90b-aa5a-4bf2-8ba1-5a736dc0dd6e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:41.024247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f59e90b-aa5a-4bf2-8ba1-5a736dc0dd6e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:41.029676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-1f59e90b-aa5a-4bf2-8ba1-5a736dc0dd6e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:43:41.029676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:41.029676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:41.029676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:41.029676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:41.029676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:41.029676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:41.029676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:41.029676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:41.029676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:41.029676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:41.029676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:41.029676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:41.029676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:41.029676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:41.029676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:41.030621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:41.030621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:41.030621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:41.030621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:41.030621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:41.030621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:41.030621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:41.030621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:41.030621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:41.030621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:41.030621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:41.030621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:41.030621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:41.030621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:41.030621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:41.030621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:41.031424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:41.031424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:41.031424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:41.031424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:41.031424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:41.031424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:41.031424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:41.031424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:41.031424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:41.031424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:41.031424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:43:41.031424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:43:41.031424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 162/327] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:41.036991 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be577e6c-84f4-44f1-bcc4-09798e1e99f0 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:41.060010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59e90b-aa5a-4bf2-8ba1-5a736dc0dd6e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:41.115343 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:41.163572 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be577e6c-84f4-44f1-bcc4-09798e1e99f0 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:41.187423 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f59e90b-aa5a-4bf2-8ba1-5a736dc0dd6e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:41.204682 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cce7bb-2ad5-4ea8-9139-1d14228cc9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:41.205557 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cce7bb-2ad5-4ea8-9139-1d14228cc9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:41.205860 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cce7bb-2ad5-4ea8-9139-1d14228cc9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:41.206134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cce7bb-2ad5-4ea8-9139-1d14228cc9b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:41.206967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cce7bb-2ad5-4ea8-9139-1d14228cc9b4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:41.207573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cce7bb-2ad5-4ea8-9139-1d14228cc9b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:41.208966 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cce7bb-2ad5-4ea8-9139-1d14228cc9b4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:41.220997 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 166/328] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:41.227007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cce7bb-2ad5-4ea8-9139-1d14228cc9b4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:41.227768 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab355a4-2057-4c74-9176-13c5b78e43a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:41.228968 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab355a4-2057-4c74-9176-13c5b78e43a1 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:41.229257 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab355a4-2057-4c74-9176-13c5b78e43a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:41.229535 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab355a4-2057-4c74-9176-13c5b78e43a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:41.242845 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab355a4-2057-4c74-9176-13c5b78e43a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:41.250826 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-0ab355a4-2057-4c74-9176-13c5b78e43a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:41.250826 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:41.250826 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:41.250826 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:41.250826 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:41.250826 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:41.250826 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:41.250826 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:41.250826 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:41.250826 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:41.250826 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:41.250826 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:41.250826 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:41.250826 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:41.250826 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:41.250826 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:41.251765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:41.251765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:41.251765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:41.251765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:41.251765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:41.251765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:41.251765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:41.251765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:41.251765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:41.251765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:41.251765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:41.251765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:41.251765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:41.251765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:41.251765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:41.251765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:41.252598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:41.252598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:41.252598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:41.252598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:41.252598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:41.252598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:41.252598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:41.252598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:41.252598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:41.252598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:41.252598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:41.252598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:43:41.252598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 163/329] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:43:41.256899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab355a4-2057-4c74-9176-13c5b78e43a1 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:41.301167 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:41.362525 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cce7bb-2ad5-4ea8-9139-1d14228cc9b4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:41.400607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab355a4-2057-4c74-9176-13c5b78e43a1 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:41.408858 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:41.410742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a51816-cd41-4b2b-9fcb-0e23676fb876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:41.411952 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a51816-cd41-4b2b-9fcb-0e23676fb876 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:41.412417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a51816-cd41-4b2b-9fcb-0e23676fb876 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:41.413138 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a51816-cd41-4b2b-9fcb-0e23676fb876 None admin] PATH_INFO: `/v3/users/a9fa4458abb54054bc3c572f6672379d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:41.414861 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a51816-cd41-4b2b-9fcb-0e23676fb876 None admin] RBAC: Authorizing `identity:get_user(user_id=a9fa4458abb54054bc3c572f6672379d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:41.417218 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a51816-cd41-4b2b-9fcb-0e23676fb876 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:41.419623 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 167/330] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:41 2022] GET /identity/v3/users/a9fa4458abb54054bc3c572f6672379d => generated 293 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:41.428471 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a51816-cd41-4b2b-9fcb-0e23676fb876 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:41.453878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257c406-ad9c-47e2-bfd9-94d21b7a57a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:41.454500 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257c406-ad9c-47e2-bfd9-94d21b7a57a2 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:41.454777 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257c406-ad9c-47e2-bfd9-94d21b7a57a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:41.455047 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257c406-ad9c-47e2-bfd9-94d21b7a57a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:41.455721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257c406-ad9c-47e2-bfd9-94d21b7a57a2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:41.456025 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257c406-ad9c-47e2-bfd9-94d21b7a57a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:41.457454 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257c406-ad9c-47e2-bfd9-94d21b7a57a2 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:41.469575 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 164/331] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:41.476119 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257c406-ad9c-47e2-bfd9-94d21b7a57a2 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:41.562003 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a51816-cd41-4b2b-9fcb-0e23676fb876 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:41.588277 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:41.594511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257c406-ad9c-47e2-bfd9-94d21b7a57a2 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:41.601331 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6827c418-8a4c-4b98-a2be-95e43afe68ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:41.602019 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827c418-8a4c-4b98-a2be-95e43afe68ff None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:41.602304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827c418-8a4c-4b98-a2be-95e43afe68ff None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:41.602581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6827c418-8a4c-4b98-a2be-95e43afe68ff None admin] PATH_INFO: `/v3/system/users/a9fa4458abb54054bc3c572f6672379d/roles/ec5168a1b302406fb0ec0082a2ed258a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:41.604155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827c418-8a4c-4b98-a2be-95e43afe68ff None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a9fa4458abb54054bc3c572f6672379d, role_id=ec5168a1b302406fb0ec0082a2ed258a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:41.605567 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6827c418-8a4c-4b98-a2be-95e43afe68ff None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:41.638472 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5840164-c74e-4d3f-b59b-7e2e8447d771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:41.639621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5840164-c74e-4d3f-b59b-7e2e8447d771 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:41.639835 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5840164-c74e-4d3f-b59b-7e2e8447d771 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:41.640102 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5840164-c74e-4d3f-b59b-7e2e8447d771 None admin] PATH_INFO: `/v3/users/1ed3310aa83a4e9fa65a722ef8b36da1` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:41.643397 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5840164-c74e-4d3f-b59b-7e2e8447d771 None admin] RBAC: Authorizing `identity:get_user(user_id=1ed3310aa83a4e9fa65a722ef8b36da1)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:41.644903 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5840164-c74e-4d3f-b59b-7e2e8447d771 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:41.647865 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 165/332] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:41 2022] GET /identity/v3/users/1ed3310aa83a4e9fa65a722ef8b36da1 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:41.653396 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5840164-c74e-4d3f-b59b-7e2e8447d771 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:41.664439 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 168/333] 10.222.0.59 () {58 vars in 1334 bytes} [Tue Sep 13 19:43:41 2022] PUT /identity/v3/system/users/a9fa4458abb54054bc3c572f6672379d/roles/ec5168a1b302406fb0ec0082a2ed258a => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:43:41.697918 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:41.774345 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5840164-c74e-4d3f-b59b-7e2e8447d771 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:41.814509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fae0e4-d14b-4fd9-a0ae-f94410f0ac83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:41.815144 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fae0e4-d14b-4fd9-a0ae-f94410f0ac83 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:41.815457 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fae0e4-d14b-4fd9-a0ae-f94410f0ac83 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:41.815711 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fae0e4-d14b-4fd9-a0ae-f94410f0ac83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:41.816457 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fae0e4-d14b-4fd9-a0ae-f94410f0ac83 None admin] RBAC: Adding query filter params (role.id=033268df62114ee6bf4c0512568f2609, user.id=1ed3310aa83a4e9fa65a722ef8b36da1, scope.system=all) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:41.816772 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fae0e4-d14b-4fd9-a0ae-f94410f0ac83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:41.818295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fae0e4-d14b-4fd9-a0ae-f94410f0ac83 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:41.833096 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 166/334] 10.222.0.59 () {56 vars in 1308 bytes} [Tue Sep 13 19:43:41 2022] GET /identity/v3/role_assignments?user.id=1ed3310aa83a4e9fa65a722ef8b36da1&scope.system=all&role.id=033268df62114ee6bf4c0512568f2609 => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:43.739760 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfba6d-81f1-474f-96b7-4ddca8fe4c41 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:43.740293 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfba6d-81f1-474f-96b7-4ddca8fe4c41 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:43.740536 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dfba6d-81f1-474f-96b7-4ddca8fe4c41 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:43.742442 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 169/335] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:43.748343 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb1c4d-e1cf-4385-9c1b-396742a98df4 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:43.748927 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb1c4d-e1cf-4385-9c1b-396742a98df4 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:43.749349 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb1c4d-e1cf-4385-9c1b-396742a98df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:43.773417 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-89cb1c4d-e1cf-4385-9c1b-396742a98df4 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:43.774653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-89cb1c4d-e1cf-4385-9c1b-396742a98df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:43.858607 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429f14a-f06b-4bab-a59e-7cb3e82c2c56 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:43.858930 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429f14a-f06b-4bab-a59e-7cb3e82c2c56 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:43.859195 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6429f14a-f06b-4bab-a59e-7cb3e82c2c56 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:43.860881 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 170/336] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:43:43.861999 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 167/337] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:43.881395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13222175-19b5-432a-9d67-b10e4686d43c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:43.881684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13222175-19b5-432a-9d67-b10e4686d43c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:43.882076 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13222175-19b5-432a-9d67-b10e4686d43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:43.915397 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-13222175-19b5-432a-9d67-b10e4686d43c None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:43.916677 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-13222175-19b5-432a-9d67-b10e4686d43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:44.008939 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 171/338] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:44.248784 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612e484-8a21-4c1e-b8cc-efebf8dde8d0 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:44.249465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612e484-8a21-4c1e-b8cc-efebf8dde8d0 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:44.249980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f612e484-8a21-4c1e-b8cc-efebf8dde8d0 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:44.251612 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 168/339] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:44.257137 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0ef2b-0b61-4762-bcc8-ea9e24a0eeb6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:44.257431 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0ef2b-0b61-4762-bcc8-ea9e24a0eeb6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:44.257719 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af0ef2b-0b61-4762-bcc8-ea9e24a0eeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:44.283075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8af0ef2b-0b61-4762-bcc8-ea9e24a0eeb6 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:44.283075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8af0ef2b-0b61-4762-bcc8-ea9e24a0eeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:44.295066 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612e484-8a21-4c1e-b8cc-efebf8dde8d0 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:44.340627 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:44.388163 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 172/340] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:44.476129 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f612e484-8a21-4c1e-b8cc-efebf8dde8d0 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:44.522721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979a648-870d-4f71-b923-fdc39e9d5aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:44.523802 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979a648-870d-4f71-b923-fdc39e9d5aa3 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:44.524285 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979a648-870d-4f71-b923-fdc39e9d5aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:44.524756 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5979a648-870d-4f71-b923-fdc39e9d5aa3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:44.545115 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5979a648-870d-4f71-b923-fdc39e9d5aa3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:44.546002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-5979a648-870d-4f71-b923-fdc39e9d5aa3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:44.546002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:44.546002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:44.546002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:44.546002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:44.546002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:44.546002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:44.546002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:44.546002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:44.546002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:44.546002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:44.546002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:44.546002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:44.546002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:44.546002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:44.546002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:44.546911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:44.546911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:44.546911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:44.546911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:44.546911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:44.546911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:44.546911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:44.546911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:44.546911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:44.546911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:44.546911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:44.546911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:44.546911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:44.546911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:44.546911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:44.546911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:44.547730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:44.547730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:44.547730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:44.547730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:44.547730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:44.547730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:44.547730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:44.547730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:44.547730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:44.547730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:44.547730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:44.547730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:43:44.550439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 169/341] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:43:44.558770 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0ef2b-0b61-4762-bcc8-ea9e24a0eeb6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:44.569361 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979a648-870d-4f71-b923-fdc39e9d5aa3 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:44.631728 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:44.668931 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:44.689268 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5979a648-870d-4f71-b923-fdc39e9d5aa3 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:44.717425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af0ef2b-0b61-4762-bcc8-ea9e24a0eeb6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:44.738849 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a5d6da-5dc6-4040-bf65-ac3a470da601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:44.740131 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5d6da-5dc6-4040-bf65-ac3a470da601 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:44.741098 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5d6da-5dc6-4040-bf65-ac3a470da601 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:44.741577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a5d6da-5dc6-4040-bf65-ac3a470da601 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:44.757790 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a5d6da-5dc6-4040-bf65-ac3a470da601 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:44.762619 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf95b1-5500-4311-8b24-a435927db0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:44.763530 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf95b1-5500-4311-8b24-a435927db0dc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:44.763909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf95b1-5500-4311-8b24-a435927db0dc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:44.764280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf95b1-5500-4311-8b24-a435927db0dc None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:44.765052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf95b1-5500-4311-8b24-a435927db0dc None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:44.765455 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf95b1-5500-4311-8b24-a435927db0dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:44.765909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-11a5d6da-5dc6-4040-bf65-ac3a470da601 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:44.765909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:44.765909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:44.765909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:44.765909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:44.765909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:44.765909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:44.765909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:44.765909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:44.765909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:44.765909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:44.765909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:44.765909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:44.765909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:44.765909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:44.765909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:44.766940 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:44.766940 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:44.766940 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:44.766940 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:44.766940 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:44.766940 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:44.766940 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:44.766940 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:44.766940 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:44.766940 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:44.766940 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:44.766940 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:44.766940 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:44.766940 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:44.766940 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:44.766940 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:44.767977 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:44.767977 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:44.767977 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:44.767977 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:44.767977 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:44.767977 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:44.767977 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:44.767977 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:44.767977 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:44.767977 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:44.767977 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:44.767977 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:43:44.769517 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf95b1-5500-4311-8b24-a435927db0dc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:44.770485 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 170/342] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Sep 13 19:43:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:43:44.772749 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7069d64-9aed-4a7f-981f-dbce975b34eb None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:44.773182 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7069d64-9aed-4a7f-981f-dbce975b34eb None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:44.773600 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7069d64-9aed-4a7f-981f-dbce975b34eb None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:44.781374 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 171/343] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:44 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:44.782622 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7069d64-9aed-4a7f-981f-dbce975b34eb None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:44.784849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 173/344] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:44.791467 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf95b1-5500-4311-8b24-a435927db0dc None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:44.997137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7069d64-9aed-4a7f-981f-dbce975b34eb None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:45.003988 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf95b1-5500-4311-8b24-a435927db0dc None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:45.034341 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:45.038610 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82964ea0-3597-46b4-b996-edb204706307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:45.039508 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82964ea0-3597-46b4-b996-edb204706307 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:45.039789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82964ea0-3597-46b4-b996-edb204706307 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:45.040059 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82964ea0-3597-46b4-b996-edb204706307 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:45.041298 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82964ea0-3597-46b4-b996-edb204706307 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:45.041602 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82964ea0-3597-46b4-b996-edb204706307 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:45.043023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82964ea0-3597-46b4-b996-edb204706307 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:45.046136 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e7637-ca05-437d-8c41-80a786d1abdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:45.046978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e7637-ca05-437d-8c41-80a786d1abdc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:45.047418 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e7637-ca05-437d-8c41-80a786d1abdc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:45.047849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09e7637-ca05-437d-8c41-80a786d1abdc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:45.052575 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 172/345] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:43:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:45.059959 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653124d-5c97-42b8-a6d7-1f74e43f7c0f None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:45.059959 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653124d-5c97-42b8-a6d7-1f74e43f7c0f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:45.059959 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a653124d-5c97-42b8-a6d7-1f74e43f7c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:45.078015 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:45.089064 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-a653124d-5c97-42b8-a6d7-1f74e43f7c0f None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:45.090699 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a653124d-5c97-42b8-a6d7-1f74e43f7c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:45.157028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e7637-ca05-437d-8c41-80a786d1abdc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:45.158517 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09e7637-ca05-437d-8c41-80a786d1abdc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:45.167985 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 173/346] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:45.169145 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653124d-5c97-42b8-a6d7-1f74e43f7c0f None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:45.291128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 174/347] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:45.292367 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e7637-ca05-437d-8c41-80a786d1abdc None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:45.294635 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a653124d-5c97-42b8-a6d7-1f74e43f7c0f None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:45.308489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:45.331998 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d79996-d3e6-47b5-97e6-76c0d61b0df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:45.332402 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d79996-d3e6-47b5-97e6-76c0d61b0df7 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:45.332676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d79996-d3e6-47b5-97e6-76c0d61b0df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:45.332942 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d79996-d3e6-47b5-97e6-76c0d61b0df7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:45.335859 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:45.348548 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d79996-d3e6-47b5-97e6-76c0d61b0df7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:45.354050 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-24d79996-d3e6-47b5-97e6-76c0d61b0df7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:45.354050 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:45.354050 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:45.354050 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:45.354050 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:45.354050 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:45.354050 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:45.354050 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:45.354050 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:45.354050 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:45.354050 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:45.354050 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:45.354050 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:45.354050 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:45.354050 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:45.354050 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:45.355163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:45.355163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:45.355163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:45.355163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:45.355163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:45.355163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:45.355163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:45.355163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:45.355163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:45.355163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:45.355163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:45.355163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:45.355163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:45.355163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:45.355163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:45.355163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:45.358780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:45.358780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:45.358780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:45.358780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:45.358780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:45.358780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:45.358780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:45.358780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:45.358780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:45.358780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:45.358780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:45.358780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:43:45.358780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 174/348] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:45.358780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d79996-d3e6-47b5-97e6-76c0d61b0df7 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:45.447847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09e7637-ca05-437d-8c41-80a786d1abdc None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:45.479469 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d79996-d3e6-47b5-97e6-76c0d61b0df7 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:45.507023 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73491ef-9708-46d0-8cc6-87b38e5e53f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:45.507891 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73491ef-9708-46d0-8cc6-87b38e5e53f5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:45.508322 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73491ef-9708-46d0-8cc6-87b38e5e53f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:45.508761 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73491ef-9708-46d0-8cc6-87b38e5e53f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:45.517805 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96110a34-36a5-45ad-bcbb-1e2ce1f7b3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:45.518614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96110a34-36a5-45ad-bcbb-1e2ce1f7b3ef None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:45.519016 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96110a34-36a5-45ad-bcbb-1e2ce1f7b3ef None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:45.520197 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96110a34-36a5-45ad-bcbb-1e2ce1f7b3ef None admin] PATH_INFO: `/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:45.520838 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96110a34-36a5-45ad-bcbb-1e2ce1f7b3ef None admin] RBAC: Authorizing `identity:get_project(project_id=de921f56e9d94e6c9a4cd2ca6b60f924)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:45.522746 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96110a34-36a5-45ad-bcbb-1e2ce1f7b3ef None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:45.524852 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 175/349] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:45 2022] GET /identity/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:45.526345 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96110a34-36a5-45ad-bcbb-1e2ce1f7b3ef None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:45.599150 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73491ef-9708-46d0-8cc6-87b38e5e53f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:45.601546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73491ef-9708-46d0-8cc6-87b38e5e53f5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:45.607442 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:45.616821 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:45.658549 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96110a34-36a5-45ad-bcbb-1e2ce1f7b3ef None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:45.702032 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6e3e7-900c-467c-99c1-65cd20037ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:45.702704 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6e3e7-900c-467c-99c1-65cd20037ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:45.702989 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6e3e7-900c-467c-99c1-65cd20037ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:45.703258 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff6e3e7-900c-467c-99c1-65cd20037ea1 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:45.703931 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6e3e7-900c-467c-99c1-65cd20037ea1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:45.704232 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6e3e7-900c-467c-99c1-65cd20037ea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:45.705609 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff6e3e7-900c-467c-99c1-65cd20037ea1 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:45.720349 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 176/350] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:45.721048 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6e3e7-900c-467c-99c1-65cd20037ea1 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:45.740088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 175/351] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:45.741357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73491ef-9708-46d0-8cc6-87b38e5e53f5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:45.858757 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff6e3e7-900c-467c-99c1-65cd20037ea1 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:45.859262 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73491ef-9708-46d0-8cc6-87b38e5e53f5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:45.871870 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:45.901987 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:45.905797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314ff915-9459-4b15-aff5-f3a5e758569d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:45.906501 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ff915-9459-4b15-aff5-f3a5e758569d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:45.906853 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ff915-9459-4b15-aff5-f3a5e758569d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:45.907190 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314ff915-9459-4b15-aff5-f3a5e758569d None admin] PATH_INFO: `/v3/groups/ef436473cb80410ab6201556c9b69448` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:45.913847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9e4d6-34a8-4f4c-b8d7-03f9150bff1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:45.913847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9e4d6-34a8-4f4c-b8d7-03f9150bff1f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:45.913847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9e4d6-34a8-4f4c-b8d7-03f9150bff1f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:45.913847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9e4d6-34a8-4f4c-b8d7-03f9150bff1f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:45.916709 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ff915-9459-4b15-aff5-f3a5e758569d None admin] RBAC: Authorizing `identity:get_group(group_id=ef436473cb80410ab6201556c9b69448)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:45.918359 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314ff915-9459-4b15-aff5-f3a5e758569d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:45.920143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 176/352] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Sep 13 19:43:45 2022] GET /identity/v3/groups/ef436473cb80410ab6201556c9b69448 => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:45.922379 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf9cda-cb38-40e1-95a5-a7563315769e None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:45.922872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf9cda-cb38-40e1-95a5-a7563315769e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:45.923143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf9cda-cb38-40e1-95a5-a7563315769e None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:45.924479 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 177/353] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:45.925175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf9cda-cb38-40e1-95a5-a7563315769e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:45.927198 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d9e4d6-34a8-4f4c-b8d7-03f9150bff1f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:45.933127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-29d9e4d6-34a8-4f4c-b8d7-03f9150bff1f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:43:45.933127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:45.933127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:45.933127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:45.933127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:45.933127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:45.933127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:45.933127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:45.933127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:45.933127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:45.933127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:45.933127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:45.933127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:45.933127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:45.933127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:45.933127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:45.934079 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:45.934079 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:45.934079 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:45.934079 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:45.934079 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:45.934079 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:45.934079 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:45.934079 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:45.934079 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:45.934079 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:45.934079 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:45.934079 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:45.934079 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:45.934079 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:45.934079 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:45.934079 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:45.934934 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:45.934934 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:45.934934 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:45.934934 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:45.934934 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:45.934934 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:45.934934 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:45.934934 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:45.934934 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:45.934934 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:45.934934 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 13 19:43:45.934934 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:43:45.935551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 177/354] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:45.936447 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9e4d6-34a8-4f4c-b8d7-03f9150bff1f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:46.064853 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf9cda-cb38-40e1-95a5-a7563315769e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:46.066643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9e4d6-34a8-4f4c-b8d7-03f9150bff1f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:46.106462 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2671d-6e5c-44cf-b39d-a0d5eb1e6acf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:46.107098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2671d-6e5c-44cf-b39d-a0d5eb1e6acf None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:46.107378 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2671d-6e5c-44cf-b39d-a0d5eb1e6acf None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:46.107648 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2671d-6e5c-44cf-b39d-a0d5eb1e6acf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:46.110750 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17930f-2f35-424c-bfab-227cb8221f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:46.111333 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17930f-2f35-424c-bfab-227cb8221f68 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:46.111607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17930f-2f35-424c-bfab-227cb8221f68 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:46.111882 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b17930f-2f35-424c-bfab-227cb8221f68 None admin] PATH_INFO: `/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:46.114319 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17930f-2f35-424c-bfab-227cb8221f68 None admin] RBAC: Authorizing `identity:get_project(project_id=de921f56e9d94e6c9a4cd2ca6b60f924)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:46.115807 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b17930f-2f35-424c-bfab-227cb8221f68 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:46.117919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 178/355] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:45 2022] GET /identity/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:46.119585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17930f-2f35-424c-bfab-227cb8221f68 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:46.177727 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:46.188538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:46.206719 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2671d-6e5c-44cf-b39d-a0d5eb1e6acf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:46.208482 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e2671d-6e5c-44cf-b39d-a0d5eb1e6acf None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:46.245777 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b17930f-2f35-424c-bfab-227cb8221f68 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:46.286911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678b7052-9679-45cc-bc70-f7c118582946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:46.287531 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b7052-9679-45cc-bc70-f7c118582946 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:46.288014 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b7052-9679-45cc-bc70-f7c118582946 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:46.288290 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678b7052-9679-45cc-bc70-f7c118582946 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:46.289235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b7052-9679-45cc-bc70-f7c118582946 None admin] RBAC: Adding query filter params (group.id=ef436473cb80410ab6201556c9b69448, role.id=033268df62114ee6bf4c0512568f2609, scope.project.id=de921f56e9d94e6c9a4cd2ca6b60f924) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:46.289791 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b7052-9679-45cc-bc70-f7c118582946 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:46.291955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678b7052-9679-45cc-bc70-f7c118582946 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:46.297963 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 179/356] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Sep 13 19:43:46 2022] GET /identity/v3/role_assignments?group.id=ef436473cb80410ab6201556c9b69448&scope.project.id=de921f56e9d94e6c9a4cd2ca6b60f924&role.id=033268df62114ee6bf4c0512568f2609 => generated 260 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:46.299282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f662cf-9310-48f8-acca-e2ff5aafaca5 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:46.299574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f662cf-9310-48f8-acca-e2ff5aafaca5 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:46.299849 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f662cf-9310-48f8-acca-e2ff5aafaca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:46.323971 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-33f662cf-9310-48f8-acca-e2ff5aafaca5 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:46.325220 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-33f662cf-9310-48f8-acca-e2ff5aafaca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:46.330293 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 178/357] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:46.331623 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2671d-6e5c-44cf-b39d-a0d5eb1e6acf None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:46.416151 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 180/358] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:46.417529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f662cf-9310-48f8-acca-e2ff5aafaca5 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:46.436736 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:46.467839 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2671d-6e5c-44cf-b39d-a0d5eb1e6acf None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:46.484793 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:46.510151 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d756ac5-3500-4d7b-b27c-c5c38516474f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:46.510757 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d756ac5-3500-4d7b-b27c-c5c38516474f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:46.511036 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d756ac5-3500-4d7b-b27c-c5c38516474f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:46.511306 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d756ac5-3500-4d7b-b27c-c5c38516474f None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:46.512136 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d756ac5-3500-4d7b-b27c-c5c38516474f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:46.512439 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d756ac5-3500-4d7b-b27c-c5c38516474f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:46.514721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d756ac5-3500-4d7b-b27c-c5c38516474f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:46.527492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 179/359] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:46 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:46.538631 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7e6b6-0bfb-486c-ad61-e5de02305039 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:46.538913 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7e6b6-0bfb-486c-ad61-e5de02305039 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:46.539186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7e6b6-0bfb-486c-ad61-e5de02305039 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:46.541131 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 180/360] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:46 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:46.541893 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7e6b6-0bfb-486c-ad61-e5de02305039 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:46.550941 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f662cf-9310-48f8-acca-e2ff5aafaca5 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:46.605956 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bac1bf-c25a-4260-86ba-d15576486c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:46.606687 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bac1bf-c25a-4260-86ba-d15576486c9e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:46.607910 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bac1bf-c25a-4260-86ba-d15576486c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:46.608219 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bac1bf-c25a-4260-86ba-d15576486c9e None admin] PATH_INFO: `/v3/groups/ef436473cb80410ab6201556c9b69448` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:46.609367 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bac1bf-c25a-4260-86ba-d15576486c9e None admin] RBAC: Authorizing `identity:get_group(group_id=ef436473cb80410ab6201556c9b69448)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:46.611028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bac1bf-c25a-4260-86ba-d15576486c9e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:46.612713 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 181/361] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Sep 13 19:43:46 2022] GET /identity/v3/groups/ef436473cb80410ab6201556c9b69448 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:46.614234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bac1bf-c25a-4260-86ba-d15576486c9e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:46.695169 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7e6b6-0bfb-486c-ad61-e5de02305039 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:46.746905 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa138ca-0ac4-4515-bfab-307b13187b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:46.747289 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bac1bf-c25a-4260-86ba-d15576486c9e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:46.748180 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa138ca-0ac4-4515-bfab-307b13187b26 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:46.748651 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa138ca-0ac4-4515-bfab-307b13187b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:46.749141 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa138ca-0ac4-4515-bfab-307b13187b26 None admin] PATH_INFO: `/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:46.750540 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa138ca-0ac4-4515-bfab-307b13187b26 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb590e1a96a41bbbe00a0a9a82d9126)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:46.752232 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa138ca-0ac4-4515-bfab-307b13187b26 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:46.753885 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 181/362] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:46 2022] GET /identity/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:46.755179 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119bb87-5b8b-4c22-8018-9d1c6cd69818 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:46.755289 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119bb87-5b8b-4c22-8018-9d1c6cd69818 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:46.755506 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119bb87-5b8b-4c22-8018-9d1c6cd69818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:46.766138 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:46.770582 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:46.786994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0119bb87-5b8b-4c22-8018-9d1c6cd69818 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:46.787288 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0119bb87-5b8b-4c22-8018-9d1c6cd69818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:46.792847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39cc08-7b63-4711-8e52-b28a688a0f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:46.793493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39cc08-7b63-4711-8e52-b28a688a0f4e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:46.793817 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39cc08-7b63-4711-8e52-b28a688a0f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:46.794093 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab39cc08-7b63-4711-8e52-b28a688a0f4e None admin] PATH_INFO: `/v3/users/a9fa4458abb54054bc3c572f6672379d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:46.795270 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39cc08-7b63-4711-8e52-b28a688a0f4e None admin] RBAC: Authorizing `identity:get_user(user_id=a9fa4458abb54054bc3c572f6672379d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:46.796695 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab39cc08-7b63-4711-8e52-b28a688a0f4e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:46.800177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 182/363] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:43:46 2022] GET /identity/v3/users/a9fa4458abb54054bc3c572f6672379d => generated 293 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:46.800177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39cc08-7b63-4711-8e52-b28a688a0f4e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:46.902704 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 182/364] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:46.904121 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119bb87-5b8b-4c22-8018-9d1c6cd69818 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:46.935333 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab39cc08-7b63-4711-8e52-b28a688a0f4e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:46.976490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040d9e9-41da-4a39-857e-6ecc5f646c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:46.977148 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040d9e9-41da-4a39-857e-6ecc5f646c17 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:46.977431 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040d9e9-41da-4a39-857e-6ecc5f646c17 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:46.977779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7040d9e9-41da-4a39-857e-6ecc5f646c17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:46.978519 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040d9e9-41da-4a39-857e-6ecc5f646c17 None admin] RBAC: Adding query filter params (group.id=ef436473cb80410ab6201556c9b69448, role.id=d520f560be6d45539a966c6de2a934e7, scope.project.id=de921f56e9d94e6c9a4cd2ca6b60f924) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:46.978838 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040d9e9-41da-4a39-857e-6ecc5f646c17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:46.980392 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7040d9e9-41da-4a39-857e-6ecc5f646c17 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:46.987366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 183/365] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Sep 13 19:43:46 2022] GET /identity/v3/role_assignments?group.id=ef436473cb80410ab6201556c9b69448&scope.project.id=de921f56e9d94e6c9a4cd2ca6b60f924&role.id=d520f560be6d45539a966c6de2a934e7 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:46.988150 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040d9e9-41da-4a39-857e-6ecc5f646c17 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:47.043318 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119bb87-5b8b-4c22-8018-9d1c6cd69818 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:47.083558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:47.087034 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:47.094248 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2b719-c07f-45d4-86b0-a20742883b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:47.095285 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2b719-c07f-45d4-86b0-a20742883b5e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:47.095746 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2b719-c07f-45d4-86b0-a20742883b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:47.099847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2b719-c07f-45d4-86b0-a20742883b5e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:47.114664 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac2b719-c07f-45d4-86b0-a20742883b5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:47.120298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-9ac2b719-c07f-45d4-86b0-a20742883b5e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:47.120298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:47.120298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:47.120298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:47.120298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:47.120298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:47.120298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:47.120298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:47.120298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:47.120298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:47.120298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:47.120298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:47.120298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:47.120298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:47.120298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:47.120298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:47.121282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:47.121282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:47.121282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:47.121282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:47.121282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:47.121282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:47.121282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:47.121282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:47.121282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:47.121282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:47.121282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:47.121282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:47.121282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:47.121282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:47.121282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:47.121282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:47.122178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:47.122178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:47.122178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:47.122178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:47.122178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:47.122178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:47.122178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:47.122178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:47.122178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:47.122178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:47.122178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:47.122178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:43:47.130300 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 183/366] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Sep 13 19:43:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:47.131281 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2b719-c07f-45d4-86b0-a20742883b5e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:47.157219 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7040d9e9-41da-4a39-857e-6ecc5f646c17 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:47.229054 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5d3de-0696-45b0-9d45-533eb54cbe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:47.230063 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5d3de-0696-45b0-9d45-533eb54cbe1d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:47.231231 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5d3de-0696-45b0-9d45-533eb54cbe1d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:47.231749 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af5d3de-0696-45b0-9d45-533eb54cbe1d None admin] PATH_INFO: `/v3/groups/ef436473cb80410ab6201556c9b69448` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:47.235477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5d3de-0696-45b0-9d45-533eb54cbe1d None admin] RBAC: Authorizing `identity:get_group(group_id=ef436473cb80410ab6201556c9b69448)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:47.237851 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af5d3de-0696-45b0-9d45-533eb54cbe1d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:47.240284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 184/367] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Sep 13 19:43:46 2022] GET /identity/v3/groups/ef436473cb80410ab6201556c9b69448 => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:47.241348 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5d3de-0696-45b0-9d45-533eb54cbe1d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:47.306380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2b719-c07f-45d4-86b0-a20742883b5e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:47.358837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7ced0-46f6-47e3-9caf-31bac52232f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:47.359441 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7ced0-46f6-47e3-9caf-31bac52232f7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:47.359714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7ced0-46f6-47e3-9caf-31bac52232f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:47.359978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7ced0-46f6-47e3-9caf-31bac52232f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:47.360691 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7ced0-46f6-47e3-9caf-31bac52232f7 None admin] RBAC: Adding query filter params (role.id=ec5168a1b302406fb0ec0082a2ed258a, user.id=a9fa4458abb54054bc3c572f6672379d, scope.system=all) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:47.360989 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7ced0-46f6-47e3-9caf-31bac52232f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:47.362436 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7ced0-46f6-47e3-9caf-31bac52232f7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:47.376101 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 184/368] 10.222.0.59 () {56 vars in 1308 bytes} [Tue Sep 13 19:43:47 2022] GET /identity/v3/role_assignments?user.id=a9fa4458abb54054bc3c572f6672379d&scope.system=all&role.id=ec5168a1b302406fb0ec0082a2ed258a => generated 510 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:47.376724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7ced0-46f6-47e3-9caf-31bac52232f7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:47.391141 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af5d3de-0696-45b0-9d45-533eb54cbe1d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:47.409496 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:47.445017 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:47.457272 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77ee09-fb36-416e-a17d-449c3d23cf5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:47.457933 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77ee09-fb36-416e-a17d-449c3d23cf5d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:47.458212 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77ee09-fb36-416e-a17d-449c3d23cf5d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:47.458483 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a77ee09-fb36-416e-a17d-449c3d23cf5d None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:47.459161 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77ee09-fb36-416e-a17d-449c3d23cf5d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:47.459505 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77ee09-fb36-416e-a17d-449c3d23cf5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:47.460889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a77ee09-fb36-416e-a17d-449c3d23cf5d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:47.475456 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 185/369] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:43:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:47.476325 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77ee09-fb36-416e-a17d-449c3d23cf5d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:47.524129 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7ced0-46f6-47e3-9caf-31bac52232f7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:47.597991 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b533a8-5fa4-47d0-bb1e-0713297e8562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:47.598672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b533a8-5fa4-47d0-bb1e-0713297e8562 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:47.598950 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b533a8-5fa4-47d0-bb1e-0713297e8562 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:47.599220 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b533a8-5fa4-47d0-bb1e-0713297e8562 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:47.599948 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b533a8-5fa4-47d0-bb1e-0713297e8562 None admin] RBAC: Adding query filter params (group.id=ef436473cb80410ab6201556c9b69448, role.id=033268df62114ee6bf4c0512568f2609, scope.project.id=dcb590e1a96a41bbbe00a0a9a82d9126) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:47.600250 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b533a8-5fa4-47d0-bb1e-0713297e8562 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:47.601749 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b533a8-5fa4-47d0-bb1e-0713297e8562 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:47.614935 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 185/370] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Sep 13 19:43:47 2022] GET /identity/v3/role_assignments?group.id=ef436473cb80410ab6201556c9b69448&scope.project.id=dcb590e1a96a41bbbe00a0a9a82d9126&role.id=033268df62114ee6bf4c0512568f2609 => generated 260 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:47.615798 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b533a8-5fa4-47d0-bb1e-0713297e8562 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:47.677126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a77ee09-fb36-416e-a17d-449c3d23cf5d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:47.763196 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0983caa-bf88-4b3a-b754-f280f7b4ba90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:47.764317 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0983caa-bf88-4b3a-b754-f280f7b4ba90 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:47.765664 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0983caa-bf88-4b3a-b754-f280f7b4ba90 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:47.766265 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0983caa-bf88-4b3a-b754-f280f7b4ba90 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:47.791374 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0983caa-bf88-4b3a-b754-f280f7b4ba90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:47.798155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-b0983caa-bf88-4b3a-b754-f280f7b4ba90 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:47.798155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:47.798155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:47.798155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:47.798155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:47.798155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:47.798155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:47.798155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:47.798155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:47.798155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:47.798155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:47.798155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:47.798155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:47.798155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:47.798155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:47.798155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:47.799136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:47.799136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:47.799136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:47.799136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:47.799136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:47.799136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:47.799136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:47.799136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:47.799136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:47.799136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:47.799136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:47.799136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:47.799136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:47.799136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:47.799136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:47.799136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:47.799961 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:47.799961 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:47.799961 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:47.799961 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:47.799961 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:47.799961 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:47.799961 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:47.799961 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:47.799961 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:47.799961 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:47.799961 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:47.799961 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:43:47.802731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 186/371] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:43:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:47.809931 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0983caa-bf88-4b3a-b754-f280f7b4ba90 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:47.842175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b533a8-5fa4-47d0-bb1e-0713297e8562 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:47.867362 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:47.893273 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:47.913570 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e50cc-971e-4eab-b3ba-e6a62b10a530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:47.914226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e50cc-971e-4eab-b3ba-e6a62b10a530 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:47.914483 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e50cc-971e-4eab-b3ba-e6a62b10a530 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:47.914752 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e50cc-971e-4eab-b3ba-e6a62b10a530 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:48.017341 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0983caa-bf88-4b3a-b754-f280f7b4ba90 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:48.036337 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e50cc-971e-4eab-b3ba-e6a62b10a530 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:48.037861 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e50cc-971e-4eab-b3ba-e6a62b10a530 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:48.090061 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aca04e-5de9-456a-a326-10915a4fa190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:48.090615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aca04e-5de9-456a-a326-10915a4fa190 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:48.090976 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aca04e-5de9-456a-a326-10915a4fa190 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:48.091306 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68aca04e-5de9-456a-a326-10915a4fa190 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:48.092094 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aca04e-5de9-456a-a326-10915a4fa190 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:48.092470 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aca04e-5de9-456a-a326-10915a4fa190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:48.094091 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68aca04e-5de9-456a-a326-10915a4fa190 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:48.118306 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 187/372] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:48.123388 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aca04e-5de9-456a-a326-10915a4fa190 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:48.242052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 186/373] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:48.248002 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e50cc-971e-4eab-b3ba-e6a62b10a530 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:48.275439 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:48.308105 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:48.314590 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68aca04e-5de9-456a-a326-10915a4fa190 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:48.357796 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405f898-b4ad-4007-a82c-723ee7feb2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:48.357796 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405f898-b4ad-4007-a82c-723ee7feb2c9 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:48.357796 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405f898-b4ad-4007-a82c-723ee7feb2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:48.357796 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e405f898-b4ad-4007-a82c-723ee7feb2c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:48.415337 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e50cc-971e-4eab-b3ba-e6a62b10a530 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:48.476898 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa2372-4a4c-4333-80b9-684689aae70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:48.479821 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa2372-4a4c-4333-80b9-684689aae70f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:48.480096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa2372-4a4c-4333-80b9-684689aae70f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:48.480363 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fa2372-4a4c-4333-80b9-684689aae70f None admin] PATH_INFO: `/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:48.481737 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa2372-4a4c-4333-80b9-684689aae70f None admin] RBAC: Authorizing `identity:get_project(project_id=dcb590e1a96a41bbbe00a0a9a82d9126)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:48.483180 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fa2372-4a4c-4333-80b9-684689aae70f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:48.486240 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 187/374] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:48 2022] GET /identity/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126 => generated 302 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:48.490167 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa2372-4a4c-4333-80b9-684689aae70f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:48.494728 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405f898-b4ad-4007-a82c-723ee7feb2c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:48.496510 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e405f898-b4ad-4007-a82c-723ee7feb2c9 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:48.589722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:48.601896 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fa2372-4a4c-4333-80b9-684689aae70f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:48.640295 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47391a-ba15-4728-bdde-35e8fd61b796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:48.640626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47391a-ba15-4728-bdde-35e8fd61b796 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:48.640905 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47391a-ba15-4728-bdde-35e8fd61b796 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:48.641186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e47391a-ba15-4728-bdde-35e8fd61b796 None admin] PATH_INFO: `/v3/groups/ef436473cb80410ab6201556c9b69448` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:48.646840 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47391a-ba15-4728-bdde-35e8fd61b796 None admin] RBAC: Authorizing `identity:get_group(group_id=ef436473cb80410ab6201556c9b69448)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:48.648329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e47391a-ba15-4728-bdde-35e8fd61b796 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:48.653866 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 188/375] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Sep 13 19:43:48 2022] GET /identity/v3/groups/ef436473cb80410ab6201556c9b69448 => generated 226 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:48.656738 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47391a-ba15-4728-bdde-35e8fd61b796 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:48.667076 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:48.671513 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 188/376] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:48.676910 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405f898-b4ad-4007-a82c-723ee7feb2c9 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:48.844172 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e405f898-b4ad-4007-a82c-723ee7feb2c9 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:48.847328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e47391a-ba15-4728-bdde-35e8fd61b796 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:48.908062 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73619a9b-f846-42f2-beff-efabd8bdda41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:48.908723 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73619a9b-f846-42f2-beff-efabd8bdda41 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:48.908998 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73619a9b-f846-42f2-beff-efabd8bdda41 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:48.909270 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73619a9b-f846-42f2-beff-efabd8bdda41 None admin] PATH_INFO: `/v3/projects/a7c8626d92bb447c910575be75fc0558` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:48.910800 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73619a9b-f846-42f2-beff-efabd8bdda41 None admin] RBAC: Authorizing `identity:get_project(project_id=a7c8626d92bb447c910575be75fc0558)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:48.912905 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73619a9b-f846-42f2-beff-efabd8bdda41 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:48.914257 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9960721-473a-47f6-aa28-e64162d3627d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:48.914880 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9960721-473a-47f6-aa28-e64162d3627d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:48.915191 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9960721-473a-47f6-aa28-e64162d3627d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:48.915538 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9960721-473a-47f6-aa28-e64162d3627d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:48.916288 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9960721-473a-47f6-aa28-e64162d3627d None admin] RBAC: Adding query filter params (group.id=ef436473cb80410ab6201556c9b69448, role.id=d520f560be6d45539a966c6de2a934e7, scope.project.id=dcb590e1a96a41bbbe00a0a9a82d9126) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:48.916590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9960721-473a-47f6-aa28-e64162d3627d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:48.918077 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9960721-473a-47f6-aa28-e64162d3627d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:48.921250 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 189/377] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:48 2022] GET /identity/v3/projects/a7c8626d92bb447c910575be75fc0558 => generated 344 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:48.928379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73619a9b-f846-42f2-beff-efabd8bdda41 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:48.934306 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 189/378] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Sep 13 19:43:48 2022] GET /identity/v3/role_assignments?group.id=ef436473cb80410ab6201556c9b69448&scope.project.id=dcb590e1a96a41bbbe00a0a9a82d9126&role.id=d520f560be6d45539a966c6de2a934e7 => generated 260 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:49.014335 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:49.050073 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73619a9b-f846-42f2-beff-efabd8bdda41 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:49.090071 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5814afbb-fc2d-42ac-8a20-43a1e7f3feb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:49.091133 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814afbb-fc2d-42ac-8a20-43a1e7f3feb7 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:49.091618 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814afbb-fc2d-42ac-8a20-43a1e7f3feb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:49.092105 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5814afbb-fc2d-42ac-8a20-43a1e7f3feb7 None admin] PATH_INFO: `/v3/groups/9baa280a8e9e4e4da59ef5a929717b65` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:49.100131 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814afbb-fc2d-42ac-8a20-43a1e7f3feb7 None admin] RBAC: Authorizing `identity:get_group(group_id=9baa280a8e9e4e4da59ef5a929717b65)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:49.101957 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5814afbb-fc2d-42ac-8a20-43a1e7f3feb7 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:49.104784 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 190/379] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Sep 13 19:43:48 2022] GET /identity/v3/groups/9baa280a8e9e4e4da59ef5a929717b65 => generated 229 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:49.110431 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9960721-473a-47f6-aa28-e64162d3627d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:49.126561 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f9082-9185-4d16-927a-f36ef9f7ea0c None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:49.126847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f9082-9185-4d16-927a-f36ef9f7ea0c None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:49.127318 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768f9082-9185-4d16-927a-f36ef9f7ea0c None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:49.129147 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 191/380] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:49.136253 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d298a-9047-4791-b2a1-0b33c5d2552c None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:49.137150 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d298a-9047-4791-b2a1-0b33c5d2552c None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:49.137587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225d298a-9047-4791-b2a1-0b33c5d2552c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:49.155599 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:49.161448 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-225d298a-9047-4791-b2a1-0b33c5d2552c None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:49.162944 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-225d298a-9047-4791-b2a1-0b33c5d2552c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:49.253373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 192/381] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:43:49.297492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9960721-473a-47f6-aa28-e64162d3627d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:49.345090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b98eb-06df-400c-b1e9-7e86d093960e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:49.345719 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b98eb-06df-400c-b1e9-7e86d093960e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:49.345995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b98eb-06df-400c-b1e9-7e86d093960e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:49.346265 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51b98eb-06df-400c-b1e9-7e86d093960e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:49.346991 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b98eb-06df-400c-b1e9-7e86d093960e None admin] RBAC: Adding query filter params (group.id=9baa280a8e9e4e4da59ef5a929717b65, role.id=cd02ef2043de492a8bff6c165485f255, scope.project.id=a7c8626d92bb447c910575be75fc0558) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:49.347296 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b98eb-06df-400c-b1e9-7e86d093960e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:49.348727 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51b98eb-06df-400c-b1e9-7e86d093960e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:49.355080 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 190/382] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Sep 13 19:43:49 2022] GET /identity/v3/role_assignments?group.id=9baa280a8e9e4e4da59ef5a929717b65&scope.project.id=a7c8626d92bb447c910575be75fc0558&role.id=cd02ef2043de492a8bff6c165485f255 => generated 260 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:49.568529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d298a-9047-4791-b2a1-0b33c5d2552c None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:49.652529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:49.697175 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225d298a-9047-4791-b2a1-0b33c5d2552c None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:49.744398 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0bda2e-8721-442e-b111-3ba91e8750e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:49.745055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bda2e-8721-442e-b111-3ba91e8750e3 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:49.745337 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bda2e-8721-442e-b111-3ba91e8750e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:49.745609 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0bda2e-8721-442e-b111-3ba91e8750e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:49.762355 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0bda2e-8721-442e-b111-3ba91e8750e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:49.767596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-2a0bda2e-8721-442e-b111-3ba91e8750e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:49.767596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:49.767596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:49.767596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:49.767596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:49.767596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:49.767596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:49.767596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:49.767596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:49.767596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:49.767596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:49.767596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:49.767596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:49.767596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:49.767596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:49.767596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:49.768564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:49.768564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:49.768564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:49.768564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:49.768564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:49.768564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:49.768564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:49.768564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:49.768564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:49.768564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:49.768564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:49.768564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:49.768564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:49.768564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:49.768564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:49.768564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:49.769406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:49.769406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:49.769406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:49.769406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:49.769406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:49.769406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:49.769406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:49.769406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:49.769406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:49.769406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:49.769406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:49.769406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:43:49.771577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 193/383] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:49.777810 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b98eb-06df-400c-b1e9-7e86d093960e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:49.855473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4f3fb-88cc-4c63-8cd9-725e64d5e19a None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:49.858160 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4f3fb-88cc-4c63-8cd9-725e64d5e19a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:49.858444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4f3fb-88cc-4c63-8cd9-725e64d5e19a None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:49.860830 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 194/384] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:43:49.871125 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7a263-f4ea-434e-b9c4-4dd1e3f15876 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:49.871431 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7a263-f4ea-434e-b9c4-4dd1e3f15876 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:49.871678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c7a263-f4ea-434e-b9c4-4dd1e3f15876 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:49.902849 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-98c7a263-f4ea-434e-b9c4-4dd1e3f15876 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:49.904236 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-98c7a263-f4ea-434e-b9c4-4dd1e3f15876 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:49.905843 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:49.943331 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51b98eb-06df-400c-b1e9-7e86d093960e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:50.004720 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e5864-8e91-474f-95a7-7746de3e80fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:50.005330 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e5864-8e91-474f-95a7-7746de3e80fe None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:50.005605 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e5864-8e91-474f-95a7-7746de3e80fe None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:50.005894 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e5864-8e91-474f-95a7-7746de3e80fe None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:50.006559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e5864-8e91-474f-95a7-7746de3e80fe None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:50.006855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e5864-8e91-474f-95a7-7746de3e80fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:50.008229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e5864-8e91-474f-95a7-7746de3e80fe None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:50.028012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 191/385] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:50.037259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e5864-8e91-474f-95a7-7746de3e80fe None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:50.037435 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 195/386] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:43:50.204501 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e5864-8e91-474f-95a7-7746de3e80fe None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:50.262399 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0f007a-ca75-421b-9228-29e57be71c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:50.263042 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f007a-ca75-421b-9228-29e57be71c78 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:50.263331 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f007a-ca75-421b-9228-29e57be71c78 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:50.263611 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0f007a-ca75-421b-9228-29e57be71c78 None admin] PATH_INFO: `/v3/groups/ef436473cb80410ab6201556c9b69448` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:50.264753 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f007a-ca75-421b-9228-29e57be71c78 None admin] RBAC: Authorizing `identity:get_group(group_id=ef436473cb80410ab6201556c9b69448)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:50.266217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0f007a-ca75-421b-9228-29e57be71c78 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:50.267789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 192/387] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Sep 13 19:43:50 2022] GET /identity/v3/groups/ef436473cb80410ab6201556c9b69448 => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:50.273362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7a263-f4ea-434e-b9c4-4dd1e3f15876 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:50.335185 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0ec55-4043-4e27-b70e-542b1986d5ff None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:50.335515 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0ec55-4043-4e27-b70e-542b1986d5ff None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:50.335747 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0ec55-4043-4e27-b70e-542b1986d5ff None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:50.337415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 193/388] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:43:50.344397 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3de5ae-66a9-4569-9d93-6f5b4ba071a7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:50.344681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3de5ae-66a9-4569-9d93-6f5b4ba071a7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:50.344957 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3de5ae-66a9-4569-9d93-6f5b4ba071a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:50.361598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:50.382716 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ec3de5ae-66a9-4569-9d93-6f5b4ba071a7 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:50.384793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ec3de5ae-66a9-4569-9d93-6f5b4ba071a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:50.395114 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:50.413538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c7a263-f4ea-434e-b9c4-4dd1e3f15876 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:50.452577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe1565-c02f-4bab-9d4a-367edde2769d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:50.454035 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe1565-c02f-4bab-9d4a-367edde2769d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:50.454644 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe1565-c02f-4bab-9d4a-367edde2769d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:50.455098 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fe1565-c02f-4bab-9d4a-367edde2769d None admin] PATH_INFO: `/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:50.456578 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe1565-c02f-4bab-9d4a-367edde2769d None admin] RBAC: Authorizing `identity:get_project(project_id=de921f56e9d94e6c9a4cd2ca6b60f924)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:50.458211 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fe1565-c02f-4bab-9d4a-367edde2769d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:50.461230 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 196/389] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:50 2022] GET /identity/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:50.462492 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe1565-c02f-4bab-9d4a-367edde2769d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:50.464468 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 194/390] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:43:50.474056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3de5ae-66a9-4569-9d93-6f5b4ba071a7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:50.633588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fe1565-c02f-4bab-9d4a-367edde2769d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:50.657998 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:50.675053 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30165e65-5be7-49be-929c-2c131a3e12d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:50.675736 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30165e65-5be7-49be-929c-2c131a3e12d5 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:50.676018 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30165e65-5be7-49be-929c-2c131a3e12d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:50.676298 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30165e65-5be7-49be-929c-2c131a3e12d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:50.676497 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3de5ae-66a9-4569-9d93-6f5b4ba071a7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:50.696922 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30165e65-5be7-49be-929c-2c131a3e12d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:50.702603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-30165e65-5be7-49be-929c-2c131a3e12d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:50.702603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:50.702603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:50.702603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:50.702603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:50.702603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:50.702603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:50.702603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:50.702603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:50.702603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:50.702603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:50.702603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:50.702603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:50.702603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:50.702603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:50.702603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:50.703511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:50.703511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:50.703511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:50.703511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:50.703511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:50.703511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:50.703511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:50.703511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:50.703511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:50.703511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:50.703511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:50.703511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:50.703511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:50.703511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:50.703511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:50.703511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:50.704314 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:50.704314 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:50.704314 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:50.704314 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:50.704314 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:50.704314 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:50.704314 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:50.704314 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:50.704314 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:50.704314 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:50.704314 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:50.704314 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:43:50.709919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 197/391] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Sep 13 19:43:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:50.715436 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30165e65-5be7-49be-929c-2c131a3e12d5 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:50.737390 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d92e21-6b91-4002-b3ca-5e35c901c785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:50.738079 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d92e21-6b91-4002-b3ca-5e35c901c785 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:50.738360 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d92e21-6b91-4002-b3ca-5e35c901c785 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:50.738635 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d92e21-6b91-4002-b3ca-5e35c901c785 None admin] PATH_INFO: `/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924/groups/ef436473cb80410ab6201556c9b69448/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:50.741313 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d92e21-6b91-4002-b3ca-5e35c901c785 None admin] RBAC: Authorizing `identity:create_grant(project_id=de921f56e9d94e6c9a4cd2ca6b60f924, group_id=ef436473cb80410ab6201556c9b69448, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:50.744824 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d92e21-6b91-4002-b3ca-5e35c901c785 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:50.826560 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:50.838045 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 195/392] 10.222.0.59 () {58 vars in 1442 bytes} [Tue Sep 13 19:43:50 2022] PUT /identity/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924/groups/ef436473cb80410ab6201556c9b69448/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:43:50.839071 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d92e21-6b91-4002-b3ca-5e35c901c785 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:50.850432 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30165e65-5be7-49be-929c-2c131a3e12d5 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:50.903730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b19d68-8e21-48a7-b045-5d60697fd86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:50.904421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b19d68-8e21-48a7-b045-5d60697fd86b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:50.904732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b19d68-8e21-48a7-b045-5d60697fd86b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:50.905062 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b19d68-8e21-48a7-b045-5d60697fd86b None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:50.906108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b19d68-8e21-48a7-b045-5d60697fd86b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:50.909560 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b19d68-8e21-48a7-b045-5d60697fd86b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:50.909560 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b19d68-8e21-48a7-b045-5d60697fd86b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:50.930107 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 198/393] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:43:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:50.936653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b19d68-8e21-48a7-b045-5d60697fd86b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:51.035426 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:51.071916 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d92e21-6b91-4002-b3ca-5e35c901c785 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:51.124942 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43aff7-fac8-4708-9b3d-e32b56a356dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:51.126064 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43aff7-fac8-4708-9b3d-e32b56a356dc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:51.126468 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43aff7-fac8-4708-9b3d-e32b56a356dc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:51.126751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43aff7-fac8-4708-9b3d-e32b56a356dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:51.128028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b19d68-8e21-48a7-b045-5d60697fd86b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:51.156804 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43aff7-fac8-4708-9b3d-e32b56a356dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:51.164333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-7a43aff7-fac8-4708-9b3d-e32b56a356dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:51.164333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:51.164333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:51.164333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:51.164333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:51.164333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:51.164333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:51.164333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:51.164333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:51.164333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:51.164333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:51.164333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:51.164333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:51.164333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:51.164333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:51.164333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:51.166249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:51.166249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:51.166249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:51.166249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:51.166249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:51.166249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:51.166249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:51.166249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:51.166249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:51.166249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:51.166249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:51.166249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:51.166249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:51.166249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:51.166249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:51.166249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:51.167057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:51.167057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:51.167057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:51.167057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:51.167057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:51.167057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:51.167057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:51.167057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:51.167057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:51.167057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:51.167057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:51.167057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:43:51.169070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 196/394] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:51.178181 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43aff7-fac8-4708-9b3d-e32b56a356dc None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:51.198496 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2eb10-a47a-4283-b8a2-e4781a70e5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:51.199138 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2eb10-a47a-4283-b8a2-e4781a70e5b6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:51.199417 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2eb10-a47a-4283-b8a2-e4781a70e5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:51.199690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a2eb10-a47a-4283-b8a2-e4781a70e5b6 None admin] PATH_INFO: `/v3/groups/ef436473cb80410ab6201556c9b69448` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:51.201239 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2eb10-a47a-4283-b8a2-e4781a70e5b6 None admin] RBAC: Authorizing `identity:get_group(group_id=ef436473cb80410ab6201556c9b69448)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:51.202903 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a2eb10-a47a-4283-b8a2-e4781a70e5b6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:51.205004 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 199/395] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Sep 13 19:43:50 2022] GET /identity/v3/groups/ef436473cb80410ab6201556c9b69448 => generated 226 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:51.211012 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2eb10-a47a-4283-b8a2-e4781a70e5b6 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:51.301339 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:51.382189 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43aff7-fac8-4708-9b3d-e32b56a356dc None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:51.405358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a2eb10-a47a-4283-b8a2-e4781a70e5b6 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:51.424817 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:51.451905 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7af1f-a2be-46e3-a6b6-d0d1c1479ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:51.452577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7af1f-a2be-46e3-a6b6-d0d1c1479ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:51.452861 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7af1f-a2be-46e3-a6b6-d0d1c1479ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:51.453137 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb7af1f-a2be-46e3-a6b6-d0d1c1479ec5 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:51.453850 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7af1f-a2be-46e3-a6b6-d0d1c1479ec5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:51.455730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7af1f-a2be-46e3-a6b6-d0d1c1479ec5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:51.457377 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb7af1f-a2be-46e3-a6b6-d0d1c1479ec5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:51.471710 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 197/396] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:51.472831 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7af1f-a2be-46e3-a6b6-d0d1c1479ec5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:51.482424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef005e-90aa-4b1f-a03f-20e6390f31f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:51.483090 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef005e-90aa-4b1f-a03f-20e6390f31f0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:51.483378 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef005e-90aa-4b1f-a03f-20e6390f31f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:51.483661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef005e-90aa-4b1f-a03f-20e6390f31f0 None admin] PATH_INFO: `/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:51.484880 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef005e-90aa-4b1f-a03f-20e6390f31f0 None admin] RBAC: Authorizing `identity:get_project(project_id=de921f56e9d94e6c9a4cd2ca6b60f924)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:51.486359 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fef005e-90aa-4b1f-a03f-20e6390f31f0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:51.490499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 200/397] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:51 2022] GET /identity/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:51.506682 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef005e-90aa-4b1f-a03f-20e6390f31f0 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:51.586513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb7af1f-a2be-46e3-a6b6-d0d1c1479ec5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:51.618613 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:51.634805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2534c-ed4a-4d10-8501-8fd1046ef4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:51.635834 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2534c-ed4a-4d10-8501-8fd1046ef4a4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:51.636330 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2534c-ed4a-4d10-8501-8fd1046ef4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:51.636804 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a2534c-ed4a-4d10-8501-8fd1046ef4a4 None admin] PATH_INFO: `/v3/groups/ef436473cb80410ab6201556c9b69448` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:51.638303 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2534c-ed4a-4d10-8501-8fd1046ef4a4 None admin] RBAC: Authorizing `identity:get_group(group_id=ef436473cb80410ab6201556c9b69448)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:51.644878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a2534c-ed4a-4d10-8501-8fd1046ef4a4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:51.644878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 198/398] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Sep 13 19:43:51 2022] GET /identity/v3/groups/ef436473cb80410ab6201556c9b69448 => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:51.650673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2534c-ed4a-4d10-8501-8fd1046ef4a4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:51.728140 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fef005e-90aa-4b1f-a03f-20e6390f31f0 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:51.768947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf858a5-9a16-460d-87eb-4db874bf53c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:51.770028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf858a5-9a16-460d-87eb-4db874bf53c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:51.770513 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf858a5-9a16-460d-87eb-4db874bf53c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:51.771007 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf858a5-9a16-460d-87eb-4db874bf53c6 None admin] PATH_INFO: `/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924/groups/ef436473cb80410ab6201556c9b69448/roles/d520f560be6d45539a966c6de2a934e7` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:51.773448 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf858a5-9a16-460d-87eb-4db874bf53c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=de921f56e9d94e6c9a4cd2ca6b60f924, group_id=ef436473cb80410ab6201556c9b69448, role_id=d520f560be6d45539a966c6de2a934e7)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:51.775874 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf858a5-9a16-460d-87eb-4db874bf53c6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:51.794920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a2534c-ed4a-4d10-8501-8fd1046ef4a4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:51.830894 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e01d6e3-5ef2-43f4-a410-3bc3e0a84e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:51.831523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01d6e3-5ef2-43f4-a410-3bc3e0a84e37 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:51.831794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01d6e3-5ef2-43f4-a410-3bc3e0a84e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:51.832085 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e01d6e3-5ef2-43f4-a410-3bc3e0a84e37 None admin] PATH_INFO: `/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:51.833216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01d6e3-5ef2-43f4-a410-3bc3e0a84e37 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb590e1a96a41bbbe00a0a9a82d9126)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:51.834734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e01d6e3-5ef2-43f4-a410-3bc3e0a84e37 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:51.836644 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 199/399] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:51 2022] GET /identity/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:51.837739 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9d6f2-9684-4f3c-a67c-5a211529f375 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:51.838027 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9d6f2-9684-4f3c-a67c-5a211529f375 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:51.838300 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9d6f2-9684-4f3c-a67c-5a211529f375 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:51.839654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 200/400] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:51.842806 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9d6f2-9684-4f3c-a67c-5a211529f375 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:51.855480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 201/401] 10.222.0.59 () {58 vars in 1442 bytes} [Tue Sep 13 19:43:51 2022] PUT /identity/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924/groups/ef436473cb80410ab6201556c9b69448/roles/d520f560be6d45539a966c6de2a934e7 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:43:51.856871 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6346b-5576-4291-81df-99abe98e365b None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:51.857242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6346b-5576-4291-81df-99abe98e365b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:51.857999 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba6346b-5576-4291-81df-99abe98e365b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:51.882830 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-bba6346b-5576-4291-81df-99abe98e365b None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:51.885094 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bba6346b-5576-4291-81df-99abe98e365b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:51.916083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:51.926427 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:51.966440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9d6f2-9684-4f3c-a67c-5a211529f375 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:51.977618 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 202/402] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:52.005328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0174c53-114c-4b09-a8db-481ad861bd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:52.006116 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0174c53-114c-4b09-a8db-481ad861bd44 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:52.006391 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0174c53-114c-4b09-a8db-481ad861bd44 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:52.006674 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0174c53-114c-4b09-a8db-481ad861bd44 None admin] PATH_INFO: `/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126/groups/ef436473cb80410ab6201556c9b69448/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:52.008682 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0174c53-114c-4b09-a8db-481ad861bd44 None admin] RBAC: Authorizing `identity:create_grant(project_id=dcb590e1a96a41bbbe00a0a9a82d9126, group_id=ef436473cb80410ab6201556c9b69448, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:52.010890 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0174c53-114c-4b09-a8db-481ad861bd44 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:52.112223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d7e53-75c1-4973-b227-9b40d3b4a1ec None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:52.112479 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d7e53-75c1-4973-b227-9b40d3b4a1ec None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:52.112695 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80d7e53-75c1-4973-b227-9b40d3b4a1ec None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:52.114332 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 203/403] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:43:52.119833 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe821d-59eb-4ee8-b0a1-a7d0a4cadeb5 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:52.120114 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe821d-59eb-4ee8-b0a1-a7d0a4cadeb5 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:52.120388 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fe821d-59eb-4ee8-b0a1-a7d0a4cadeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:52.133963 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 201/404] 10.222.0.59 () {58 vars in 1442 bytes} [Tue Sep 13 19:43:51 2022] PUT /identity/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126/groups/ef436473cb80410ab6201556c9b69448/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:43:52.147821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-c3fe821d-59eb-4ee8-b0a1-a7d0a4cadeb5 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:52.149167 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c3fe821d-59eb-4ee8-b0a1-a7d0a4cadeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:52.224573 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 204/405] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:43:52.280330 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0174c53-114c-4b09-a8db-481ad861bd44 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:52.421853 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0174c53-114c-4b09-a8db-481ad861bd44 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:52.443462 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:52.468763 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67d9e3-1f3a-4f55-88d8-c72b2f411643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:52.469824 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67d9e3-1f3a-4f55-88d8-c72b2f411643 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:52.470407 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67d9e3-1f3a-4f55-88d8-c72b2f411643 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:52.470884 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d67d9e3-1f3a-4f55-88d8-c72b2f411643 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:52.488538 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d67d9e3-1f3a-4f55-88d8-c72b2f411643 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:52.493976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-4d67d9e3-1f3a-4f55-88d8-c72b2f411643 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:52.493976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:52.493976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:52.493976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:52.493976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:52.493976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:52.493976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:52.493976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:52.493976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:52.493976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:52.493976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:52.493976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:52.493976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:52.493976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:52.493976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:52.493976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:52.494904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:52.494904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:52.494904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:52.494904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:52.494904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:52.494904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:52.494904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:52.494904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:52.494904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:52.494904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:52.494904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:52.494904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:52.494904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:52.494904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:52.494904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:52.494904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:52.495742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:52.495742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:52.495742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:52.495742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:52.495742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:52.495742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:52.495742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:52.495742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:52.495742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:52.495742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:52.495742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:52.495742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:43:52.502542 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 202/406] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Sep 13 19:43:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:52.505869 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe821d-59eb-4ee8-b0a1-a7d0a4cadeb5 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:52.527111 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67d9e3-1f3a-4f55-88d8-c72b2f411643 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:52.640131 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:52.644345 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fe821d-59eb-4ee8-b0a1-a7d0a4cadeb5 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:52.651457 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d67d9e3-1f3a-4f55-88d8-c72b2f411643 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:52.681341 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6dbe1-fffd-4cc6-a94a-d5c8c7df58c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:52.682460 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6dbe1-fffd-4cc6-a94a-d5c8c7df58c0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:52.682983 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6dbe1-fffd-4cc6-a94a-d5c8c7df58c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:52.683728 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6dbe1-fffd-4cc6-a94a-d5c8c7df58c0 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:52.685002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6dbe1-fffd-4cc6-a94a-d5c8c7df58c0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:52.685502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6dbe1-fffd-4cc6-a94a-d5c8c7df58c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:52.687366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6dbe1-fffd-4cc6-a94a-d5c8c7df58c0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:52.688205 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb03c5f-293f-40eb-9889-184a6d4d8c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:52.688923 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb03c5f-293f-40eb-9889-184a6d4d8c86 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:52.689354 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb03c5f-293f-40eb-9889-184a6d4d8c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:52.689603 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb03c5f-293f-40eb-9889-184a6d4d8c86 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:52.697101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 205/407] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:43:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:52.702765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6dbe1-fffd-4cc6-a94a-d5c8c7df58c0 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:52.703422 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb03c5f-293f-40eb-9889-184a6d4d8c86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:52.710004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-3eb03c5f-293f-40eb-9889-184a6d4d8c86 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:52.710004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:52.710004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:52.710004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:52.710004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:52.710004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:52.710004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:52.710004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:52.710004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:52.710004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:52.710004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:52.710004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:52.710004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:52.710004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:52.710004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:52.710004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:52.710897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:52.710897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:52.710897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:52.710897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:52.710897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:52.710897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:52.710897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:52.710897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:52.710897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:52.710897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:52.710897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:52.710897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:52.710897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:52.710897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:52.710897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:52.710897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:52.712245 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:52.712245 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:52.712245 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:52.712245 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:52.712245 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:52.712245 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:52.712245 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:52.712245 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:52.712245 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:52.712245 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:52.712245 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:52.712245 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:43:52.714832 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 203/408] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:43:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:43:52.720624 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb03c5f-293f-40eb-9889-184a6d4d8c86 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:52.758353 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:52.830717 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6dbe1-fffd-4cc6-a94a-d5c8c7df58c0 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:52.841603 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb03c5f-293f-40eb-9889-184a6d4d8c86 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:52.903503 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e75fc-4eff-43b6-b9a7-94e5addeec12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:52.904144 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e75fc-4eff-43b6-b9a7-94e5addeec12 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:52.905792 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e75fc-4eff-43b6-b9a7-94e5addeec12 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:52.906077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1e75fc-4eff-43b6-b9a7-94e5addeec12 None admin] PATH_INFO: `/v3/groups/ef436473cb80410ab6201556c9b69448` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:52.908571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e75fc-4eff-43b6-b9a7-94e5addeec12 None admin] RBAC: Authorizing `identity:get_group(group_id=ef436473cb80410ab6201556c9b69448)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:52.910457 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1e75fc-4eff-43b6-b9a7-94e5addeec12 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:52.912057 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 206/409] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Sep 13 19:43:52 2022] GET /identity/v3/groups/ef436473cb80410ab6201556c9b69448 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:52.918454 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e75fc-4eff-43b6-b9a7-94e5addeec12 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:52.922138 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba26c6b-25df-4985-a9de-0d9510fc18e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:52.922764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba26c6b-25df-4985-a9de-0d9510fc18e4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:52.923097 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba26c6b-25df-4985-a9de-0d9510fc18e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:52.923373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba26c6b-25df-4985-a9de-0d9510fc18e4 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:52.924055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba26c6b-25df-4985-a9de-0d9510fc18e4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:52.924361 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba26c6b-25df-4985-a9de-0d9510fc18e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:52.925781 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba26c6b-25df-4985-a9de-0d9510fc18e4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:52.944815 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 204/410] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:52.952273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba26c6b-25df-4985-a9de-0d9510fc18e4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:52.984592 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:53.126591 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1e75fc-4eff-43b6-b9a7-94e5addeec12 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:53.150931 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:53.163570 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba26c6b-25df-4985-a9de-0d9510fc18e4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:53.177446 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8adaac-0584-414b-82a8-edb7acf74cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:53.178653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8adaac-0584-414b-82a8-edb7acf74cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:53.179016 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8adaac-0584-414b-82a8-edb7acf74cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:53.179395 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8adaac-0584-414b-82a8-edb7acf74cf6 None admin] PATH_INFO: `/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:53.181143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8adaac-0584-414b-82a8-edb7acf74cf6 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb590e1a96a41bbbe00a0a9a82d9126)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:53.182687 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8adaac-0584-414b-82a8-edb7acf74cf6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:53.185349 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 207/411] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:52 2022] GET /identity/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126 => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:53.190567 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8adaac-0584-414b-82a8-edb7acf74cf6 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:53.262412 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72257394-bedf-4fbc-9444-bb0064497639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:53.263315 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72257394-bedf-4fbc-9444-bb0064497639 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:53.263741 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72257394-bedf-4fbc-9444-bb0064497639 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:53.264161 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72257394-bedf-4fbc-9444-bb0064497639 None admin] PATH_INFO: `/v3/groups/9baa280a8e9e4e4da59ef5a929717b65` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:53.265531 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72257394-bedf-4fbc-9444-bb0064497639 None admin] RBAC: Authorizing `identity:get_group(group_id=9baa280a8e9e4e4da59ef5a929717b65)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:53.267222 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72257394-bedf-4fbc-9444-bb0064497639 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:53.269273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 205/412] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Sep 13 19:43:52 2022] GET /identity/v3/groups/9baa280a8e9e4e4da59ef5a929717b65 => generated 229 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:53.275701 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72257394-bedf-4fbc-9444-bb0064497639 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:53.313875 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8adaac-0584-414b-82a8-edb7acf74cf6 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:53.326096 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:53.353421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3a7c10-1c50-43fb-b983-3ef793327f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:53.354166 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a7c10-1c50-43fb-b983-3ef793327f17 None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:53.354446 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a7c10-1c50-43fb-b983-3ef793327f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:53.354722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3a7c10-1c50-43fb-b983-3ef793327f17 None admin] PATH_INFO: `/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126/groups/ef436473cb80410ab6201556c9b69448/roles/d520f560be6d45539a966c6de2a934e7` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:53.357172 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a7c10-1c50-43fb-b983-3ef793327f17 None admin] RBAC: Authorizing `identity:create_grant(project_id=dcb590e1a96a41bbbe00a0a9a82d9126, group_id=ef436473cb80410ab6201556c9b69448, role_id=d520f560be6d45539a966c6de2a934e7)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:53.358687 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3a7c10-1c50-43fb-b983-3ef793327f17 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:53.440713 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 208/413] 10.222.0.59 () {58 vars in 1442 bytes} [Tue Sep 13 19:43:53 2022] PUT /identity/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126/groups/ef436473cb80410ab6201556c9b69448/roles/d520f560be6d45539a966c6de2a934e7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:43:53.441125 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72257394-bedf-4fbc-9444-bb0064497639 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:53.442028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5a758-d102-4697-98ee-2d6d0d5e86fd None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:53.442310 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5a758-d102-4697-98ee-2d6d0d5e86fd None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:53.442581 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b5a758-d102-4697-98ee-2d6d0d5e86fd None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:53.444098 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 209/414] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:53.452497 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51676a-6cf6-4fb1-8fbb-a9216a133138 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:53.452796 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51676a-6cf6-4fb1-8fbb-a9216a133138 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:53.453250 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed51676a-6cf6-4fb1-8fbb-a9216a133138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:53.485663 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-ed51676a-6cf6-4fb1-8fbb-a9216a133138 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:53.487793 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ed51676a-6cf6-4fb1-8fbb-a9216a133138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:53.490435 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373bb84-20b5-4819-802b-b569b2e8a536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:53.491124 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373bb84-20b5-4819-802b-b569b2e8a536 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:53.491471 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373bb84-20b5-4819-802b-b569b2e8a536 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:53.491828 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4373bb84-20b5-4819-802b-b569b2e8a536 None admin] PATH_INFO: `/v3/projects/a7c8626d92bb447c910575be75fc0558` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:53.494340 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373bb84-20b5-4819-802b-b569b2e8a536 None admin] RBAC: Authorizing `identity:get_project(project_id=a7c8626d92bb447c910575be75fc0558)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:53.495889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4373bb84-20b5-4819-802b-b569b2e8a536 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:53.498227 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 206/415] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:53 2022] GET /identity/v3/projects/a7c8626d92bb447c910575be75fc0558 => generated 344 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:53.505459 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373bb84-20b5-4819-802b-b569b2e8a536 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:53.546089 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:53.588717 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 210/416] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:53.647439 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4373bb84-20b5-4819-802b-b569b2e8a536 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:53.699475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb00928-dc9d-4719-b8a2-74d6e62e25c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:53.700132 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb00928-dc9d-4719-b8a2-74d6e62e25c4 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:53.700407 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb00928-dc9d-4719-b8a2-74d6e62e25c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:53.700676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb00928-dc9d-4719-b8a2-74d6e62e25c4 None admin] PATH_INFO: `/v3/projects/a7c8626d92bb447c910575be75fc0558/groups/9baa280a8e9e4e4da59ef5a929717b65/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:53.707371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb00928-dc9d-4719-b8a2-74d6e62e25c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=a7c8626d92bb447c910575be75fc0558, group_id=9baa280a8e9e4e4da59ef5a929717b65, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:53.708804 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb00928-dc9d-4719-b8a2-74d6e62e25c4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:53.814653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 207/417] 10.222.0.59 () {58 vars in 1442 bytes} [Tue Sep 13 19:43:53 2022] PUT /identity/v3/projects/a7c8626d92bb447c910575be75fc0558/groups/9baa280a8e9e4e4da59ef5a929717b65/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:43:53.983227 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51676a-6cf6-4fb1-8fbb-a9216a133138 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:54.078496 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:54.093925 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed51676a-6cf6-4fb1-8fbb-a9216a133138 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:54.132824 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8895ab6a-bfb9-4f0f-9491-abeac3f4efa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:54.133474 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895ab6a-bfb9-4f0f-9491-abeac3f4efa5 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:54.133838 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895ab6a-bfb9-4f0f-9491-abeac3f4efa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:54.134364 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8895ab6a-bfb9-4f0f-9491-abeac3f4efa5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:54.144712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8895ab6a-bfb9-4f0f-9491-abeac3f4efa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:54.150291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-8895ab6a-bfb9-4f0f-9491-abeac3f4efa5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:54.150291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:54.150291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:54.150291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:54.150291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:54.150291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:54.150291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:54.150291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:54.150291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:54.150291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:54.150291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:54.150291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:54.150291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:54.150291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:54.150291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:54.150291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:54.151242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:54.151242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:54.151242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:54.151242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:54.151242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:54.151242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:54.151242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:54.151242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:54.151242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:54.151242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:54.151242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:54.151242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:54.151242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:54.151242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:54.151242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:54.151242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:54.152060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:54.152060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:54.152060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:54.152060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:54.152060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:54.152060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:54.152060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:54.152060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:54.152060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:54.152060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:54.152060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:54.152060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:43:54.152060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 211/418] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:54.157658 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb00928-dc9d-4719-b8a2-74d6e62e25c4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:54.299681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:54.308502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb00928-dc9d-4719-b8a2-74d6e62e25c4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:54.323239 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b986053-9ed7-4add-9cb9-2f63199e89a9 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:54.323526 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b986053-9ed7-4add-9cb9-2f63199e89a9 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:54.323808 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b986053-9ed7-4add-9cb9-2f63199e89a9 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:54.325156 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 212/419] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:54.343568 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb39960-4ef2-4bc5-8d78-afee5a718b4c None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:54.344220 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb39960-4ef2-4bc5-8d78-afee5a718b4c None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:54.344707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb39960-4ef2-4bc5-8d78-afee5a718b4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:54.359734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a1c06-0526-446a-bc12-b3ffbf81a2c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:54.360365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a1c06-0526-446a-bc12-b3ffbf81a2c8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:54.360652 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a1c06-0526-446a-bc12-b3ffbf81a2c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:54.360921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a1c06-0526-446a-bc12-b3ffbf81a2c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:54.361599 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a1c06-0526-446a-bc12-b3ffbf81a2c8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:54.361934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a1c06-0526-446a-bc12-b3ffbf81a2c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:54.363311 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673a1c06-0526-446a-bc12-b3ffbf81a2c8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:54.366324 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-0bb39960-4ef2-4bc5-8d78-afee5a718b4c None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:54.367822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0bb39960-4ef2-4bc5-8d78-afee5a718b4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:54.372952 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 208/420] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:54.382944 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a1c06-0526-446a-bc12-b3ffbf81a2c8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:54.474159 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 213/421] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:54.555863 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a1c06-0526-446a-bc12-b3ffbf81a2c8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:54.592125 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc57c97-4b84-4b8a-9f45-7facdc710660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:54.592728 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc57c97-4b84-4b8a-9f45-7facdc710660 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:54.593055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc57c97-4b84-4b8a-9f45-7facdc710660 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:54.593330 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc57c97-4b84-4b8a-9f45-7facdc710660 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:54.619595 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:54.663143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc57c97-4b84-4b8a-9f45-7facdc710660 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:54.664686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc57c97-4b84-4b8a-9f45-7facdc710660 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:54.768722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 209/422] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:54.774326 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb39960-4ef2-4bc5-8d78-afee5a718b4c None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:54.783821 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc57c97-4b84-4b8a-9f45-7facdc710660 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:54.911603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:54.912348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:54.959903 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb39960-4ef2-4bc5-8d78-afee5a718b4c None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:54.998646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc57c97-4b84-4b8a-9f45-7facdc710660 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:55.022479 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f386206-1d83-4d4b-b362-194bdb192408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:55.023218 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f386206-1d83-4d4b-b362-194bdb192408 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:55.023504 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f386206-1d83-4d4b-b362-194bdb192408 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:55.023878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f386206-1d83-4d4b-b362-194bdb192408 None admin] PATH_INFO: `/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:55.025041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f386206-1d83-4d4b-b362-194bdb192408 None admin] RBAC: Authorizing `identity:get_project(project_id=de921f56e9d94e6c9a4cd2ca6b60f924)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:55.026509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f386206-1d83-4d4b-b362-194bdb192408 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:55.028545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 214/423] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:54 2022] GET /identity/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924 => generated 298 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:55.029972 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadac0a5-8f89-45b0-bac8-037235d68a82 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:55.030316 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadac0a5-8f89-45b0-bac8-037235d68a82 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:55.030596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadac0a5-8f89-45b0-bac8-037235d68a82 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:55.032071 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 215/424] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:55.034891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadac0a5-8f89-45b0-bac8-037235d68a82 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:55.046007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3a5b46-c30a-41a8-af03-64c69967b15b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:55.046636 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a5b46-c30a-41a8-af03-64c69967b15b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:55.046910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a5b46-c30a-41a8-af03-64c69967b15b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:55.047179 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3a5b46-c30a-41a8-af03-64c69967b15b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:55.062594 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3a5b46-c30a-41a8-af03-64c69967b15b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:55.067969 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-8b3a5b46-c30a-41a8-af03-64c69967b15b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:55.067969 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:55.067969 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:55.067969 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:55.067969 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:55.067969 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:55.067969 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:55.067969 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:55.067969 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:55.067969 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:55.067969 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:55.067969 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:55.067969 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:55.067969 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:55.067969 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:55.067969 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:55.069055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:55.069055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:55.069055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:55.069055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:55.069055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:55.069055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:55.069055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:55.069055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:55.069055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:55.069055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:55.069055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:55.069055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:55.069055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:55.069055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:55.069055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:55.069055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:55.071088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:55.071088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:55.071088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:55.071088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:55.071088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:55.071088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:55.071088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:55.071088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:55.071088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:55.071088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:55.071088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:55.071088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:43:55.071088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 210/425] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Sep 13 19:43:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:55.073044 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fc29a-950d-429e-a865-56eb87440928 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:55.073044 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fc29a-950d-429e-a865-56eb87440928 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:55.073044 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360fc29a-950d-429e-a865-56eb87440928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:55.094800 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-360fc29a-950d-429e-a865-56eb87440928 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:55.096093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-360fc29a-950d-429e-a865-56eb87440928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:55.145904 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadac0a5-8f89-45b0-bac8-037235d68a82 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:55.183942 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe912a-abe9-4b86-ab66-844d0bb24447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:55.184572 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe912a-abe9-4b86-ab66-844d0bb24447 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:55.184844 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe912a-abe9-4b86-ab66-844d0bb24447 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:55.185114 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe912a-abe9-4b86-ab66-844d0bb24447 None admin] PATH_INFO: `/v3/groups/ef436473cb80410ab6201556c9b69448` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:55.186126 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 211/426] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:55.186631 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe912a-abe9-4b86-ab66-844d0bb24447 None admin] RBAC: Authorizing `identity:get_group(group_id=ef436473cb80410ab6201556c9b69448)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:55.186981 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fc29a-950d-429e-a865-56eb87440928 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:55.187727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffe912a-abe9-4b86-ab66-844d0bb24447 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:55.189581 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 216/427] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Sep 13 19:43:55 2022] GET /identity/v3/groups/ef436473cb80410ab6201556c9b69448 => generated 226 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:55.198676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe912a-abe9-4b86-ab66-844d0bb24447 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:55.233442 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:55.278033 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:55.359975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe912a-abe9-4b86-ab66-844d0bb24447 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:55.395327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c9731-4536-4511-95a5-dcde272ad4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:55.395992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c9731-4536-4511-95a5-dcde272ad4d0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:55.396212 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c9731-4536-4511-95a5-dcde272ad4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:55.396482 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c9731-4536-4511-95a5-dcde272ad4d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:55.397203 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c9731-4536-4511-95a5-dcde272ad4d0 None admin] RBAC: Adding query filter params (group.id=ef436473cb80410ab6201556c9b69448, role.id=033268df62114ee6bf4c0512568f2609, scope.project.id=de921f56e9d94e6c9a4cd2ca6b60f924) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:55.397530 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c9731-4536-4511-95a5-dcde272ad4d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:55.399495 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306c9731-4536-4511-95a5-dcde272ad4d0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:55.400316 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360fc29a-950d-429e-a865-56eb87440928 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:55.405726 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 217/428] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Sep 13 19:43:55 2022] GET /identity/v3/role_assignments?group.id=ef436473cb80410ab6201556c9b69448&scope.project.id=de921f56e9d94e6c9a4cd2ca6b60f924&role.id=033268df62114ee6bf4c0512568f2609 => generated 611 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:55.475604 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bb724-1ef8-485c-a8f7-3f6bdd57bb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:55.476236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bb724-1ef8-485c-a8f7-3f6bdd57bb2f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:55.476512 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bb724-1ef8-485c-a8f7-3f6bdd57bb2f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:55.476838 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2bb724-1ef8-485c-a8f7-3f6bdd57bb2f None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:55.478164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2bb724-1ef8-485c-a8f7-3f6bdd57bb2f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:55.478468 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2bb724-1ef8-485c-a8f7-3f6bdd57bb2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:55.479883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2bb724-1ef8-485c-a8f7-3f6bdd57bb2f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:55.494255 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 212/429] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:43:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:55.499913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c9731-4536-4511-95a5-dcde272ad4d0 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:55.508297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bb724-1ef8-485c-a8f7-3f6bdd57bb2f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:55.613003 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:55.621777 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306c9731-4536-4511-95a5-dcde272ad4d0 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:55.665747 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f98117-fda8-43d2-83c0-dc18399263ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:55.665747 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f98117-fda8-43d2-83c0-dc18399263ef None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:55.666007 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f98117-fda8-43d2-83c0-dc18399263ef None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:55.666238 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f98117-fda8-43d2-83c0-dc18399263ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:55.666917 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2bb724-1ef8-485c-a8f7-3f6bdd57bb2f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:55.677331 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:55.714540 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8fb58-fe62-47fa-9ec0-2881fca87be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:55.715223 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8fb58-fe62-47fa-9ec0-2881fca87be0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:55.715503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8fb58-fe62-47fa-9ec0-2881fca87be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:55.716128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8fb58-fe62-47fa-9ec0-2881fca87be0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:55.731792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8fb58-fe62-47fa-9ec0-2881fca87be0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:55.745540 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-8ba8fb58-fe62-47fa-9ec0-2881fca87be0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:55.745540 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:55.745540 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:55.745540 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:55.745540 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:55.745540 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:55.745540 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:55.745540 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:55.745540 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:55.745540 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:55.745540 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:55.745540 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:55.745540 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:55.745540 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:55.745540 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:55.745540 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:55.746535 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:55.746535 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:55.746535 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:55.746535 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:55.746535 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:55.746535 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:55.746535 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:55.746535 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:55.746535 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:55.746535 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:55.746535 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:55.746535 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:55.746535 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:55.746535 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:55.746535 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:55.746535 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:55.747372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:55.747372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:55.747372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:55.747372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:55.747372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:55.747372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:55.747372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:55.747372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:55.747372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:55.747372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:55.747372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 13 19:43:55.747372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:43:55.747372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 213/430] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:55.749717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8fb58-fe62-47fa-9ec0-2881fca87be0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:55.767390 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f98117-fda8-43d2-83c0-dc18399263ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:55.769510 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f98117-fda8-43d2-83c0-dc18399263ef None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:55.872041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:55.903434 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8fb58-fe62-47fa-9ec0-2881fca87be0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:55.912659 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 218/431] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:55.920743 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f98117-fda8-43d2-83c0-dc18399263ef None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:55.948699 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200afbe7-7a91-49e0-90b9-eaed31331384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:55.949554 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200afbe7-7a91-49e0-90b9-eaed31331384 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:55.950007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200afbe7-7a91-49e0-90b9-eaed31331384 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:55.950456 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200afbe7-7a91-49e0-90b9-eaed31331384 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:55.951280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200afbe7-7a91-49e0-90b9-eaed31331384 None admin] RBAC: Adding query filter params (name=member) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:55.951699 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200afbe7-7a91-49e0-90b9-eaed31331384 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:55.953103 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200afbe7-7a91-49e0-90b9-eaed31331384 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:55.966909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 214/432] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:43:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:55.974935 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200afbe7-7a91-49e0-90b9-eaed31331384 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:56.018786 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:56.055061 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f98117-fda8-43d2-83c0-dc18399263ef None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:56.096678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd482cdb-c48a-4cf2-aa70-bec7514aa1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:56.097802 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd482cdb-c48a-4cf2-aa70-bec7514aa1de None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:56.098535 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd482cdb-c48a-4cf2-aa70-bec7514aa1de None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:56.099077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd482cdb-c48a-4cf2-aa70-bec7514aa1de None admin] PATH_INFO: `/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:56.100457 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd482cdb-c48a-4cf2-aa70-bec7514aa1de None admin] RBAC: Authorizing `identity:get_project(project_id=de921f56e9d94e6c9a4cd2ca6b60f924)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:56.103181 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd482cdb-c48a-4cf2-aa70-bec7514aa1de None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:56.105539 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 219/433] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:55 2022] GET /identity/v3/projects/de921f56e9d94e6c9a4cd2ca6b60f924 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:56.111131 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd482cdb-c48a-4cf2-aa70-bec7514aa1de None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:56.125375 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200afbe7-7a91-49e0-90b9-eaed31331384 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:56.164380 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:56.175828 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6301d86-c487-41c5-8df6-dad342be4c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:56.175828 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6301d86-c487-41c5-8df6-dad342be4c2b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:56.175828 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6301d86-c487-41c5-8df6-dad342be4c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:56.175828 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6301d86-c487-41c5-8df6-dad342be4c2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:56.234528 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd482cdb-c48a-4cf2-aa70-bec7514aa1de None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:56.264494 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6301d86-c487-41c5-8df6-dad342be4c2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:56.266444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6301d86-c487-41c5-8df6-dad342be4c2b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:56.271421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cbb3710-4ba6-4735-9970-c3bd44a6bb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:56.278013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb3710-4ba6-4735-9970-c3bd44a6bb35 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:56.278013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb3710-4ba6-4735-9970-c3bd44a6bb35 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:56.278013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb3710-4ba6-4735-9970-c3bd44a6bb35 None admin] PATH_INFO: `/v3/groups/ef436473cb80410ab6201556c9b69448` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:56.278013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb3710-4ba6-4735-9970-c3bd44a6bb35 None admin] RBAC: Authorizing `identity:get_group(group_id=ef436473cb80410ab6201556c9b69448)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:56.278013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cbb3710-4ba6-4735-9970-c3bd44a6bb35 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:56.278013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 220/434] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Sep 13 19:43:56 2022] GET /identity/v3/groups/ef436473cb80410ab6201556c9b69448 => generated 226 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:56.278613 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bd7f3-00b5-496f-8b07-04d347334120 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:56.278613 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bd7f3-00b5-496f-8b07-04d347334120 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:56.278867 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97bd7f3-00b5-496f-8b07-04d347334120 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:56.280344 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 221/435] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:43:56.282754 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bd7f3-00b5-496f-8b07-04d347334120 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:56.302496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:56.377174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 215/436] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:56.378803 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf9929-f4b0-43ce-bb02-e91fe4752a8b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:56.379155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf9929-f4b0-43ce-bb02-e91fe4752a8b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:56.379497 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cf9929-f4b0-43ce-bb02-e91fe4752a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:56.397677 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-83cf9929-f4b0-43ce-bb02-e91fe4752a8b None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:56.399520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97bd7f3-00b5-496f-8b07-04d347334120 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:56.399650 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-83cf9929-f4b0-43ce-bb02-e91fe4752a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:56.415670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:56.438026 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291a464-f9eb-41cd-9644-71db3fcc9e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:56.438761 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291a464-f9eb-41cd-9644-71db3fcc9e7c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:56.439245 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291a464-f9eb-41cd-9644-71db3fcc9e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:56.439679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291a464-f9eb-41cd-9644-71db3fcc9e7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:56.441008 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291a464-f9eb-41cd-9644-71db3fcc9e7c None admin] RBAC: Adding query filter params (group.id=ef436473cb80410ab6201556c9b69448, role.id=d520f560be6d45539a966c6de2a934e7, scope.project.id=de921f56e9d94e6c9a4cd2ca6b60f924) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:56.441498 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291a464-f9eb-41cd-9644-71db3fcc9e7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:56.443465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b291a464-f9eb-41cd-9644-71db3fcc9e7c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:56.451359 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 222/437] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Sep 13 19:43:56 2022] GET /identity/v3/role_assignments?group.id=ef436473cb80410ab6201556c9b69448&scope.project.id=de921f56e9d94e6c9a4cd2ca6b60f924&role.id=d520f560be6d45539a966c6de2a934e7 => generated 611 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:56.452483 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291a464-f9eb-41cd-9644-71db3fcc9e7c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:56.494339 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 216/438] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:43:56.592143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291a464-f9eb-41cd-9644-71db3fcc9e7c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:56.592577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f44c0-6a34-4b89-9199-7af69d8acbdf None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:56.592865 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f44c0-6a34-4b89-9199-7af69d8acbdf None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:56.593138 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24f44c0-6a34-4b89-9199-7af69d8acbdf None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:56.594797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 217/439] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:43:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:43:56.600164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daed23-57e1-49b5-97ab-8a48126f59c3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:56.600456 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daed23-57e1-49b5-97ab-8a48126f59c3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:56.600711 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9daed23-57e1-49b5-97ab-8a48126f59c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:56.624227 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b9daed23-57e1-49b5-97ab-8a48126f59c3 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:43:56.625612 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b9daed23-57e1-49b5-97ab-8a48126f59c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:43:56.632033 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63bf3d-4d1d-4ce6-99b8-929dd17ad661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:56.632689 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63bf3d-4d1d-4ce6-99b8-929dd17ad661 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:56.632972 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63bf3d-4d1d-4ce6-99b8-929dd17ad661 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:56.634064 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63bf3d-4d1d-4ce6-99b8-929dd17ad661 None admin] PATH_INFO: `/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:56.635260 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63bf3d-4d1d-4ce6-99b8-929dd17ad661 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb590e1a96a41bbbe00a0a9a82d9126)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:56.637426 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63bf3d-4d1d-4ce6-99b8-929dd17ad661 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:56.640116 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 223/440] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:56 2022] GET /identity/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:56.645230 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63bf3d-4d1d-4ce6-99b8-929dd17ad661 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:56.695451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:56.696868 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:56.708455 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 218/441] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:43:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:43:56.759888 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63bf3d-4d1d-4ce6-99b8-929dd17ad661 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:56.780816 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9daed23-57e1-49b5-97ab-8a48126f59c3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:56.796976 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3176f-4a00-4793-9e48-22b04269ea76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:56.797625 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3176f-4a00-4793-9e48-22b04269ea76 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:56.797933 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3176f-4a00-4793-9e48-22b04269ea76 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:56.798192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f3176f-4a00-4793-9e48-22b04269ea76 None admin] PATH_INFO: `/v3/groups/ef436473cb80410ab6201556c9b69448` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:56.799325 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3176f-4a00-4793-9e48-22b04269ea76 None admin] RBAC: Authorizing `identity:get_group(group_id=ef436473cb80410ab6201556c9b69448)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:56.800916 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f3176f-4a00-4793-9e48-22b04269ea76 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:56.802828 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 224/442] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Sep 13 19:43:56 2022] GET /identity/v3/groups/ef436473cb80410ab6201556c9b69448 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:56.808476 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3176f-4a00-4793-9e48-22b04269ea76 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:56.924829 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9daed23-57e1-49b5-97ab-8a48126f59c3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:56.936280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f3176f-4a00-4793-9e48-22b04269ea76 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:56.951406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:56.974230 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7673a-18ee-4d74-9de1-7d9abc368185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:56.974859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7673a-18ee-4d74-9de1-7d9abc368185 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:56.975134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7673a-18ee-4d74-9de1-7d9abc368185 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:56.975479 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f7673a-18ee-4d74-9de1-7d9abc368185 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:56.981782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2c359-222e-423f-8b1f-5c96a7580bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:56.982477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2c359-222e-423f-8b1f-5c96a7580bc4 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:56.982766 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2c359-222e-423f-8b1f-5c96a7580bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:56.983024 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd2c359-222e-423f-8b1f-5c96a7580bc4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:56.983818 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2c359-222e-423f-8b1f-5c96a7580bc4 None admin] RBAC: Adding query filter params (group.id=ef436473cb80410ab6201556c9b69448, role.id=033268df62114ee6bf4c0512568f2609, scope.project.id=dcb590e1a96a41bbbe00a0a9a82d9126) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:56.984129 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2c359-222e-423f-8b1f-5c96a7580bc4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:56.985997 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd2c359-222e-423f-8b1f-5c96a7580bc4 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:56.990660 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f7673a-18ee-4d74-9de1-7d9abc368185 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:56.993934 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 225/443] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Sep 13 19:43:56 2022] GET /identity/v3/role_assignments?group.id=ef436473cb80410ab6201556c9b69448&scope.project.id=dcb590e1a96a41bbbe00a0a9a82d9126&role.id=033268df62114ee6bf4c0512568f2609 => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:56.994868 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2c359-222e-423f-8b1f-5c96a7580bc4 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:56.996216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-67f7673a-18ee-4d74-9de1-7d9abc368185 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:56.996216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:56.996216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:56.996216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:56.996216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:56.996216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:56.996216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:56.996216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:56.996216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:56.996216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:56.996216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:56.996216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:56.996216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:56.996216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:56.996216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:56.996216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:56.997164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:56.997164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:56.997164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:56.997164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:56.997164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:56.997164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:56.997164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:56.997164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:56.997164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:56.997164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:56.997164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:56.997164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:56.997164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:56.997164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:56.997164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:56.997164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:56.998022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:56.998022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:56.998022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:56.998022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:56.998022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:56.998022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:56.998022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:56.998022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:56.998022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:56.998022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:56.998022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:43:56.998022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:43:56.998022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 219/444] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Sep 13 19:43:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:43:57.004356 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7673a-18ee-4d74-9de1-7d9abc368185 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:57.062332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:57.118152 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd2c359-222e-423f-8b1f-5c96a7580bc4 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:57.118863 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f7673a-18ee-4d74-9de1-7d9abc368185 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:57.158189 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912aa7d-4191-4701-9194-d011e71e60dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:57.159125 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912aa7d-4191-4701-9194-d011e71e60dd None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:57.159555 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912aa7d-4191-4701-9194-d011e71e60dd None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:57.159976 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0912aa7d-4191-4701-9194-d011e71e60dd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:57.161534 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79cea4-8214-4d46-bf1c-7e95a6286510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:57.162159 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79cea4-8214-4d46-bf1c-7e95a6286510 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:57.162437 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79cea4-8214-4d46-bf1c-7e95a6286510 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:57.162701 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d79cea4-8214-4d46-bf1c-7e95a6286510 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:57.163385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79cea4-8214-4d46-bf1c-7e95a6286510 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:57.163689 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79cea4-8214-4d46-bf1c-7e95a6286510 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:57.165113 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d79cea4-8214-4d46-bf1c-7e95a6286510 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:57.172882 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0912aa7d-4191-4701-9194-d011e71e60dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:43:57.175493 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 220/445] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:43:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:57.178722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-0912aa7d-4191-4701-9194-d011e71e60dd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:57.178722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:43:57.178722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:43:57.178722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:43:57.178722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:43:57.178722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:43:57.178722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:43:57.178722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:43:57.178722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:43:57.178722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:43:57.178722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:43:57.178722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:43:57.178722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:43:57.178722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:43:57.178722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:43:57.178722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:43:57.179620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:43:57.179620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:43:57.179620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:43:57.179620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:43:57.179620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:43:57.179620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:43:57.179620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:43:57.179620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:43:57.179620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:43:57.179620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:43:57.179620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:43:57.179620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:43:57.179620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:43:57.179620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:43:57.179620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:43:57.179620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:43:57.181643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:43:57.181643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:43:57.181643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:43:57.181643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:43:57.181643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:43:57.181643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:43:57.181643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:43:57.181643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:43:57.181643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:43:57.181643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:43:57.181643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:43:57.181643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:43:57.181643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 226/446] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:43:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:43:57.182399 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79cea4-8214-4d46-bf1c-7e95a6286510 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:57.186069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912aa7d-4191-4701-9194-d011e71e60dd None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:57.223452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:57.300999 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0912aa7d-4191-4701-9194-d011e71e60dd None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:57.304438 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d79cea4-8214-4d46-bf1c-7e95a6286510 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:57.318542 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:57.343355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b807ae-1ece-49bf-88d8-fc63f00062f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:57.343869 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada0526-d933-4b53-9ac4-cb754375eea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:57.344309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b807ae-1ece-49bf-88d8-fc63f00062f4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:57.344489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada0526-d933-4b53-9ac4-cb754375eea1 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:57.344605 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b807ae-1ece-49bf-88d8-fc63f00062f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:57.344818 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada0526-d933-4b53-9ac4-cb754375eea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:57.344914 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b807ae-1ece-49bf-88d8-fc63f00062f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:57.345073 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ada0526-d933-4b53-9ac4-cb754375eea1 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:57.345684 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada0526-d933-4b53-9ac4-cb754375eea1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:57.347059 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada0526-d933-4b53-9ac4-cb754375eea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:57.348443 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ada0526-d933-4b53-9ac4-cb754375eea1 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:57.358948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 227/447] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:43:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:57.364818 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada0526-d933-4b53-9ac4-cb754375eea1 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:57.422159 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b807ae-1ece-49bf-88d8-fc63f00062f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:57.423617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b807ae-1ece-49bf-88d8-fc63f00062f4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:57.465356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:57.469435 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ada0526-d933-4b53-9ac4-cb754375eea1 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:57.503689 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891953e5-7a45-44a1-85c2-0ec084966897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:57.504382 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891953e5-7a45-44a1-85c2-0ec084966897 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:57.504672 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891953e5-7a45-44a1-85c2-0ec084966897 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:57.504952 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891953e5-7a45-44a1-85c2-0ec084966897 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:57.522287 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 221/448] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:43:57.527686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b807ae-1ece-49bf-88d8-fc63f00062f4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:57.541195 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:57.571629 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891953e5-7a45-44a1-85c2-0ec084966897 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:57.573161 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-891953e5-7a45-44a1-85c2-0ec084966897 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:57.623061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b807ae-1ece-49bf-88d8-fc63f00062f4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:57.656186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118123f-3cf3-46f8-94e4-386ceef0c381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:57.656802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118123f-3cf3-46f8-94e4-386ceef0c381 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:57.657082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118123f-3cf3-46f8-94e4-386ceef0c381 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:57.657354 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118123f-3cf3-46f8-94e4-386ceef0c381 None admin] PATH_INFO: `/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:57.658490 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118123f-3cf3-46f8-94e4-386ceef0c381 None admin] RBAC: Authorizing `identity:get_project(project_id=dcb590e1a96a41bbbe00a0a9a82d9126)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:57.659929 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118123f-3cf3-46f8-94e4-386ceef0c381 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:57.661533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 222/449] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:57 2022] GET /identity/v3/projects/dcb590e1a96a41bbbe00a0a9a82d9126 => generated 302 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:57.666662 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:57.667663 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118123f-3cf3-46f8-94e4-386ceef0c381 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:57.671163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 228/450] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:43:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:43:57.676602 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891953e5-7a45-44a1-85c2-0ec084966897 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:57.745395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:57.764003 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118123f-3cf3-46f8-94e4-386ceef0c381 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:57.772138 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891953e5-7a45-44a1-85c2-0ec084966897 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:57.798898 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351b3f9-e7d2-434d-883d-c58fd176e92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:57.799503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351b3f9-e7d2-434d-883d-c58fd176e92c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:57.799776 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351b3f9-e7d2-434d-883d-c58fd176e92c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:57.800040 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c351b3f9-e7d2-434d-883d-c58fd176e92c None admin] PATH_INFO: `/v3/groups/ef436473cb80410ab6201556c9b69448` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:57.801125 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351b3f9-e7d2-434d-883d-c58fd176e92c None admin] RBAC: Authorizing `identity:get_group(group_id=ef436473cb80410ab6201556c9b69448)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:57.802595 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c351b3f9-e7d2-434d-883d-c58fd176e92c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:57.804132 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 223/451] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Sep 13 19:43:57 2022] GET /identity/v3/groups/ef436473cb80410ab6201556c9b69448 => generated 226 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:43:57.806132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c06da-4843-4b7a-9b11-fc9e5d7f7867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:57.806756 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c06da-4843-4b7a-9b11-fc9e5d7f7867 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:57.807032 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c06da-4843-4b7a-9b11-fc9e5d7f7867 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:57.807312 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18c06da-4843-4b7a-9b11-fc9e5d7f7867 None admin] PATH_INFO: `/v3/projects/a7c8626d92bb447c910575be75fc0558` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:57.808395 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c06da-4843-4b7a-9b11-fc9e5d7f7867 None admin] RBAC: Authorizing `identity:get_project(project_id=a7c8626d92bb447c910575be75fc0558)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:57.809855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351b3f9-e7d2-434d-883d-c58fd176e92c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:57.810100 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18c06da-4843-4b7a-9b11-fc9e5d7f7867 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:57.816033 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 229/452] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:43:57 2022] GET /identity/v3/projects/a7c8626d92bb447c910575be75fc0558 => generated 344 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:57.816941 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c06da-4843-4b7a-9b11-fc9e5d7f7867 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:57.884611 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:57.906486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c351b3f9-e7d2-434d-883d-c58fd176e92c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:57.920039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18c06da-4843-4b7a-9b11-fc9e5d7f7867 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:57.939276 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf12af4-7b09-4d6e-8cba-0e3f3dabb685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:57.939862 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf12af4-7b09-4d6e-8cba-0e3f3dabb685 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:57.940137 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf12af4-7b09-4d6e-8cba-0e3f3dabb685 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:57.940400 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf12af4-7b09-4d6e-8cba-0e3f3dabb685 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:57.941108 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf12af4-7b09-4d6e-8cba-0e3f3dabb685 None admin] RBAC: Adding query filter params (group.id=ef436473cb80410ab6201556c9b69448, role.id=d520f560be6d45539a966c6de2a934e7, scope.project.id=dcb590e1a96a41bbbe00a0a9a82d9126) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:57.941408 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf12af4-7b09-4d6e-8cba-0e3f3dabb685 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:57.942843 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf12af4-7b09-4d6e-8cba-0e3f3dabb685 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:57.948311 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 224/453] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Sep 13 19:43:57 2022] GET /identity/v3/role_assignments?group.id=ef436473cb80410ab6201556c9b69448&scope.project.id=dcb590e1a96a41bbbe00a0a9a82d9126&role.id=d520f560be6d45539a966c6de2a934e7 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:57.953113 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ceb000-383b-4e80-b4b9-2bd19f6e023e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:57.953874 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ceb000-383b-4e80-b4b9-2bd19f6e023e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:57.954220 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ceb000-383b-4e80-b4b9-2bd19f6e023e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:57.954555 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ceb000-383b-4e80-b4b9-2bd19f6e023e None admin] PATH_INFO: `/v3/groups/9baa280a8e9e4e4da59ef5a929717b65` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:57.955796 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ceb000-383b-4e80-b4b9-2bd19f6e023e None admin] RBAC: Authorizing `identity:get_group(group_id=9baa280a8e9e4e4da59ef5a929717b65)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:57.957308 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ceb000-383b-4e80-b4b9-2bd19f6e023e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:57.958989 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 230/454] 10.222.0.59 () {56 vars in 1180 bytes} [Tue Sep 13 19:43:57 2022] GET /identity/v3/groups/9baa280a8e9e4e4da59ef5a929717b65 => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:43:57.965770 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf12af4-7b09-4d6e-8cba-0e3f3dabb685 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:43:57.982791 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:43:58.072645 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf12af4-7b09-4d6e-8cba-0e3f3dabb685 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:43:58.107110 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7206e229-1630-43d4-9931-134da6bc2c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:43:58.107710 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206e229-1630-43d4-9931-134da6bc2c8c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:43:58.107992 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206e229-1630-43d4-9931-134da6bc2c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:43:58.108262 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7206e229-1630-43d4-9931-134da6bc2c8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:43:58.108993 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206e229-1630-43d4-9931-134da6bc2c8c None admin] RBAC: Adding query filter params (group.id=9baa280a8e9e4e4da59ef5a929717b65, role.id=cd02ef2043de492a8bff6c165485f255, scope.project.id=a7c8626d92bb447c910575be75fc0558) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:43:58.109307 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206e229-1630-43d4-9931-134da6bc2c8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:43:58.110771 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7206e229-1630-43d4-9931-134da6bc2c8c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:43:58.117234 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 225/455] 10.222.0.59 () {56 vars in 1376 bytes} [Tue Sep 13 19:43:57 2022] GET /identity/v3/role_assignments?group.id=9baa280a8e9e4e4da59ef5a929717b65&scope.project.id=a7c8626d92bb447c910575be75fc0558&role.id=cd02ef2043de492a8bff6c165485f255 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:00.905618 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033ab36-f68f-4870-8a08-4031b630e617 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:00.906118 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033ab36-f68f-4870-8a08-4031b630e617 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:00.906194 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033ab36-f68f-4870-8a08-4031b630e617 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:00.907734 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 231/456] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:00.913427 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f60a9-b87c-41ad-923b-6e25be5a1eca None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:00.913921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f60a9-b87c-41ad-923b-6e25be5a1eca None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:00.914101 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f60a9-b87c-41ad-923b-6e25be5a1eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:00.942742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ed3f60a9-b87c-41ad-923b-6e25be5a1eca None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:00.943946 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ed3f60a9-b87c-41ad-923b-6e25be5a1eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:00.957334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a820bb-0abc-43ec-b2b5-25b6ef723398 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:00.957617 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a820bb-0abc-43ec-b2b5-25b6ef723398 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:00.958219 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a820bb-0abc-43ec-b2b5-25b6ef723398 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:00.959787 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 232/457] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:00.978009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5a4da-9898-4c05-8d47-5a43fec3c7c5 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:00.978291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5a4da-9898-4c05-8d47-5a43fec3c7c5 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:00.978563 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb5a4da-9898-4c05-8d47-5a43fec3c7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:01.010722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-9fb5a4da-9898-4c05-8d47-5a43fec3c7c5 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:01.011903 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9fb5a4da-9898-4c05-8d47-5a43fec3c7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:01.051209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 226/458] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:01.110451 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 233/459] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:44:01.295750 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc90e9b-c111-4d9b-8208-e8115a32f439 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:01.296120 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc90e9b-c111-4d9b-8208-e8115a32f439 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:01.296299 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc90e9b-c111-4d9b-8208-e8115a32f439 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:01.297892 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 227/460] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:01.310962 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bdc90-92a2-4767-83aa-1a11d84ff02b None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:01.311243 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bdc90-92a2-4767-83aa-1a11d84ff02b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:01.311514 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529bdc90-92a2-4767-83aa-1a11d84ff02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:01.338707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-529bdc90-92a2-4767-83aa-1a11d84ff02b None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:01.339897 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-529bdc90-92a2-4767-83aa-1a11d84ff02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:01.415293 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:01.424380 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 234/461] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:01.434283 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc90e9b-c111-4d9b-8208-e8115a32f439 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:01.443214 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:01.512242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bdc90-92a2-4767-83aa-1a11d84ff02b None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:01.584302 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc90e9b-c111-4d9b-8208-e8115a32f439 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:01.653230 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529bdc90-92a2-4767-83aa-1a11d84ff02b None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:01.655198 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc176642-42c8-4589-b43e-aca7ab886f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:01.655819 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc176642-42c8-4589-b43e-aca7ab886f29 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:01.656091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc176642-42c8-4589-b43e-aca7ab886f29 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:01.656359 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc176642-42c8-4589-b43e-aca7ab886f29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:01.675778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc176642-42c8-4589-b43e-aca7ab886f29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:01.677283 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc176642-42c8-4589-b43e-aca7ab886f29 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:01.701041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-dc176642-42c8-4589-b43e-aca7ab886f29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:01.701041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:01.701041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:01.701041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:01.701041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:01.701041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:01.701041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:01.701041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:01.701041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:01.701041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:01.701041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:01.701041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:01.701041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:01.701041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:01.701041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:01.701041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:01.702067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:01.702067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:01.702067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:01.702067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:01.702067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:01.702067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:01.702067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:01.702067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:01.702067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:01.702067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:01.702067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:01.702067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:01.702067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:01.702067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:01.702067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:01.702067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:01.702067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:01.702937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:01.702937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:01.702937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:01.702937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 228/462] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:01.709431 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc176642-42c8-4589-b43e-aca7ab886f29 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:01.738882 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de232c55-0f90-4bd0-94d2-a9058c7ec21c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:01.739523 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de232c55-0f90-4bd0-94d2-a9058c7ec21c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:01.739805 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de232c55-0f90-4bd0-94d2-a9058c7ec21c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:01.740073 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de232c55-0f90-4bd0-94d2-a9058c7ec21c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:01.753616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de232c55-0f90-4bd0-94d2-a9058c7ec21c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:01.755601 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de232c55-0f90-4bd0-94d2-a9058c7ec21c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:01.774385 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-de232c55-0f90-4bd0-94d2-a9058c7ec21c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:01.774385 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:01.774385 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:01.774385 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:01.774385 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:01.774385 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:01.774385 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:01.774385 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:01.774385 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:01.774385 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:01.774385 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:01.774385 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:01.774385 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:01.774385 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:01.774385 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:01.774385 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:01.776589 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:01.776589 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:01.776589 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:01.776589 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:01.776589 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:01.776589 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:01.776589 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:01.776589 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:01.776589 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:01.776589 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:01.776589 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:01.776589 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:01.776589 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:01.776589 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:01.776589 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:01.776589 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:01.776589 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:01.778723 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:01.778723 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:01.778723 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:01.778723 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 235/463] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:01.778723 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de232c55-0f90-4bd0-94d2-a9058c7ec21c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:01.783942 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:01.826971 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:01.832584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc176642-42c8-4589-b43e-aca7ab886f29 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:01.867084 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac54f07-4617-47bf-bb23-89be36dd88d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:01.868114 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac54f07-4617-47bf-bb23-89be36dd88d9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:01.868390 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac54f07-4617-47bf-bb23-89be36dd88d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:01.868655 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac54f07-4617-47bf-bb23-89be36dd88d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:01.869284 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac54f07-4617-47bf-bb23-89be36dd88d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:01.869642 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac54f07-4617-47bf-bb23-89be36dd88d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:01.871066 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac54f07-4617-47bf-bb23-89be36dd88d9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:01.884844 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 229/464] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:01.885485 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac54f07-4617-47bf-bb23-89be36dd88d9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:01.891391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de232c55-0f90-4bd0-94d2-a9058c7ec21c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:01.926499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a5c605-7670-4c10-b7a6-4cb37f3957df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:01.927145 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5c605-7670-4c10-b7a6-4cb37f3957df None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:01.927384 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5c605-7670-4c10-b7a6-4cb37f3957df None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:01.927656 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a5c605-7670-4c10-b7a6-4cb37f3957df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:01.939372 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5c605-7670-4c10-b7a6-4cb37f3957df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:01.940817 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a5c605-7670-4c10-b7a6-4cb37f3957df None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:01.955041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-85a5c605-7670-4c10-b7a6-4cb37f3957df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:01.955041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:01.955041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:01.955041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:01.955041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:01.955041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:01.955041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:01.955041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:01.955041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:01.955041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:01.955041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:01.955041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:01.955041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:01.955041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:01.955041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:01.955041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:01.955982 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:01.955982 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:01.955982 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:01.955982 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:01.955982 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:01.955982 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:01.955982 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:01.955982 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:01.955982 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:01.955982 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:01.955982 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:01.955982 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:01.955982 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:01.955982 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:01.955982 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:01.955982 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:01.955982 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:01.956884 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:01.956884 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:01.956884 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:01.956884 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 236/465] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:01.957890 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3312b5-fedc-4625-839a-5c541666719a None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:01.957890 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3312b5-fedc-4625-839a-5c541666719a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:01.957890 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af3312b5-fedc-4625-839a-5c541666719a None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:01.959010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 237/466] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:01.959704 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3312b5-fedc-4625-839a-5c541666719a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:02.002027 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac54f07-4617-47bf-bb23-89be36dd88d9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:02.018872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:02.035696 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873a28a-11fc-489b-bb6b-e40d90924dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:02.036295 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873a28a-11fc-489b-bb6b-e40d90924dfd None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:02.036580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873a28a-11fc-489b-bb6b-e40d90924dfd None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:02.036830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873a28a-11fc-489b-bb6b-e40d90924dfd None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:02.037947 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873a28a-11fc-489b-bb6b-e40d90924dfd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:02.037947 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873a28a-11fc-489b-bb6b-e40d90924dfd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:02.039650 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873a28a-11fc-489b-bb6b-e40d90924dfd None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:02.051824 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 230/467] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:02.052633 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873a28a-11fc-489b-bb6b-e40d90924dfd None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:02.071667 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:02.076048 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af3312b5-fedc-4625-839a-5c541666719a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:02.112063 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3924bcf-1872-4e00-9241-0ac035063a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:02.112788 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3924bcf-1872-4e00-9241-0ac035063a08 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:02.113066 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3924bcf-1872-4e00-9241-0ac035063a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:02.113340 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3924bcf-1872-4e00-9241-0ac035063a08 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:02.114023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3924bcf-1872-4e00-9241-0ac035063a08 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:02.115650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3924bcf-1872-4e00-9241-0ac035063a08 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:02.152880 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873a28a-11fc-489b-bb6b-e40d90924dfd None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:02.184962 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e821186-255a-4089-865a-09c9349521f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:02.185549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e821186-255a-4089-865a-09c9349521f6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:02.185859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e821186-255a-4089-865a-09c9349521f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:02.186127 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e821186-255a-4089-865a-09c9349521f6 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:02.186755 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e821186-255a-4089-865a-09c9349521f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:02.187049 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e821186-255a-4089-865a-09c9349521f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:02.188407 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e821186-255a-4089-865a-09c9349521f6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:02.205804 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 231/468] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:02.206009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 238/469] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Sep 13 19:44:01 2022] POST /identity/v3/users => generated 246 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:44:02.206009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3924bcf-1872-4e00-9241-0ac035063a08 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:02.206191 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32337a09-01a7-401f-bcce-138e9516af5d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:02.206191 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32337a09-01a7-401f-bcce-138e9516af5d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:02.206191 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32337a09-01a7-401f-bcce-138e9516af5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:02.228198 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-32337a09-01a7-401f-bcce-138e9516af5d None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:02.229841 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-32337a09-01a7-401f-bcce-138e9516af5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:02.265782 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:02.317666 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 232/470] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:02.318880 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32337a09-01a7-401f-bcce-138e9516af5d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:02.342624 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3924bcf-1872-4e00-9241-0ac035063a08 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:02.381903 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58db0c5-e77b-4758-911a-34f2cc63c56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:02.382525 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58db0c5-e77b-4758-911a-34f2cc63c56c None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:02.382921 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58db0c5-e77b-4758-911a-34f2cc63c56c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:02.383202 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58db0c5-e77b-4758-911a-34f2cc63c56c None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:02.384108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58db0c5-e77b-4758-911a-34f2cc63c56c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:02.386054 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58db0c5-e77b-4758-911a-34f2cc63c56c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:02.451036 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32337a09-01a7-401f-bcce-138e9516af5d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:02.484333 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 239/471] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Sep 13 19:44:02 2022] POST /identity/v3/users => generated 248 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:44:02.485758 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173257b4-528b-40fc-99ef-f4a0a3b636a8 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:02.488313 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173257b4-528b-40fc-99ef-f4a0a3b636a8 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:02.488313 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173257b4-528b-40fc-99ef-f4a0a3b636a8 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:02.489916 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbcb32-ee32-42df-988b-ae416208df85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:02.490729 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbcb32-ee32-42df-988b-ae416208df85 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:02.491169 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbcb32-ee32-42df-988b-ae416208df85 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:02.491650 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbcb32-ee32-42df-988b-ae416208df85 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:02.492332 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 240/472] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:02.492723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbcb32-ee32-42df-988b-ae416208df85 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:02.494346 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c21540-d146-436d-85c3-1409142f9004 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:02.494646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecbcb32-ee32-42df-988b-ae416208df85 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:02.494768 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c21540-d146-436d-85c3-1409142f9004 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:02.495044 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c21540-d146-436d-85c3-1409142f9004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:02.523038 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-74c21540-d146-436d-85c3-1409142f9004 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:02.525258 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-74c21540-d146-436d-85c3-1409142f9004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:02.529972 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:02.599398 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 233/473] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Sep 13 19:44:02 2022] POST /identity/v3/users => generated 248 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:44:02.616588 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbcb32-ee32-42df-988b-ae416208df85 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:02.617235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 241/474] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:44:02.674311 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:02.786629 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbcb32-ee32-42df-988b-ae416208df85 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:02.826961 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118e72d-3f86-458c-830b-36184aced336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:02.827591 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118e72d-3f86-458c-830b-36184aced336 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:02.827864 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118e72d-3f86-458c-830b-36184aced336 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:02.828135 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c118e72d-3f86-458c-830b-36184aced336 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:02.839225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118e72d-3f86-458c-830b-36184aced336 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:02.840666 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c118e72d-3f86-458c-830b-36184aced336 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:02.854910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-c118e72d-3f86-458c-830b-36184aced336 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:02.854910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:02.854910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:02.854910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:02.854910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:02.854910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:02.854910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:02.854910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:02.854910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:02.854910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:02.854910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:02.854910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:02.854910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:02.854910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:02.854910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:02.854910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:02.855848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:02.855848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:02.855848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:02.855848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:02.855848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:02.855848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:02.855848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:02.855848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:02.855848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:02.855848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:02.855848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:02.855848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:02.855848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:02.855848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:02.855848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:02.855848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:02.855848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:02.856776 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:02.856776 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:02.856776 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:02.856776 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 234/475] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:02.861980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c21540-d146-436d-85c3-1409142f9004 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:02.943887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118e72d-3f86-458c-830b-36184aced336 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:02.986965 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c21540-d146-436d-85c3-1409142f9004 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:03.032451 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb744e-2e14-44fb-adec-0a39e023a726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:03.033330 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb744e-2e14-44fb-adec-0a39e023a726 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:03.033616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb744e-2e14-44fb-adec-0a39e023a726 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:03.034854 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb744e-2e14-44fb-adec-0a39e023a726 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:03.035529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb744e-2e14-44fb-adec-0a39e023a726 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:03.035897 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb744e-2e14-44fb-adec-0a39e023a726 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:03.037341 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb744e-2e14-44fb-adec-0a39e023a726 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:03.042770 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:03.063150 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 242/476] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:03.066093 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:03.068742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb744e-2e14-44fb-adec-0a39e023a726 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:03.073584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c118e72d-3f86-458c-830b-36184aced336 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:03.146601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13794c-4b4b-4f7a-97ff-e7a34c1cf6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:03.147612 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13794c-4b4b-4f7a-97ff-e7a34c1cf6b5 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:03.148104 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13794c-4b4b-4f7a-97ff-e7a34c1cf6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:03.149102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee13794c-4b4b-4f7a-97ff-e7a34c1cf6b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:03.149995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13794c-4b4b-4f7a-97ff-e7a34c1cf6b5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:03.151581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee13794c-4b4b-4f7a-97ff-e7a34c1cf6b5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:03.200830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.sql.core [None req-ee13794c-4b4b-4f7a-97ff-e7a34c1cf6b5 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 19:44:03.200830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 13 19:44:03.200830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [parameters: {'id': 'a224e978db0f4fc6b5f2ec2e0b602913', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 13 19:44:03.200830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81554) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 19:44:03.229344 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ee13794c-4b4b-4f7a-97ff-e7a34c1cf6b5 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 13 19:44:03.229344 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:03.229344 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 19:44:03.229344 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 19:44:03.229344 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 19:44:03.229344 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 19:44:03.229344 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 19:44:03.229344 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 19:44:03.229344 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 19:44:03.229344 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application conn.query(q) Sep 13 19:44:03.229344 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 19:44:03.229344 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 19:44:03.229344 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 19:44:03.229344 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application result.read() Sep 13 19:44:03.229344 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 19:44:03.230321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 19:44:03.230321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 19:44:03.230321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 19:44:03.230321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 19:44:03.230321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 19:44:03.230321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 19:44:03.230321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 19:44:03.230321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 19:44:03.230321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:03.230321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 19:44:03.230321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:03.230321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:03.230321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 19:44:03.230321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 19:44:03.230321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 13 19:44:03.230321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return ref.to_dict() Sep 13 19:44:03.230321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 19:44:03.230321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application next(self.gen) Sep 13 19:44:03.231229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 19:44:03.231229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application yield resource Sep 13 19:44:03.231229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 19:44:03.231229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application next(self.gen) Sep 13 19:44:03.231229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 19:44:03.231229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 19:44:03.231229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 19:44:03.231229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 19:44:03.231229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 19:44:03.231229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise self.value Sep 13 19:44:03.231229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 19:44:03.231229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 19:44:03.231229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 19:44:03.231229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application session.commit() Sep 13 19:44:03.231229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 19:44:03.231229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 19:44:03.231229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 19:44:03.232106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 19:44:03.232106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 19:44:03.232106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self.session.flush() Sep 13 19:44:03.232106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 19:44:03.232106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 19:44:03.232106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 19:44:03.232106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 19:44:03.232106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 19:44:03.232106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application compat.raise_( Sep 13 19:44:03.232106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 19:44:03.232106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception Sep 13 19:44:03.232106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 19:44:03.232106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 19:44:03.232106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 19:44:03.232106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 19:44:03.232106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 19:44:03.232106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 19:44:03.233007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 19:44:03.233007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 19:44:03.233007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 19:44:03.233007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 19:44:03.233007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 19:44:03.233007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 19:44:03.233007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 19:44:03.233007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 19:44:03.233007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 19:44:03.233007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 19:44:03.233007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 19:44:03.233007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 19:44:03.233007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 19:44:03.233007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 19:44:03.233007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 19:44:03.233007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception Sep 13 19:44:03.233901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 19:44:03.233901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 19:44:03.233901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 19:44:03.233901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 19:44:03.233901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 19:44:03.233901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 19:44:03.233901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 19:44:03.233901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application conn.query(q) Sep 13 19:44:03.233901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 19:44:03.233901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 19:44:03.233901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 19:44:03.233901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application result.read() Sep 13 19:44:03.233901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 19:44:03.233901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 19:44:03.233901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 19:44:03.233901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 19:44:03.234698 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 19:44:03.234698 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 19:44:03.234698 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 19:44:03.234698 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 19:44:03.234698 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 13 19:44:03.234698 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 13 19:44:03.234698 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [parameters: {'id': 'a224e978db0f4fc6b5f2ec2e0b602913', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 13 19:44:03.234698 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 19:44:03.234698 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:03.234698 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:44:03.234698 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:03.234698 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:03.234698 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:03.234698 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:03.234698 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:03.234698 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:03.237496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:03.237496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:03.237496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:03.237496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:03.237496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:03.237496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:03.237496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 13 19:44:03.237496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 13 19:44:03.237496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:03.237496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:03.237496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 13 19:44:03.237496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 13 19:44:03.237496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 19:44:03.237496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 19:44:03.237496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 13 19:44:03.237496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:03.245030 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 235/477] 10.222.0.59 () {60 vars in 1131 bytes} [Tue Sep 13 19:44:02 2022] POST /identity/v3/roles => generated 144 bytes in 302 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:03.250873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13794c-4b4b-4f7a-97ff-e7a34c1cf6b5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:03.255863 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb744e-2e14-44fb-adec-0a39e023a726 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:03.324305 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca5849-df80-4bf3-ac5a-b89456dc8121 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:03.324844 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca5849-df80-4bf3-ac5a-b89456dc8121 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:03.325126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca5849-df80-4bf3-ac5a-b89456dc8121 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:03.325402 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca5849-df80-4bf3-ac5a-b89456dc8121 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:03.326100 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca5849-df80-4bf3-ac5a-b89456dc8121 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:03.328930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca5849-df80-4bf3-ac5a-b89456dc8121 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:03.394047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee13794c-4b4b-4f7a-97ff-e7a34c1cf6b5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:03.430282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84145606-f5c8-4b2b-bee6-6f99bef82cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:03.431303 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84145606-f5c8-4b2b-bee6-6f99bef82cca None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:03.431848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84145606-f5c8-4b2b-bee6-6f99bef82cca None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:03.432339 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84145606-f5c8-4b2b-bee6-6f99bef82cca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:03.441314 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:03.446293 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84145606-f5c8-4b2b-bee6-6f99bef82cca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:03.452192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-84145606-f5c8-4b2b-bee6-6f99bef82cca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:44:03.452192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:03.452192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:03.452192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:03.452192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:03.452192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:03.452192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:03.452192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:03.452192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:03.452192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:03.452192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:03.452192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:03.452192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:03.452192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:03.452192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:03.452192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:03.453083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:03.453083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:03.453083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:03.453083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:03.453083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:03.453083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:03.453083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:03.453083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:03.453083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:03.453083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:03.453083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:03.453083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:03.453083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:03.453083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:03.453083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:03.453083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:03.453927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:03.453927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:03.453927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:03.453927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:03.453927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:03.453927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:03.453927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:03.453927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:03.453927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:03.453927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:03.453927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 13 19:44:03.453927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:03.453927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 236/478] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Sep 13 19:44:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:03.462709 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84145606-f5c8-4b2b-bee6-6f99bef82cca None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:03.485222 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 243/479] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Sep 13 19:44:03 2022] POST /identity/v3/users => generated 249 bytes in 417 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:44:03.595265 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84145606-f5c8-4b2b-bee6-6f99bef82cca None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:03.645488 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd9c219-2162-4f19-865b-167dae337fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:03.646542 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9c219-2162-4f19-865b-167dae337fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:03.647044 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9c219-2162-4f19-865b-167dae337fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:03.647514 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd9c219-2162-4f19-865b-167dae337fc5 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:03.648420 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9c219-2162-4f19-865b-167dae337fc5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:03.649003 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9c219-2162-4f19-865b-167dae337fc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:03.650619 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd9c219-2162-4f19-865b-167dae337fc5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:03.664207 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 237/480] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:04.546032 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d804d78-be4c-4c49-9d3f-d72015a696c4 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:04.547050 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d804d78-be4c-4c49-9d3f-d72015a696c4 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:04.547557 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d804d78-be4c-4c49-9d3f-d72015a696c4 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:04.549498 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 244/481] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:04.554521 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef14364-5aaa-49cd-b5b9-adba376fafd1 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:04.555339 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef14364-5aaa-49cd-b5b9-adba376fafd1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:04.555815 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef14364-5aaa-49cd-b5b9-adba376fafd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:04.583343 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-bef14364-5aaa-49cd-b5b9-adba376fafd1 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:04.584542 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bef14364-5aaa-49cd-b5b9-adba376fafd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:04.665730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:04.680845 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 238/482] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:44:05.000453 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d804d78-be4c-4c49-9d3f-d72015a696c4 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:05.073120 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:05.136422 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d804d78-be4c-4c49-9d3f-d72015a696c4 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:05.187767 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3578f907-e863-4cc7-9d99-1c9d59c54635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:05.188719 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578f907-e863-4cc7-9d99-1c9d59c54635 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:05.189198 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578f907-e863-4cc7-9d99-1c9d59c54635 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:05.189668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3578f907-e863-4cc7-9d99-1c9d59c54635 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:05.206530 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3578f907-e863-4cc7-9d99-1c9d59c54635 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:05.212769 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-3578f907-e863-4cc7-9d99-1c9d59c54635 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:05.212769 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:05.212769 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:05.212769 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:05.212769 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:05.212769 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:05.212769 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:05.212769 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:05.212769 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:05.212769 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:05.212769 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:05.212769 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:05.212769 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:05.212769 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:05.212769 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:05.212769 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:05.213649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:05.213649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:05.213649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:05.213649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:05.213649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:05.213649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:05.213649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:05.213649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:05.213649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:05.213649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:05.213649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:05.213649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:05.213649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:05.213649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:05.213649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:05.213649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:05.214492 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:05.214492 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:05.214492 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:05.214492 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:05.214492 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:05.214492 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:05.214492 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:05.214492 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:05.214492 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:05.214492 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:05.214492 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:05.214492 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:05.216737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 245/483] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:05.222494 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef14364-5aaa-49cd-b5b9-adba376fafd1 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:05.341940 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0ca6f-7d9c-4e87-b866-70a23cfc06b7 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:05.342607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0ca6f-7d9c-4e87-b866-70a23cfc06b7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:05.343202 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d0ca6f-7d9c-4e87-b866-70a23cfc06b7 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:05.345000 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 246/484] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:44:05.350217 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365d1c4-1643-4937-adbc-f6886f2218cd None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:05.350721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365d1c4-1643-4937-adbc-f6886f2218cd None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:05.351762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0365d1c4-1643-4937-adbc-f6886f2218cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:05.382784 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-0365d1c4-1643-4937-adbc-f6886f2218cd None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:05.384820 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0365d1c4-1643-4937-adbc-f6886f2218cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:05.416700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef14364-5aaa-49cd-b5b9-adba376fafd1 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:05.475609 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1730f3f-416b-4f2e-9c38-c77669395595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:05.477724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1730f3f-416b-4f2e-9c38-c77669395595 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:05.478205 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1730f3f-416b-4f2e-9c38-c77669395595 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:05.479565 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1730f3f-416b-4f2e-9c38-c77669395595 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:05.480439 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1730f3f-416b-4f2e-9c38-c77669395595 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:05.481789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1730f3f-416b-4f2e-9c38-c77669395595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:05.484180 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1730f3f-416b-4f2e-9c38-c77669395595 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:05.494809 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 239/485] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:05.496291 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f744f8d-9e38-4d3b-b96b-93290416ad34 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:05.496774 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f744f8d-9e38-4d3b-b96b-93290416ad34 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:05.497245 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f744f8d-9e38-4d3b-b96b-93290416ad34 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:05.498694 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 240/486] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:05.503864 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f744f8d-9e38-4d3b-b96b-93290416ad34 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:05.516056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 247/487] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:05.517157 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d524414-000b-45e6-81d1-674fde3e0b54 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:05.521792 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d524414-000b-45e6-81d1-674fde3e0b54 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:05.521792 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d524414-000b-45e6-81d1-674fde3e0b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:05.548572 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-9d524414-000b-45e6-81d1-674fde3e0b54 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:05.550102 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9d524414-000b-45e6-81d1-674fde3e0b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:05.604320 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:05.631214 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:05.658932 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 248/488] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:05.687318 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f744f8d-9e38-4d3b-b96b-93290416ad34 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:05.739184 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99300cc8-c857-41b2-8f28-7eaebd10d84a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:05.739810 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99300cc8-c857-41b2-8f28-7eaebd10d84a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:05.740085 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99300cc8-c857-41b2-8f28-7eaebd10d84a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:05.740352 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99300cc8-c857-41b2-8f28-7eaebd10d84a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:05.754357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99300cc8-c857-41b2-8f28-7eaebd10d84a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:05.755778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99300cc8-c857-41b2-8f28-7eaebd10d84a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:05.778034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-99300cc8-c857-41b2-8f28-7eaebd10d84a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:05.778034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:05.778034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:05.778034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:05.778034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:05.778034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:05.778034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:05.778034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:05.778034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:05.778034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:05.778034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:05.778034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:05.778034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:05.778034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:05.778034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:05.778034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:05.778982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:05.778982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:05.778982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:05.778982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:05.778982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:05.778982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:05.778982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:05.778982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:05.778982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:05.778982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:05.778982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:05.778982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:05.778982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:05.778982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:05.778982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:05.778982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:05.778982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:05.779837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:05.779837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:05.779837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:05.781912 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 241/489] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:05.787210 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d524414-000b-45e6-81d1-674fde3e0b54 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:05.895694 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99300cc8-c857-41b2-8f28-7eaebd10d84a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:05.948305 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d524414-000b-45e6-81d1-674fde3e0b54 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:06.002343 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1075cc5-9182-4632-a565-013ffa068921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:06.003233 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1075cc5-9182-4632-a565-013ffa068921 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.003689 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1075cc5-9182-4632-a565-013ffa068921 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.004139 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1075cc5-9182-4632-a565-013ffa068921 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.004963 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1075cc5-9182-4632-a565-013ffa068921 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:06.005472 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1075cc5-9182-4632-a565-013ffa068921 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:06.007048 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1075cc5-9182-4632-a565-013ffa068921 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:06.024327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 249/490] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:06.024327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1075cc5-9182-4632-a565-013ffa068921 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:06.057757 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99300cc8-c857-41b2-8f28-7eaebd10d84a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:06.059417 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:06.068789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:06.103226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d75e0-5ed0-4543-8dec-1e03cb374b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:06.104513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d75e0-5ed0-4543-8dec-1e03cb374b96 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.105017 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d75e0-5ed0-4543-8dec-1e03cb374b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.105869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974d75e0-5ed0-4543-8dec-1e03cb374b96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.121441 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974d75e0-5ed0-4543-8dec-1e03cb374b96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:06.129128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-974d75e0-5ed0-4543-8dec-1e03cb374b96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:06.129128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:06.129128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:06.129128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:06.129128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:06.129128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:06.129128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:06.129128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:06.129128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:06.129128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:06.129128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:06.129128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:06.129128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:06.129128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:06.129128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:06.129128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:06.130259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:06.130259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:06.130259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:06.130259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:06.130259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:06.130259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:06.130259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:06.130259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:06.130259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:06.130259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:06.130259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:06.130259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:06.130259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:06.130259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:06.130259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:06.130259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:06.131263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:06.131263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:06.131263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:06.131263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:06.131263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:06.131263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:06.131263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:06.131263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:06.131263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:06.131263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:06.131263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:06.131263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:06.132270 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1075cc5-9182-4632-a565-013ffa068921 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:06.139470 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 242/491] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:06.139470 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d75e0-5ed0-4543-8dec-1e03cb374b96 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:06.175673 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105878a-311f-47c1-812d-14dadb48fd58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:06.176794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105878a-311f-47c1-812d-14dadb48fd58 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.177267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105878a-311f-47c1-812d-14dadb48fd58 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.177799 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f105878a-311f-47c1-812d-14dadb48fd58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.190953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f105878a-311f-47c1-812d-14dadb48fd58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:06.198165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-f105878a-311f-47c1-812d-14dadb48fd58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:06.198165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:06.198165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:06.198165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:06.198165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:06.198165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:06.198165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:06.198165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:06.198165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:06.198165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:06.198165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:06.198165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:06.198165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:06.198165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:06.198165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:06.198165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:06.199136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:06.199136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:06.199136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:06.199136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:06.199136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:06.199136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:06.199136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:06.199136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:06.199136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:06.199136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:06.199136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:06.199136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:06.199136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:06.199136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:06.199136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:06.199136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:06.199976 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:06.199976 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:06.199976 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:06.199976 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:06.199976 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:06.199976 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:06.199976 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:06.199976 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:06.199976 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:06.199976 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:06.199976 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:06.199976 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:06.207738 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 250/492] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:06.209227 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105878a-311f-47c1-812d-14dadb48fd58 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:06.252274 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974d75e0-5ed0-4543-8dec-1e03cb374b96 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:06.288342 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c213ee6-ac44-485e-9ac7-2368e722514c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:06.289212 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c213ee6-ac44-485e-9ac7-2368e722514c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.289497 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c213ee6-ac44-485e-9ac7-2368e722514c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.289832 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c213ee6-ac44-485e-9ac7-2368e722514c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.298881 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c213ee6-ac44-485e-9ac7-2368e722514c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:06.300359 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c213ee6-ac44-485e-9ac7-2368e722514c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:06.314157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-8c213ee6-ac44-485e-9ac7-2368e722514c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:44:06.314157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:06.314157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:06.314157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:06.314157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:06.314157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:06.314157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:06.314157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:06.314157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:06.314157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:06.314157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:06.314157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:06.314157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:06.314157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:06.314157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:06.314157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:06.316723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:06.316723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:06.316723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:06.316723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:06.316723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:06.316723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:06.316723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:06.316723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:06.316723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:06.316723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:06.316723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:06.316723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:06.316723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:06.316723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:06.316723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:06.316723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:06.316723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:06.316723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:06.317891 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:06.317891 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:06.317891 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:06.317891 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:06.317891 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:06.317891 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:06.317891 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:06.317891 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:06.317891 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:44:06.317891 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:06.317891 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 243/493] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Sep 13 19:44:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:06.317891 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c213ee6-ac44-485e-9ac7-2368e722514c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:06.323396 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:06.330944 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f105878a-311f-47c1-812d-14dadb48fd58 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:06.345039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:06.371947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa65f57b-d14d-43da-bd68-89808f8e77a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:06.372560 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65f57b-d14d-43da-bd68-89808f8e77a5 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.372838 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65f57b-d14d-43da-bd68-89808f8e77a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.373111 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa65f57b-d14d-43da-bd68-89808f8e77a5 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.373835 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65f57b-d14d-43da-bd68-89808f8e77a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:06.374213 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65f57b-d14d-43da-bd68-89808f8e77a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:06.375813 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa65f57b-d14d-43da-bd68-89808f8e77a5 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:06.385717 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 251/494] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:06.391261 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dd1d2-91a6-429b-87d9-2b01a2f18a01 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.391561 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dd1d2-91a6-429b-87d9-2b01a2f18a01 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.391816 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059dd1d2-91a6-429b-87d9-2b01a2f18a01 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.397990 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 252/495] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:06.397990 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dd1d2-91a6-429b-87d9-2b01a2f18a01 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:06.425896 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c213ee6-ac44-485e-9ac7-2368e722514c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:06.461601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1665b-edee-47ff-9114-4a8437d3bb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:06.462249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1665b-edee-47ff-9114-4a8437d3bb02 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.462525 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1665b-edee-47ff-9114-4a8437d3bb02 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.462783 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd1665b-edee-47ff-9114-4a8437d3bb02 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.463442 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd1665b-edee-47ff-9114-4a8437d3bb02 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:06.463739 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd1665b-edee-47ff-9114-4a8437d3bb02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:06.465128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd1665b-edee-47ff-9114-4a8437d3bb02 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:06.473150 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 244/496] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:06.473977 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1665b-edee-47ff-9114-4a8437d3bb02 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:06.513906 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059dd1d2-91a6-429b-87d9-2b01a2f18a01 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:06.547793 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86762a9-f0ff-433e-9c9b-e16034a5e459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:06.548324 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86762a9-f0ff-433e-9c9b-e16034a5e459 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.548605 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86762a9-f0ff-433e-9c9b-e16034a5e459 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.549137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86762a9-f0ff-433e-9c9b-e16034a5e459 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.549669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86762a9-f0ff-433e-9c9b-e16034a5e459 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:06.550005 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86762a9-f0ff-433e-9c9b-e16034a5e459 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:06.551862 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86762a9-f0ff-433e-9c9b-e16034a5e459 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:06.563459 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:06.576412 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd1665b-edee-47ff-9114-4a8437d3bb02 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:06.590876 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 253/497] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Sep 13 19:44:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:06.592111 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e658ce-9086-4bc8-bab1-98938c53f3ac None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.592401 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e658ce-9086-4bc8-bab1-98938c53f3ac None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.592673 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e658ce-9086-4bc8-bab1-98938c53f3ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.610712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-51e658ce-9086-4bc8-bab1-98938c53f3ac None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:06.611877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-51e658ce-9086-4bc8-bab1-98938c53f3ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:06.613176 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8625f2-821d-4769-a920-ea64ce0249d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:06.613847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8625f2-821d-4769-a920-ea64ce0249d9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.614127 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8625f2-821d-4769-a920-ea64ce0249d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.614398 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8625f2-821d-4769-a920-ea64ce0249d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.623365 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:06.625480 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8625f2-821d-4769-a920-ea64ce0249d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:06.627031 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8625f2-821d-4769-a920-ea64ce0249d9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:06.641182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ae8625f2-821d-4769-a920-ea64ce0249d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:06.641182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:06.641182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:06.641182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:06.641182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:06.641182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:06.641182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:06.641182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:06.641182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:06.641182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:06.641182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:06.641182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:06.641182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:06.641182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:06.641182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:06.641182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:06.642118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:06.642118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:06.642118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:06.642118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:06.642118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:06.642118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:06.642118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:06.642118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:06.642118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:06.642118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:06.642118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:06.642118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:06.642118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:06.642118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:06.642118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:06.642118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:06.642118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:06.643159 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:06.643159 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:06.643159 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:06.643159 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 245/498] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:06.643159 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8625f2-821d-4769-a920-ea64ce0249d9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:06.683359 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 254/499] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:06.684608 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458ba6d-632e-4cf1-8aa2-4e95888995bb None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.684897 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458ba6d-632e-4cf1-8aa2-4e95888995bb None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.685168 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4458ba6d-632e-4cf1-8aa2-4e95888995bb None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.689721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 255/500] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:06.689721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458ba6d-632e-4cf1-8aa2-4e95888995bb None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:06.741526 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8625f2-821d-4769-a920-ea64ce0249d9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:06.776241 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9510d-04b5-4c92-a88d-32c9ee03b780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:06.776838 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9510d-04b5-4c92-a88d-32c9ee03b780 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.777116 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9510d-04b5-4c92-a88d-32c9ee03b780 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.777385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9510d-04b5-4c92-a88d-32c9ee03b780 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.786523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:06.788658 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9510d-04b5-4c92-a88d-32c9ee03b780 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:06.790216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9510d-04b5-4c92-a88d-32c9ee03b780 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:06.804022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-91d9510d-04b5-4c92-a88d-32c9ee03b780 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:06.804022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:06.804022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:06.804022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:06.804022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:06.804022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:06.804022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:06.804022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:06.804022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:06.804022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:06.804022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:06.804022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:06.804022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:06.804022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:06.804022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:06.804022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:06.805419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:06.805419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:06.805419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:06.805419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:06.805419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:06.805419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:06.805419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:06.805419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:06.805419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:06.805419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:06.805419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:06.805419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:06.805419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:06.805419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:06.805419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:06.805419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:06.805419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:06.806319 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:06.806319 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:06.806319 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:06.806319 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 246/501] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:06.806319 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9510d-04b5-4c92-a88d-32c9ee03b780 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:06.821125 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4458ba6d-632e-4cf1-8aa2-4e95888995bb None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:06.855217 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0493e5b-3931-425c-ba0c-891cce64d094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:06.855819 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0493e5b-3931-425c-ba0c-891cce64d094 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.856094 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0493e5b-3931-425c-ba0c-891cce64d094 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.856360 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0493e5b-3931-425c-ba0c-891cce64d094 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.872628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:06.919956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9510d-04b5-4c92-a88d-32c9ee03b780 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:06.932341 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0493e5b-3931-425c-ba0c-891cce64d094 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:06.933844 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0493e5b-3931-425c-ba0c-891cce64d094 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:06.954991 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1536473c-8974-445b-b23b-dc6506988157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:06.955587 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536473c-8974-445b-b23b-dc6506988157 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.955860 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536473c-8974-445b-b23b-dc6506988157 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.956126 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1536473c-8974-445b-b23b-dc6506988157 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.956758 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536473c-8974-445b-b23b-dc6506988157 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:06.957055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536473c-8974-445b-b23b-dc6506988157 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:06.958422 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1536473c-8974-445b-b23b-dc6506988157 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:06.969953 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 247/502] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:06.971131 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847af04-fbc2-4f66-9591-4bfc5203137e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:06.971415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847af04-fbc2-4f66-9591-4bfc5203137e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:06.971687 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8847af04-fbc2-4f66-9591-4bfc5203137e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:06.989507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8847af04-fbc2-4f66-9591-4bfc5203137e None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:06.990703 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8847af04-fbc2-4f66-9591-4bfc5203137e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:07.040872 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 256/503] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:07.040872 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0493e5b-3931-425c-ba0c-891cce64d094 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:07.043516 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:07.056904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 248/504] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:07.057640 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847af04-fbc2-4f66-9591-4bfc5203137e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:07.085935 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:07.140723 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0493e5b-3931-425c-ba0c-891cce64d094 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:07.164608 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8847af04-fbc2-4f66-9591-4bfc5203137e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:07.175741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c938ee8-716f-454f-a5ac-5866f42a332a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:07.176347 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c938ee8-716f-454f-a5ac-5866f42a332a None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:07.176627 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c938ee8-716f-454f-a5ac-5866f42a332a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:07.176898 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c938ee8-716f-454f-a5ac-5866f42a332a None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:07.177527 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c938ee8-716f-454f-a5ac-5866f42a332a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:07.177876 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c938ee8-716f-454f-a5ac-5866f42a332a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:07.179832 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c938ee8-716f-454f-a5ac-5866f42a332a None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:07.191538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 257/505] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:07.192316 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c938ee8-716f-454f-a5ac-5866f42a332a None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:07.203877 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced45f72-05cc-478f-a914-28ad7fbe91c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:07.204500 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced45f72-05cc-478f-a914-28ad7fbe91c7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:07.204822 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced45f72-05cc-478f-a914-28ad7fbe91c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:07.205095 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced45f72-05cc-478f-a914-28ad7fbe91c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:07.216023 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced45f72-05cc-478f-a914-28ad7fbe91c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:07.217590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced45f72-05cc-478f-a914-28ad7fbe91c7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:07.233038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ced45f72-05cc-478f-a914-28ad7fbe91c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:07.233038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:07.233038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:07.233038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:07.233038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:07.233038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:07.233038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:07.233038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:07.233038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:07.233038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:07.233038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:07.233038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:07.233038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:07.233038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:07.233038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:07.233038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:07.233977 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:07.233977 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:07.233977 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:07.233977 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:07.233977 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:07.233977 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:07.233977 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:07.233977 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:07.233977 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:07.233977 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:07.233977 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:07.233977 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:07.233977 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:07.233977 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:07.233977 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:07.233977 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:07.233977 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:07.234830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:07.234830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:07.234830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:07.234830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 249/506] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:07.235053 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced45f72-05cc-478f-a914-28ad7fbe91c7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:07.269631 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:07.306097 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c938ee8-716f-454f-a5ac-5866f42a332a None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:07.313584 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:07.336435 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced45f72-05cc-478f-a914-28ad7fbe91c7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:07.340599 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcd308-8f0b-4b83-8d75-e493b6a3bd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:07.341218 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcd308-8f0b-4b83-8d75-e493b6a3bd43 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:07.341493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcd308-8f0b-4b83-8d75-e493b6a3bd43 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:07.341796 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dcd308-8f0b-4b83-8d75-e493b6a3bd43 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:07.349568 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcd308-8f0b-4b83-8d75-e493b6a3bd43 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:07.352117 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dcd308-8f0b-4b83-8d75-e493b6a3bd43 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:07.364445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-39dcd308-8f0b-4b83-8d75-e493b6a3bd43 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 19:44:07.364445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:07.364445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:07.364445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:07.364445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:07.364445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:07.364445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:07.364445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:07.364445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:07.364445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:07.364445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:07.364445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:07.364445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:07.364445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:07.364445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:07.364445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:07.365357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:07.365357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:07.365357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:07.365357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:07.365357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:07.365357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:07.365357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:07.365357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:07.365357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:07.365357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:07.365357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:07.365357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:07.365357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:07.365357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:07.365357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:07.365357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:07.365357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:07.365357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:07.366295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:07.366295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:07.366295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:07.366295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:07.366295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:07.366295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:07.366295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:07.366295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:07.366295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 19:44:07.366295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:07.366295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 258/507] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:07.366295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcd308-8f0b-4b83-8d75-e493b6a3bd43 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:07.375078 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1d3fd-b23f-436d-b01a-7a49790c1769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:07.375698 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1d3fd-b23f-436d-b01a-7a49790c1769 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:07.375978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1d3fd-b23f-436d-b01a-7a49790c1769 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:07.376253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1d3fd-b23f-436d-b01a-7a49790c1769 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:07.387015 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1d3fd-b23f-436d-b01a-7a49790c1769 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:07.388455 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1d3fd-b23f-436d-b01a-7a49790c1769 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:07.402676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-48c1d3fd-b23f-436d-b01a-7a49790c1769 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:07.402676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:07.402676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:07.402676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:07.402676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:07.402676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:07.402676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:07.402676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:07.402676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:07.402676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:07.402676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:07.402676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:07.402676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:07.402676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:07.402676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:07.402676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:07.403722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:07.403722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:07.403722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:07.403722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:07.403722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:07.403722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:07.403722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:07.403722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:07.403722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:07.403722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:07.403722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:07.403722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:07.403722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:07.403722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:07.403722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:07.403722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:07.403722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:07.404791 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:07.404791 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:07.404791 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:07.404791 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 250/508] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:07.404791 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1d3fd-b23f-436d-b01a-7a49790c1769 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:07.473083 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dcd308-8f0b-4b83-8d75-e493b6a3bd43 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:07.488439 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:07.502573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1d3fd-b23f-436d-b01a-7a49790c1769 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:07.505839 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b13d3-151e-4354-ab25-c629499b8880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:07.506491 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b13d3-151e-4354-ab25-c629499b8880 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:07.506772 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b13d3-151e-4354-ab25-c629499b8880 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:07.507046 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2b13d3-151e-4354-ab25-c629499b8880 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:07.515464 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b13d3-151e-4354-ab25-c629499b8880 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:07.516916 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2b13d3-151e-4354-ab25-c629499b8880 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:07.528566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-be2b13d3-151e-4354-ab25-c629499b8880 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:44:07.528566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:07.528566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:07.528566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:07.528566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:07.528566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:07.528566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:07.528566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:07.528566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:07.528566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:07.528566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:07.528566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:07.528566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:07.528566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:07.528566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:07.528566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:07.529712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:07.529712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:07.529712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:07.529712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:07.529712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:07.529712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:07.529712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:07.529712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:07.529712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:07.529712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:07.529712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:07.529712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:07.529712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:07.529712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:07.529712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:07.529712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:07.529712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:07.529712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:07.530652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:07.530652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:07.530652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:07.530652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:07.530652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:07.530652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:07.530652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:07.530652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:07.530652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:44:07.530652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:07.530652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 259/509] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:07 2022] GET /identity/v3/users/cinder => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:07.531240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b13d3-151e-4354-ab25-c629499b8880 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:07.539728 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b453f-0c0e-4d84-b966-a693baef351a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:07.540327 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b453f-0c0e-4d84-b966-a693baef351a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:07.540605 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b453f-0c0e-4d84-b966-a693baef351a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:07.540880 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70b453f-0c0e-4d84-b966-a693baef351a None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:07.541519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b453f-0c0e-4d84-b966-a693baef351a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:07.541850 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b453f-0c0e-4d84-b966-a693baef351a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:07.543222 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70b453f-0c0e-4d84-b966-a693baef351a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:07.555047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 251/510] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:07.555827 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b453f-0c0e-4d84-b966-a693baef351a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:07.561845 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:07.634179 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2b13d3-151e-4354-ab25-c629499b8880 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:07.652353 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70b453f-0c0e-4d84-b966-a693baef351a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:07.667845 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379630f9-5c1b-45da-ab9d-e3430a680dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:07.668470 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379630f9-5c1b-45da-ab9d-e3430a680dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:07.668750 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379630f9-5c1b-45da-ab9d-e3430a680dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:07.669025 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379630f9-5c1b-45da-ab9d-e3430a680dc6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:07.679225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379630f9-5c1b-45da-ab9d-e3430a680dc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:07.684487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-379630f9-5c1b-45da-ab9d-e3430a680dc6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:07.684487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:07.684487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:07.684487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:07.684487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:07.684487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:07.684487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:07.684487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:07.684487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:07.684487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:07.684487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:07.684487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:07.684487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:07.684487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:07.684487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:07.684487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:07.685588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:07.685588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:07.685588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:07.685588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:07.685588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:07.685588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:07.685588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:07.685588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:07.685588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:07.685588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:07.685588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:07.685588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:07.685588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:07.685588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:07.685588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:07.685588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:07.686458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:07.686458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:07.686458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:07.686458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:07.686458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:07.686458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:07.686458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:07.686458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:07.686458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:07.686458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:07.686458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:07.686458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:07.686458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 260/511] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:07.686458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379630f9-5c1b-45da-ab9d-e3430a680dc6 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:07.688623 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81428cef-1e39-43c6-ba68-fcf2c7eb211d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:07.689365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81428cef-1e39-43c6-ba68-fcf2c7eb211d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:07.689801 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81428cef-1e39-43c6-ba68-fcf2c7eb211d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:07.690197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81428cef-1e39-43c6-ba68-fcf2c7eb211d None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:07.691069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81428cef-1e39-43c6-ba68-fcf2c7eb211d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:07.691378 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81428cef-1e39-43c6-ba68-fcf2c7eb211d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:07.692808 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81428cef-1e39-43c6-ba68-fcf2c7eb211d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:07.729098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 252/512] 10.222.0.59 () {56 vars in 1137 bytes} [Tue Sep 13 19:44:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:07.729943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81428cef-1e39-43c6-ba68-fcf2c7eb211d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:07.733304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:07.770472 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:07.786222 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379630f9-5c1b-45da-ab9d-e3430a680dc6 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:07.821500 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff21e5a-bc51-4b83-918b-c907763c195a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:07.822132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff21e5a-bc51-4b83-918b-c907763c195a None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:07.822412 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff21e5a-bc51-4b83-918b-c907763c195a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:07.822681 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff21e5a-bc51-4b83-918b-c907763c195a None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:07.823310 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff21e5a-bc51-4b83-918b-c907763c195a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:07.823610 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff21e5a-bc51-4b83-918b-c907763c195a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:07.825000 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff21e5a-bc51-4b83-918b-c907763c195a None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:07.828352 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81428cef-1e39-43c6-ba68-fcf2c7eb211d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:07.836420 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 261/513] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:07.837179 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff21e5a-bc51-4b83-918b-c907763c195a None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:07.865992 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb46cf-7489-40c3-a996-3a0c053c4f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:07.867203 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb46cf-7489-40c3-a996-3a0c053c4f32 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:07.867479 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb46cf-7489-40c3-a996-3a0c053c4f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:07.867755 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbb46cf-7489-40c3-a996-3a0c053c4f32 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:07.868472 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb46cf-7489-40c3-a996-3a0c053c4f32 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:07.868775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb46cf-7489-40c3-a996-3a0c053c4f32 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:07.870234 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbb46cf-7489-40c3-a996-3a0c053c4f32 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:07.893133 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 253/514] 10.222.0.59 () {56 vars in 1137 bytes} [Tue Sep 13 19:44:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:07.893133 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb46cf-7489-40c3-a996-3a0c053c4f32 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:07.941353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff21e5a-bc51-4b83-918b-c907763c195a None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:07.950036 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:07.974689 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70b4ef-0413-4d7f-a07e-eef22cee175a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:07.975294 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70b4ef-0413-4d7f-a07e-eef22cee175a None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:07.975573 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70b4ef-0413-4d7f-a07e-eef22cee175a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:07.976354 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b70b4ef-0413-4d7f-a07e-eef22cee175a None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:07.977376 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70b4ef-0413-4d7f-a07e-eef22cee175a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:07.978840 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b70b4ef-0413-4d7f-a07e-eef22cee175a None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:07.987259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbb46cf-7489-40c3-a996-3a0c053c4f32 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:08.020084 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8083e1f-55db-4772-82f2-6f0a373fd3ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:08.020669 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8083e1f-55db-4772-82f2-6f0a373fd3ea None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:08.020946 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8083e1f-55db-4772-82f2-6f0a373fd3ea None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:08.021216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8083e1f-55db-4772-82f2-6f0a373fd3ea None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:08.021889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8083e1f-55db-4772-82f2-6f0a373fd3ea None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:08.022189 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8083e1f-55db-4772-82f2-6f0a373fd3ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:08.023551 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8083e1f-55db-4772-82f2-6f0a373fd3ea None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:08.031041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 254/515] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:08.031793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8083e1f-55db-4772-82f2-6f0a373fd3ea None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:08.067054 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 262/516] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Sep 13 19:44:07 2022] POST /identity/v3/users => generated 247 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:44:08.067054 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70b4ef-0413-4d7f-a07e-eef22cee175a None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:08.067054 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:08.152557 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8083e1f-55db-4772-82f2-6f0a373fd3ea None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:08.178573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:08.178840 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b70b4ef-0413-4d7f-a07e-eef22cee175a None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:08.190451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2cfb6-08cd-4db7-98a2-9d580e5bbbe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:08.192070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2cfb6-08cd-4db7-98a2-9d580e5bbbe5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:08.192070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2cfb6-08cd-4db7-98a2-9d580e5bbbe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:08.192070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf2cfb6-08cd-4db7-98a2-9d580e5bbbe5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:08.219793 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d65ee-6fbd-4afa-baaf-1180e74732a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:08.220434 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d65ee-6fbd-4afa-baaf-1180e74732a2 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:08.220715 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d65ee-6fbd-4afa-baaf-1180e74732a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:08.220989 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1d65ee-6fbd-4afa-baaf-1180e74732a2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:08.231320 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d65ee-6fbd-4afa-baaf-1180e74732a2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:08.232764 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1d65ee-6fbd-4afa-baaf-1180e74732a2 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:08.246545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-aa1d65ee-6fbd-4afa-baaf-1180e74732a2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:08.246545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:08.246545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:08.246545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:08.246545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:08.246545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:08.246545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:08.246545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:08.246545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:08.246545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:08.246545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:08.246545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:08.246545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:08.246545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:08.246545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:08.247623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:08.247623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:08.247623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:08.247623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:08.247623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:08.247623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:08.247623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:08.247623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:08.247623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:08.247623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:08.247623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:08.247623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:08.247623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:08.247623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:08.247623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:08.247623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:08.247623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:08.248606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:08.248606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:08.248606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:08.248606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:08.248606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:08.248606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:08.248606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:08.248606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:08.248606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 263/517] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:08.249198 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d65ee-6fbd-4afa-baaf-1180e74732a2 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:08.271355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2cfb6-08cd-4db7-98a2-9d580e5bbbe5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:08.274536 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf2cfb6-08cd-4db7-98a2-9d580e5bbbe5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:08.327087 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:08.362394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1d65ee-6fbd-4afa-baaf-1180e74732a2 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:08.387873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 255/518] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:08.387873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2cfb6-08cd-4db7-98a2-9d580e5bbbe5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:08.404250 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090de9e3-2c8b-4f35-8dd2-903fdfee3330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:08.404797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090de9e3-2c8b-4f35-8dd2-903fdfee3330 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:08.405077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090de9e3-2c8b-4f35-8dd2-903fdfee3330 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:08.405350 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090de9e3-2c8b-4f35-8dd2-903fdfee3330 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:08.411240 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:08.478524 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090de9e3-2c8b-4f35-8dd2-903fdfee3330 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:08.479998 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090de9e3-2c8b-4f35-8dd2-903fdfee3330 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:08.489024 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf2cfb6-08cd-4db7-98a2-9d580e5bbbe5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:08.525859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6599b-5d18-4895-8921-0b0ae6e23cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:08.526478 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6599b-5d18-4895-8921-0b0ae6e23cbd None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:08.526753 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6599b-5d18-4895-8921-0b0ae6e23cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:08.527021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c6599b-5d18-4895-8921-0b0ae6e23cbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:08.537321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c6599b-5d18-4895-8921-0b0ae6e23cbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:08.538826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c6599b-5d18-4895-8921-0b0ae6e23cbd None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:08.543758 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:08.553454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-d1c6599b-5d18-4895-8921-0b0ae6e23cbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:08.553454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:08.553454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:08.553454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:08.553454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:08.553454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:08.553454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:08.553454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:08.553454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:08.553454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:08.553454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:08.553454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:08.553454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:08.553454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:08.553454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:08.553454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:08.560329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:08.560329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:08.560329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:08.560329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:08.560329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:08.560329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:08.560329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:08.560329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:08.560329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:08.560329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:08.560329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:08.560329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:08.560329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:08.560329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:08.560329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:08.560329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:08.560329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:08.561202 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:08.561202 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:08.561202 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:08.561202 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 256/519] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:08.561202 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6599b-5d18-4895-8921-0b0ae6e23cbd None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:08.589961 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 264/520] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:08.590742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090de9e3-2c8b-4f35-8dd2-903fdfee3330 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:08.645898 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:08.669842 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c6599b-5d18-4895-8921-0b0ae6e23cbd None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:08.695378 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090de9e3-2c8b-4f35-8dd2-903fdfee3330 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:08.705353 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127fadd-6e75-4a7d-b2e8-1834f4406be3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:08.706082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127fadd-6e75-4a7d-b2e8-1834f4406be3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:08.706360 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127fadd-6e75-4a7d-b2e8-1834f4406be3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:08.706630 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5127fadd-6e75-4a7d-b2e8-1834f4406be3 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:08.707310 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127fadd-6e75-4a7d-b2e8-1834f4406be3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:08.707621 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127fadd-6e75-4a7d-b2e8-1834f4406be3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:08.709249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5127fadd-6e75-4a7d-b2e8-1834f4406be3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:08.727924 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 257/521] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:08.728742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127fadd-6e75-4a7d-b2e8-1834f4406be3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:08.733352 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd686b4-6955-4665-80f9-d82d99d96c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:08.734014 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd686b4-6955-4665-80f9-d82d99d96c5b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:08.734319 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd686b4-6955-4665-80f9-d82d99d96c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:08.734589 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd686b4-6955-4665-80f9-d82d99d96c5b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:08.745219 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd686b4-6955-4665-80f9-d82d99d96c5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:08.746690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd686b4-6955-4665-80f9-d82d99d96c5b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:08.762001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-ccd686b4-6955-4665-80f9-d82d99d96c5b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:08.762001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:08.762001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:08.762001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:08.762001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:08.762001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:08.762001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:08.762001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:08.762001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:08.762001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:08.762001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:08.762001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:08.762001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:08.762001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:08.762001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:08.762001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:08.763045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:08.763045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:08.763045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:08.763045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:08.763045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:08.763045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:08.763045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:08.763045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:08.763045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:08.763045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:08.763045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:08.763045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:08.763045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:08.763045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:08.763045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:08.763045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:08.763045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:08.763952 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:08.763952 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:08.763952 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:08.763952 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 265/522] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:08.763952 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd686b4-6955-4665-80f9-d82d99d96c5b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:08.780178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:08.843194 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5127fadd-6e75-4a7d-b2e8-1834f4406be3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:08.870997 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd686b4-6955-4665-80f9-d82d99d96c5b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:08.883910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5ce89-8d10-4db3-9ffe-3a1958184335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:08.884675 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5ce89-8d10-4db3-9ffe-3a1958184335 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:08.884962 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5ce89-8d10-4db3-9ffe-3a1958184335 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:08.885236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5ce89-8d10-4db3-9ffe-3a1958184335 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:08.885996 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5ce89-8d10-4db3-9ffe-3a1958184335 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:08.886301 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5ce89-8d10-4db3-9ffe-3a1958184335 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:08.887749 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5ce89-8d10-4db3-9ffe-3a1958184335 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:08.890380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:08.900043 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 258/523] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:08.901070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5ce89-8d10-4db3-9ffe-3a1958184335 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:08.916607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750fdae-2180-47aa-8758-8acbe809e410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:08.916607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750fdae-2180-47aa-8758-8acbe809e410 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:08.916607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750fdae-2180-47aa-8758-8acbe809e410 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:08.916607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1750fdae-2180-47aa-8758-8acbe809e410 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:08.925803 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750fdae-2180-47aa-8758-8acbe809e410 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:08.927216 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1750fdae-2180-47aa-8758-8acbe809e410 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:08.941980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-1750fdae-2180-47aa-8758-8acbe809e410 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:08.941980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:08.941980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:08.941980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:08.941980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:08.941980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:08.941980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:08.941980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:08.941980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:08.941980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:08.941980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:08.941980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:08.941980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:08.941980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:08.941980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:08.941980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:08.943051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:08.943051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:08.943051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:08.943051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:08.943051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:08.943051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:08.943051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:08.943051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:08.943051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:08.943051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:08.943051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:08.943051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:08.943051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:08.943051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:08.943051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:08.943051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:08.943051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:08.943912 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:08.943912 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:08.943912 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:08.943912 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 266/524] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:08.943912 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750fdae-2180-47aa-8758-8acbe809e410 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:09.013483 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5ce89-8d10-4db3-9ffe-3a1958184335 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:09.021033 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:09.048471 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fe1f5-56f4-46fc-b0ad-71c52d075302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:09.049072 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fe1f5-56f4-46fc-b0ad-71c52d075302 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:09.049354 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fe1f5-56f4-46fc-b0ad-71c52d075302 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:09.049643 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4fe1f5-56f4-46fc-b0ad-71c52d075302 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:09.050375 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4fe1f5-56f4-46fc-b0ad-71c52d075302 None admin] RBAC: Adding query filter params (role.id=b253c1f3cd6a4197a85ca5f672852073, scope.project.id=ad67761fec0a430181877e216e90e7d4, user.id=3919b24291f54df99a9da0f5d3164ccf) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:09.050683 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4fe1f5-56f4-46fc-b0ad-71c52d075302 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:09.052211 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4fe1f5-56f4-46fc-b0ad-71c52d075302 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:09.057875 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1750fdae-2180-47aa-8758-8acbe809e410 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:09.058487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 259/525] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:08 2022] GET /identity/v3/role_assignments?user.id=3919b24291f54df99a9da0f5d3164ccf&scope.project.id=ad67761fec0a430181877e216e90e7d4&role.id=b253c1f3cd6a4197a85ca5f672852073 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:09.081740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fe1f5-56f4-46fc-b0ad-71c52d075302 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:09.112752 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a29a6-2395-4d49-a91d-0225c3ebfff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:09.113390 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a29a6-2395-4d49-a91d-0225c3ebfff0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:09.113667 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a29a6-2395-4d49-a91d-0225c3ebfff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:09.113960 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105a29a6-2395-4d49-a91d-0225c3ebfff0 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:09.114621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a29a6-2395-4d49-a91d-0225c3ebfff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:09.114923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a29a6-2395-4d49-a91d-0225c3ebfff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:09.116986 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105a29a6-2395-4d49-a91d-0225c3ebfff0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:09.135379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 267/526] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:09.136257 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a29a6-2395-4d49-a91d-0225c3ebfff0 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:09.143035 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:09.191068 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4fe1f5-56f4-46fc-b0ad-71c52d075302 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:09.228864 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b19e7c-5915-41a3-8597-bc4e4fa78167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:09.229830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b19e7c-5915-41a3-8597-bc4e4fa78167 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:09.230254 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b19e7c-5915-41a3-8597-bc4e4fa78167 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:09.230670 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b19e7c-5915-41a3-8597-bc4e4fa78167 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:09.239274 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b19e7c-5915-41a3-8597-bc4e4fa78167 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:09.240945 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b19e7c-5915-41a3-8597-bc4e4fa78167 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:09.253995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-a9b19e7c-5915-41a3-8597-bc4e4fa78167 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 19:44:09.253995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:09.253995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:09.253995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:09.253995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:09.253995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:09.253995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:09.253995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:09.253995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:09.253995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:09.253995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:09.253995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:09.253995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:09.253995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:09.253995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:09.253995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:09.255143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:09.255143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:09.255143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:09.255143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:09.255143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:09.255143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:09.255143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:09.255143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:09.255143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:09.255143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:09.255143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:09.255143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:09.255143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:09.255143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:09.255143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:09.255143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:09.255143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:09.255143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:09.256148 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:09.256148 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:09.256148 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:09.256148 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:09.256148 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:09.256148 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:09.256148 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:09.256148 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:09.256148 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 19:44:09.256148 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:09.259235 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 260/527] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:09 2022] GET /identity/v3/users/neutron => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:09.260290 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b19e7c-5915-41a3-8597-bc4e4fa78167 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:09.260968 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105a29a6-2395-4d49-a91d-0225c3ebfff0 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:09.292703 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:09.301578 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02923233-3be0-4de6-88c2-536961d2708e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:09.302361 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02923233-3be0-4de6-88c2-536961d2708e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:09.302789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02923233-3be0-4de6-88c2-536961d2708e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:09.303122 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02923233-3be0-4de6-88c2-536961d2708e None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:09.303872 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02923233-3be0-4de6-88c2-536961d2708e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:09.304784 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02923233-3be0-4de6-88c2-536961d2708e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:09.306327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02923233-3be0-4de6-88c2-536961d2708e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:09.318741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 268/528] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:09.319655 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02923233-3be0-4de6-88c2-536961d2708e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:09.394649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b19e7c-5915-41a3-8597-bc4e4fa78167 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:09.423250 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:09.440881 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02923233-3be0-4de6-88c2-536961d2708e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:09.443011 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26c7f5-727f-4cf5-865b-5b4f4bb574d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:09.444783 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26c7f5-727f-4cf5-865b-5b4f4bb574d9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:09.445244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26c7f5-727f-4cf5-865b-5b4f4bb574d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:09.445734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e26c7f5-727f-4cf5-865b-5b4f4bb574d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:09.454866 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26c7f5-727f-4cf5-865b-5b4f4bb574d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:09.457261 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e26c7f5-727f-4cf5-865b-5b4f4bb574d9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:09.475142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-6e26c7f5-727f-4cf5-865b-5b4f4bb574d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:09.475142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:09.475142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:09.475142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:09.475142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:09.475142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:09.475142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:09.475142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:09.475142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:09.475142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:09.475142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:09.475142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:09.475142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:09.475142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:09.475142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:09.476748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:09.476748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:09.476748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:09.476748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:09.476748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:09.476748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:09.476748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:09.476748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:09.476748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:09.476748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:09.476748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:09.476748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:09.476748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:09.476748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:09.476748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:09.476748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:09.476748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:09.477884 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:09.477884 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:09.477884 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:09.477884 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:09.477884 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:09.477884 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:09.477884 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:09.477884 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:09.479922 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 261/529] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:09.480974 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26c7f5-727f-4cf5-865b-5b4f4bb574d9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:09.481130 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b30441-ddcc-4b06-a65d-75303890d311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:09.481984 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b30441-ddcc-4b06-a65d-75303890d311 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:09.482460 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b30441-ddcc-4b06-a65d-75303890d311 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:09.482826 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b30441-ddcc-4b06-a65d-75303890d311 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:09.483694 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b30441-ddcc-4b06-a65d-75303890d311 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:09.484251 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b30441-ddcc-4b06-a65d-75303890d311 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:09.486801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b30441-ddcc-4b06-a65d-75303890d311 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:09.508270 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 269/530] 10.222.0.59 () {56 vars in 1139 bytes} [Tue Sep 13 19:44:09 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:09.509231 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b30441-ddcc-4b06-a65d-75303890d311 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:09.565105 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:09.616067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e26c7f5-727f-4cf5-865b-5b4f4bb574d9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:09.631606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b30441-ddcc-4b06-a65d-75303890d311 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:09.663060 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea5d61-046e-4480-b5c1-0e8618cb0663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:09.664763 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea5d61-046e-4480-b5c1-0e8618cb0663 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:09.665192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea5d61-046e-4480-b5c1-0e8618cb0663 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:09.665861 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deea5d61-046e-4480-b5c1-0e8618cb0663 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:09.674449 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea5d61-046e-4480-b5c1-0e8618cb0663 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:09.676110 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deea5d61-046e-4480-b5c1-0e8618cb0663 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:09.677807 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f800ebc-b641-40ea-93b5-f3870b10165f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:09.678743 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f800ebc-b641-40ea-93b5-f3870b10165f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:09.679270 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f800ebc-b641-40ea-93b5-f3870b10165f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:09.679743 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f800ebc-b641-40ea-93b5-f3870b10165f None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:09.680669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f800ebc-b641-40ea-93b5-f3870b10165f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:09.681177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f800ebc-b641-40ea-93b5-f3870b10165f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:09.682846 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f800ebc-b641-40ea-93b5-f3870b10165f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:09.687496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-deea5d61-046e-4480-b5c1-0e8618cb0663 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:09.687496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:09.687496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:09.687496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:09.687496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:09.687496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:09.687496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:09.687496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:09.687496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:09.687496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:09.687496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:09.687496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:09.687496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:09.687496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:09.687496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:09.688380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:09.688380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:09.688380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:09.688380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:09.688380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:09.688380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:09.688380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:09.688380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:09.688380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:09.688380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:09.688380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:09.688380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:09.688380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:09.688380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:09.688380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:09.688380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:09.688380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:09.689264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:09.689264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:09.689264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:09.689264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:09.689264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:09.689264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:09.689264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:09.689264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:09.693368 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 262/531] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:09.694144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea5d61-046e-4480-b5c1-0e8618cb0663 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:09.709280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 270/532] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:09.711265 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f800ebc-b641-40ea-93b5-f3870b10165f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:09.738689 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:09.800980 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deea5d61-046e-4480-b5c1-0e8618cb0663 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:09.836649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ca793-ec85-4c3b-a5ae-37b76676a09e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:09.837276 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ca793-ec85-4c3b-a5ae-37b76676a09e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:09.837606 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ca793-ec85-4c3b-a5ae-37b76676a09e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:09.837906 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49ca793-ec85-4c3b-a5ae-37b76676a09e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:09.838820 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f800ebc-b641-40ea-93b5-f3870b10165f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:09.841783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:09.880208 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e1220-2616-4f16-bd5c-b2c75bbcd18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:09.881255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e1220-2616-4f16-bd5c-b2c75bbcd18d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:09.881763 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e1220-2616-4f16-bd5c-b2c75bbcd18d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:09.882280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e1220-2616-4f16-bd5c-b2c75bbcd18d None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:09.883505 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e1220-2616-4f16-bd5c-b2c75bbcd18d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:09.884040 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e1220-2616-4f16-bd5c-b2c75bbcd18d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:09.885791 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3e1220-2616-4f16-bd5c-b2c75bbcd18d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:09.902386 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 271/533] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:09.903804 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e1220-2616-4f16-bd5c-b2c75bbcd18d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:09.919126 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ca793-ec85-4c3b-a5ae-37b76676a09e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:09.920605 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49ca793-ec85-4c3b-a5ae-37b76676a09e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:09.963688 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:10.028602 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 263/534] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:10.029558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ca793-ec85-4c3b-a5ae-37b76676a09e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:10.032765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e1220-2616-4f16-bd5c-b2c75bbcd18d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:10.072436 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4e674-06ec-49a8-85c3-493cc852f224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:10.073393 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4e674-06ec-49a8-85c3-493cc852f224 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:10.073904 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4e674-06ec-49a8-85c3-493cc852f224 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:10.074382 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b4e674-06ec-49a8-85c3-493cc852f224 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:10.075571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4e674-06ec-49a8-85c3-493cc852f224 None admin] RBAC: Adding query filter params (role.id=b253c1f3cd6a4197a85ca5f672852073, scope.project.id=ad67761fec0a430181877e216e90e7d4, user.id=44093d63c1aa45b781d2ce30239ed598) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:10.076564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4e674-06ec-49a8-85c3-493cc852f224 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:10.078594 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b4e674-06ec-49a8-85c3-493cc852f224 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:10.085635 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 272/535] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:09 2022] GET /identity/v3/role_assignments?user.id=44093d63c1aa45b781d2ce30239ed598&scope.project.id=ad67761fec0a430181877e216e90e7d4&role.id=b253c1f3cd6a4197a85ca5f672852073 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:10.087162 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4e674-06ec-49a8-85c3-493cc852f224 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:10.124649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:10.134934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49ca793-ec85-4c3b-a5ae-37b76676a09e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:10.173176 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f7655-6859-4db4-86f7-b25fa72b6943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:10.173886 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f7655-6859-4db4-86f7-b25fa72b6943 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:10.174232 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f7655-6859-4db4-86f7-b25fa72b6943 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:10.174563 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189f7655-6859-4db4-86f7-b25fa72b6943 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:10.175369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f7655-6859-4db4-86f7-b25fa72b6943 None admin] RBAC: Adding query filter params (role.id=b253c1f3cd6a4197a85ca5f672852073, scope.project.id=ad67761fec0a430181877e216e90e7d4, user.id=fbdff73734304485ac9884d6b44ea73c) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:10.175754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f7655-6859-4db4-86f7-b25fa72b6943 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:10.177493 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189f7655-6859-4db4-86f7-b25fa72b6943 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:10.183869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 264/536] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:10 2022] GET /identity/v3/role_assignments?user.id=fbdff73734304485ac9884d6b44ea73c&scope.project.id=ad67761fec0a430181877e216e90e7d4&role.id=b253c1f3cd6a4197a85ca5f672852073 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:10.223975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b4e674-06ec-49a8-85c3-493cc852f224 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:10.266146 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73de4c44-48e3-4622-8b57-5cc6787750de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:10.267134 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de4c44-48e3-4622-8b57-5cc6787750de None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:10.267602 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de4c44-48e3-4622-8b57-5cc6787750de None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:10.268060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73de4c44-48e3-4622-8b57-5cc6787750de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:10.282477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de4c44-48e3-4622-8b57-5cc6787750de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:10.295332 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73de4c44-48e3-4622-8b57-5cc6787750de None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:10.302254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-73de4c44-48e3-4622-8b57-5cc6787750de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:10.302254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:10.302254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:10.302254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:10.302254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:10.302254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:10.302254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:10.302254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:10.302254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:10.302254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:10.302254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:10.302254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:10.302254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:10.302254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:10.302254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:10.302254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:10.303271 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:10.303271 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:10.303271 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:10.303271 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:10.303271 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:10.303271 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:10.303271 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:10.303271 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:10.303271 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:10.303271 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:10.303271 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:10.303271 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:10.303271 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:10.303271 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:10.303271 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:10.303271 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:10.303271 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:10.304373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:10.304373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:10.304373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:10.306356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 273/537] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:10.312058 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f7655-6859-4db4-86f7-b25fa72b6943 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:10.316616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:10.453974 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189f7655-6859-4db4-86f7-b25fa72b6943 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:10.456029 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d8e8e-e411-4d6c-bc5c-a920859ae523 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:10.456294 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d8e8e-e411-4d6c-bc5c-a920859ae523 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:10.456571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066d8e8e-e411-4d6c-bc5c-a920859ae523 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:10.458199 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 274/538] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:44:10.463271 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfedb7-8ea1-49bb-83b3-32d97bb64303 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:10.463556 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfedb7-8ea1-49bb-83b3-32d97bb64303 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:10.463829 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfedb7-8ea1-49bb-83b3-32d97bb64303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:10.484073 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-5fcfedb7-8ea1-49bb-83b3-32d97bb64303 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:10.485261 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5fcfedb7-8ea1-49bb-83b3-32d97bb64303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:10.506992 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410e997-7c0e-4719-8c19-f8c149fd5fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:10.508335 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410e997-7c0e-4719-8c19-f8c149fd5fcb None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:10.508600 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410e997-7c0e-4719-8c19-f8c149fd5fcb None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:10.508871 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410e997-7c0e-4719-8c19-f8c149fd5fcb None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:10.509523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410e997-7c0e-4719-8c19-f8c149fd5fcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:10.509853 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410e997-7c0e-4719-8c19-f8c149fd5fcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:10.511233 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410e997-7c0e-4719-8c19-f8c149fd5fcb None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:10.536779 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 265/539] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:10.540481 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410e997-7c0e-4719-8c19-f8c149fd5fcb None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:10.604065 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 275/540] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:44:10.633706 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:10.685969 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410e997-7c0e-4719-8c19-f8c149fd5fcb None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:10.739464 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a4277-f1d1-4bf6-aae0-dc8547069cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:10.740018 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a4277-f1d1-4bf6-aae0-dc8547069cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:10.740304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a4277-f1d1-4bf6-aae0-dc8547069cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:10.740576 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78a4277-f1d1-4bf6-aae0-dc8547069cd1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:10.750747 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a4277-f1d1-4bf6-aae0-dc8547069cd1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:10.752201 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78a4277-f1d1-4bf6-aae0-dc8547069cd1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:10.764696 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-d78a4277-f1d1-4bf6-aae0-dc8547069cd1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:10.764696 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:10.764696 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:10.764696 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:10.764696 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:10.764696 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:10.764696 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:10.764696 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:10.764696 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:10.764696 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:10.764696 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:10.764696 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:10.764696 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:10.764696 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:10.764696 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:10.765578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:10.765578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:10.765578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:10.765578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:10.765578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:10.765578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:10.765578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:10.765578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:10.765578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:10.765578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:10.765578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:10.765578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:10.765578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:10.765578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:10.765578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:10.765578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:10.765578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:10.766482 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:10.766482 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:10.766482 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:10.766482 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:10.766482 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:10.766482 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:10.766482 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:10.766482 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:10.766482 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 266/541] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:10.775046 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfedb7-8ea1-49bb-83b3-32d97bb64303 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:10.790372 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:10.908257 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfedb7-8ea1-49bb-83b3-32d97bb64303 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:10.954430 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f61eb-8220-4780-9699-e3718231c28d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:10.955046 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f61eb-8220-4780-9699-e3718231c28d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:10.955322 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f61eb-8220-4780-9699-e3718231c28d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:10.955590 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455f61eb-8220-4780-9699-e3718231c28d None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:10.956287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f61eb-8220-4780-9699-e3718231c28d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:10.956586 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f61eb-8220-4780-9699-e3718231c28d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:10.958019 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455f61eb-8220-4780-9699-e3718231c28d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:10.972343 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 276/542] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:10.978690 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a4277-f1d1-4bf6-aae0-dc8547069cd1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:11.011283 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f61eb-8220-4780-9699-e3718231c28d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:11.151419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:11.158794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78a4277-f1d1-4bf6-aae0-dc8547069cd1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:11.175499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455f61eb-8220-4780-9699-e3718231c28d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:11.206003 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:11.226669 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9c027-2f65-4efb-9e9f-bd79c7e1a7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:11.227512 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9c027-2f65-4efb-9e9f-bd79c7e1a7ed None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:11.227956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9c027-2f65-4efb-9e9f-bd79c7e1a7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:11.228366 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf9c027-2f65-4efb-9e9f-bd79c7e1a7ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:11.229242 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9c027-2f65-4efb-9e9f-bd79c7e1a7ed None admin] RBAC: Adding query filter params (role.id=b253c1f3cd6a4197a85ca5f672852073, scope.project.id=ad67761fec0a430181877e216e90e7d4, user.id=b86b85c457d84ac99359ac93add704d2) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:11.230294 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9c027-2f65-4efb-9e9f-bd79c7e1a7ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:11.232030 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf9c027-2f65-4efb-9e9f-bd79c7e1a7ed None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:11.240288 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 267/543] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:10 2022] GET /identity/v3/role_assignments?user.id=b86b85c457d84ac99359ac93add704d2&scope.project.id=ad67761fec0a430181877e216e90e7d4&role.id=b253c1f3cd6a4197a85ca5f672852073 => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:11.241074 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352bbeea-18ff-4972-a6fb-81d7d0176d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:11.246105 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bbeea-18ff-4972-a6fb-81d7d0176d81 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:11.246592 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bbeea-18ff-4972-a6fb-81d7d0176d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:11.247008 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352bbeea-18ff-4972-a6fb-81d7d0176d81 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:11.265005 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352bbeea-18ff-4972-a6fb-81d7d0176d81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:11.270584 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-352bbeea-18ff-4972-a6fb-81d7d0176d81 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:11.270584 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:11.270584 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:11.270584 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:11.270584 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:11.270584 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:11.270584 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:11.270584 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:11.270584 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:11.270584 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:11.270584 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:11.270584 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:11.270584 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:11.270584 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:11.270584 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:11.270584 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:11.271645 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:11.271645 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:11.271645 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:11.271645 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:11.271645 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:11.271645 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:11.271645 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:11.271645 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:11.271645 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:11.271645 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:11.271645 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:11.271645 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:11.271645 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:11.271645 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:11.271645 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:11.271645 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:11.273154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:11.273154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:11.273154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:11.273154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:11.273154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:11.273154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:11.273154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:11.273154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:11.273154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:11.273154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:11.273154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:11.273154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:11.275278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 277/544] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:11.281196 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9c027-2f65-4efb-9e9f-bd79c7e1a7ed None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:11.454828 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b92460-bc40-418e-bd5c-0d0c155dda1e None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:11.455131 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b92460-bc40-418e-bd5c-0d0c155dda1e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:11.455399 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b92460-bc40-418e-bd5c-0d0c155dda1e None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:11.456997 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 278/545] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:44:11.463161 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439742c9-8422-4f4e-a5a0-534c4605a9e7 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:11.463440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439742c9-8422-4f4e-a5a0-534c4605a9e7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:11.463722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439742c9-8422-4f4e-a5a0-534c4605a9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:11.491917 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-439742c9-8422-4f4e-a5a0-534c4605a9e7 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:11.493175 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-439742c9-8422-4f4e-a5a0-534c4605a9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:11.504385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf9c027-2f65-4efb-9e9f-bd79c7e1a7ed None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:11.570375 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244164d7-9a5a-49c7-ab83-c271698679d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:11.570904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244164d7-9a5a-49c7-ab83-c271698679d9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:11.571186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244164d7-9a5a-49c7-ab83-c271698679d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:11.571464 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244164d7-9a5a-49c7-ab83-c271698679d9 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:11.572132 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244164d7-9a5a-49c7-ab83-c271698679d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:11.572435 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244164d7-9a5a-49c7-ab83-c271698679d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:11.575514 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244164d7-9a5a-49c7-ab83-c271698679d9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:11.596990 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 268/546] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:11.601848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244164d7-9a5a-49c7-ab83-c271698679d9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:11.619958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 279/547] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:44:11.682701 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:11.746637 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244164d7-9a5a-49c7-ab83-c271698679d9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:11.798925 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858601cb-c0cc-4be7-8faa-4f7bd4dc23aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:11.799566 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858601cb-c0cc-4be7-8faa-4f7bd4dc23aa None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:11.799845 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858601cb-c0cc-4be7-8faa-4f7bd4dc23aa None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:11.800121 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858601cb-c0cc-4be7-8faa-4f7bd4dc23aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:11.811246 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858601cb-c0cc-4be7-8faa-4f7bd4dc23aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:11.812690 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858601cb-c0cc-4be7-8faa-4f7bd4dc23aa None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:11.832162 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-858601cb-c0cc-4be7-8faa-4f7bd4dc23aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:11.832162 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:11.832162 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:11.832162 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:11.832162 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:11.832162 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:11.832162 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:11.832162 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:11.832162 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:11.832162 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:11.832162 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:11.832162 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:11.832162 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:11.832162 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:11.832162 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:11.832162 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:11.833082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:11.833082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:11.833082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:11.833082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:11.833082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:11.833082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:11.833082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:11.833082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:11.833082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:11.833082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:11.833082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:11.833082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:11.833082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:11.833082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:11.833082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:11.833082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:11.833082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:11.834460 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:11.834460 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:11.834460 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:11.834460 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 269/548] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:11.839387 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439742c9-8422-4f4e-a5a0-534c4605a9e7 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:11.944089 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:11.995219 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439742c9-8422-4f4e-a5a0-534c4605a9e7 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:12.014252 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858601cb-c0cc-4be7-8faa-4f7bd4dc23aa None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:12.059579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c3fbb-4869-4f84-84d3-36fa3f4f06a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:12.060190 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c3fbb-4869-4f84-84d3-36fa3f4f06a1 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:12.060467 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c3fbb-4869-4f84-84d3-36fa3f4f06a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:12.061301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5c3fbb-4869-4f84-84d3-36fa3f4f06a1 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:12.061971 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c3fbb-4869-4f84-84d3-36fa3f4f06a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:12.062272 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c3fbb-4869-4f84-84d3-36fa3f4f06a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:12.063653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5c3fbb-4869-4f84-84d3-36fa3f4f06a1 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:12.088555 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 280/549] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:12.095374 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c3fbb-4869-4f84-84d3-36fa3f4f06a1 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:12.192814 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858601cb-c0cc-4be7-8faa-4f7bd4dc23aa None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:12.195087 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:12.248361 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95523dc-0f0d-4e12-88d0-29fa6345b23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:12.248981 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95523dc-0f0d-4e12-88d0-29fa6345b23a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:12.249256 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95523dc-0f0d-4e12-88d0-29fa6345b23a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:12.249523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95523dc-0f0d-4e12-88d0-29fa6345b23a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:12.271762 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95523dc-0f0d-4e12-88d0-29fa6345b23a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:12.282792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-c95523dc-0f0d-4e12-88d0-29fa6345b23a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:12.282792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:12.282792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:12.282792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:12.282792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:12.282792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:12.282792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:12.282792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:12.282792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:12.282792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:12.282792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:12.282792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:12.282792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:12.282792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:12.282792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:12.282792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:12.283789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:12.283789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:12.283789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:12.283789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:12.283789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:12.283789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:12.283789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:12.283789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:12.283789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:12.283789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:12.283789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:12.283789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:12.283789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:12.283789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:12.283789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:12.283789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:12.284610 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:12.284610 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:12.284610 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:12.284610 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:12.284610 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:12.284610 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:12.284610 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:12.284610 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:12.284610 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:12.284610 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:12.284610 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:12.284610 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:12.289213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 270/550] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:12.298827 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95523dc-0f0d-4e12-88d0-29fa6345b23a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:12.301215 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5c3fbb-4869-4f84-84d3-36fa3f4f06a1 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:12.336889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:12.364712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ad82e-1dd6-42d4-a82a-47494b6a9c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:12.365270 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ad82e-1dd6-42d4-a82a-47494b6a9c1c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:12.365546 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ad82e-1dd6-42d4-a82a-47494b6a9c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:12.365842 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ad82e-1dd6-42d4-a82a-47494b6a9c1c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:12.378597 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ad82e-1dd6-42d4-a82a-47494b6a9c1c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:12.380029 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ad82e-1dd6-42d4-a82a-47494b6a9c1c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:12.397037 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-ed7ad82e-1dd6-42d4-a82a-47494b6a9c1c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:44:12.397037 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:12.397037 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:12.397037 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:12.397037 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:12.397037 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:12.397037 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:12.397037 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:12.397037 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:12.397037 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:12.397037 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:12.397037 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:12.397037 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:12.397037 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:12.397037 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:12.397037 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:12.398106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:12.398106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:12.398106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:12.398106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:12.398106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:12.398106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:12.398106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:12.398106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:12.398106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:12.398106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:12.398106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:12.398106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:12.398106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:12.398106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:12.398106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:12.398106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:12.398106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:12.398106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:12.399036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:12.399036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:12.399036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:12.399036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:12.399036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:12.399036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:12.399036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:12.399036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:12.399036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:44:12.399036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:12.399581 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 281/551] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:44:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:12.409655 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ad82e-1dd6-42d4-a82a-47494b6a9c1c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:12.477258 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95523dc-0f0d-4e12-88d0-29fa6345b23a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:12.545721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0f105-2c65-4d5f-b71d-a540da2b7cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:12.546340 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0f105-2c65-4d5f-b71d-a540da2b7cf1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:12.546613 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0f105-2c65-4d5f-b71d-a540da2b7cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:12.546875 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b0f105-2c65-4d5f-b71d-a540da2b7cf1 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:12.547535 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0f105-2c65-4d5f-b71d-a540da2b7cf1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:12.547834 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0f105-2c65-4d5f-b71d-a540da2b7cf1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:12.549200 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b0f105-2c65-4d5f-b71d-a540da2b7cf1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:12.562783 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 271/552] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:12.568130 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0f105-2c65-4d5f-b71d-a540da2b7cf1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:12.599922 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ad82e-1dd6-42d4-a82a-47494b6a9c1c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:12.613458 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:12.645053 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982df3b7-cc3d-431f-b0a2-c767ac2e3bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:12.645590 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982df3b7-cc3d-431f-b0a2-c767ac2e3bf1 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:12.645955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982df3b7-cc3d-431f-b0a2-c767ac2e3bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:12.646258 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982df3b7-cc3d-431f-b0a2-c767ac2e3bf1 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:12.646955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982df3b7-cc3d-431f-b0a2-c767ac2e3bf1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:12.647764 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982df3b7-cc3d-431f-b0a2-c767ac2e3bf1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:12.649186 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982df3b7-cc3d-431f-b0a2-c767ac2e3bf1 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:12.668981 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 282/553] 10.222.0.59 () {56 vars in 1135 bytes} [Tue Sep 13 19:44:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:12.674814 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7352a3-3508-443b-93d5-3055c421bd44 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:12.675101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7352a3-3508-443b-93d5-3055c421bd44 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:12.675378 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7352a3-3508-443b-93d5-3055c421bd44 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:12.676943 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 283/554] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:12.677677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7352a3-3508-443b-93d5-3055c421bd44 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:12.708272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b0f105-2c65-4d5f-b71d-a540da2b7cf1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:12.722923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:12.748315 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b8dd4e-fb0a-486a-8da8-e9290accc390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:12.749800 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8dd4e-fb0a-486a-8da8-e9290accc390 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:12.750306 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8dd4e-fb0a-486a-8da8-e9290accc390 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:12.750773 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b8dd4e-fb0a-486a-8da8-e9290accc390 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:12.763850 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8dd4e-fb0a-486a-8da8-e9290accc390 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:12.765676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b8dd4e-fb0a-486a-8da8-e9290accc390 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:12.782734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-b7b8dd4e-fb0a-486a-8da8-e9290accc390 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:12.782734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:12.782734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:12.782734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:12.782734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:12.782734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:12.782734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:12.782734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:12.782734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:12.782734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:12.782734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:12.782734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:12.782734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:12.782734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:12.782734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:12.782734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:12.783740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:12.783740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:12.783740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:12.783740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:12.783740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:12.783740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:12.783740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:12.783740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:12.783740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:12.783740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:12.783740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:12.783740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:12.783740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:12.783740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:12.783740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:12.783740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:12.783740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:12.784705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:12.784705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:12.784705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:12.792220 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7352a3-3508-443b-93d5-3055c421bd44 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:12.792683 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 272/555] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:12.794659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8cb54-dcce-4902-8388-80a9ae2e8b72 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:12.795227 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8cb54-dcce-4902-8388-80a9ae2e8b72 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:12.795697 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f8cb54-dcce-4902-8388-80a9ae2e8b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:12.817234 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a6f8cb54-dcce-4902-8388-80a9ae2e8b72 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:12.818844 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a6f8cb54-dcce-4902-8388-80a9ae2e8b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:12.831432 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c2a801-1002-48d6-9dcd-7b35b42203f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:12.831923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2a801-1002-48d6-9dcd-7b35b42203f8 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:12.832204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2a801-1002-48d6-9dcd-7b35b42203f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:12.832528 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c2a801-1002-48d6-9dcd-7b35b42203f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:12.902118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 273/556] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:12.903297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8cb54-dcce-4902-8388-80a9ae2e8b72 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:12.912398 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:12.916424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2a801-1002-48d6-9dcd-7b35b42203f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:12.918509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c2a801-1002-48d6-9dcd-7b35b42203f8 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:12.965472 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:13.014681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f8cb54-dcce-4902-8388-80a9ae2e8b72 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:13.038480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 284/557] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:13.040191 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe74c5-91a9-4e32-9f83-e680cd060007 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:13.040481 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe74c5-91a9-4e32-9f83-e680cd060007 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:13.040761 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fe74c5-91a9-4e32-9f83-e680cd060007 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:13.046274 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 285/558] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:13.047066 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe74c5-91a9-4e32-9f83-e680cd060007 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:13.051621 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e37c433-33cf-41cf-87dd-2b84a89f6e97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:13.052356 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37c433-33cf-41cf-87dd-2b84a89f6e97 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:13.052729 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37c433-33cf-41cf-87dd-2b84a89f6e97 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:13.053092 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e37c433-33cf-41cf-87dd-2b84a89f6e97 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:13.053975 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37c433-33cf-41cf-87dd-2b84a89f6e97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:13.054371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37c433-33cf-41cf-87dd-2b84a89f6e97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:13.055827 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e37c433-33cf-41cf-87dd-2b84a89f6e97 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:13.068554 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 274/559] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:13.074743 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fb32b-097c-460f-b049-ddb5674bafce None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:13.075311 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fb32b-097c-460f-b049-ddb5674bafce None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:13.075708 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4fb32b-097c-460f-b049-ddb5674bafce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:13.094967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8d4fb32b-097c-460f-b049-ddb5674bafce None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:13.096309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8d4fb32b-097c-460f-b049-ddb5674bafce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:13.158148 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fe74c5-91a9-4e32-9f83-e680cd060007 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:13.171363 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:13.179502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 275/560] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:13.180381 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fb32b-097c-460f-b049-ddb5674bafce None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:13.195955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93049d2-0932-4c8e-abae-1987db051456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:13.196603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93049d2-0932-4c8e-abae-1987db051456 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:13.197402 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93049d2-0932-4c8e-abae-1987db051456 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:13.197402 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93049d2-0932-4c8e-abae-1987db051456 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:13.204434 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:13.208331 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93049d2-0932-4c8e-abae-1987db051456 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:13.210428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93049d2-0932-4c8e-abae-1987db051456 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:13.227070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-d93049d2-0932-4c8e-abae-1987db051456 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:13.227070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:13.227070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:13.227070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:13.227070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:13.227070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:13.227070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:13.227070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:13.227070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:13.227070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:13.227070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:13.227070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:13.227070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:13.227070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:13.227070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:13.227070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:13.231520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:13.231520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:13.231520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:13.231520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:13.231520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:13.231520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:13.231520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:13.231520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:13.231520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:13.231520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:13.231520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:13.231520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:13.231520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:13.231520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:13.231520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:13.231520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:13.231520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:13.232631 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:13.232631 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:13.232631 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:13.232631 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 286/561] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:13.232631 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93049d2-0932-4c8e-abae-1987db051456 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:13.311589 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4fb32b-097c-460f-b049-ddb5674bafce None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:13.342954 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93049d2-0932-4c8e-abae-1987db051456 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:13.358139 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fd862-3da8-450d-96dc-a4d5e91de251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:13.359226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fd862-3da8-450d-96dc-a4d5e91de251 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:13.359679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fd862-3da8-450d-96dc-a4d5e91de251 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:13.360094 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5fd862-3da8-450d-96dc-a4d5e91de251 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:13.370457 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fd862-3da8-450d-96dc-a4d5e91de251 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:13.372969 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5fd862-3da8-450d-96dc-a4d5e91de251 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:13.379615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca378fc2-8a9f-4c33-81fe-27b765d71b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:13.380369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca378fc2-8a9f-4c33-81fe-27b765d71b35 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:13.380760 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca378fc2-8a9f-4c33-81fe-27b765d71b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:13.381160 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca378fc2-8a9f-4c33-81fe-27b765d71b35 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:13.388734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-dd5fd862-3da8-450d-96dc-a4d5e91de251 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:44:13.388734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:13.388734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:13.388734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:13.388734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:13.388734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:13.388734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:13.388734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:13.388734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:13.388734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:13.388734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:13.388734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:13.388734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:13.388734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:13.388734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:13.388734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:13.389869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:13.389869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:13.389869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:13.389869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:13.389869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:13.389869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:13.389869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:13.389869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:13.389869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:13.389869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:13.389869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:13.389869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:13.389869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:13.389869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:13.389869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:13.389869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:13.389869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:13.389869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:13.391046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:13.391046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:13.391046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:13.391046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:13.391046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:13.391046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:13.391046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:13.391046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:13.391046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:44:13.391046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:13.393597 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 276/562] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Sep 13 19:44:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:13.394520 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fd862-3da8-450d-96dc-a4d5e91de251 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:13.396258 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca378fc2-8a9f-4c33-81fe-27b765d71b35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:13.401992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-ca378fc2-8a9f-4c33-81fe-27b765d71b35 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:13.401992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:13.401992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:13.401992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:13.401992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:13.401992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:13.401992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:13.401992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:13.401992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:13.401992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:13.401992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:13.401992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:13.401992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:13.401992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:13.401992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:13.401992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:13.403128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:13.403128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:13.403128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:13.403128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:13.403128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:13.403128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:13.403128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:13.403128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:13.403128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:13.403128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:13.403128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:13.403128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:13.403128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:13.403128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:13.403128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:13.403128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:13.404100 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:13.404100 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:13.404100 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:13.404100 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:13.404100 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:13.404100 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:13.404100 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:13.404100 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:13.404100 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:13.404100 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:13.404100 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:13.404100 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:13.406039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 287/563] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:13.406974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca378fc2-8a9f-4c33-81fe-27b765d71b35 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:13.460448 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:13.472241 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:13.519689 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca378fc2-8a9f-4c33-81fe-27b765d71b35 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:13.531067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5fd862-3da8-450d-96dc-a4d5e91de251 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:13.560089 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fbc5f-15b3-49a4-a52a-7c39c3c67ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:13.560691 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fbc5f-15b3-49a4-a52a-7c39c3c67ffc None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:13.560964 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fbc5f-15b3-49a4-a52a-7c39c3c67ffc None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:13.561434 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907fbc5f-15b3-49a4-a52a-7c39c3c67ffc None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:13.561985 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907fbc5f-15b3-49a4-a52a-7c39c3c67ffc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:13.562284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907fbc5f-15b3-49a4-a52a-7c39c3c67ffc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:13.563812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907fbc5f-15b3-49a4-a52a-7c39c3c67ffc None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:13.569528 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24510f-667d-4a14-a868-49b36f6c4ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:13.570162 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24510f-667d-4a14-a868-49b36f6c4ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:13.570439 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24510f-667d-4a14-a868-49b36f6c4ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:13.570709 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa24510f-667d-4a14-a868-49b36f6c4ea4 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:13.571344 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24510f-667d-4a14-a868-49b36f6c4ea4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:13.571645 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24510f-667d-4a14-a868-49b36f6c4ea4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:13.573000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa24510f-667d-4a14-a868-49b36f6c4ea4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:13.582010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 288/564] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Sep 13 19:44:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:13.582634 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fbc5f-15b3-49a4-a52a-7c39c3c67ffc None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:13.589563 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 277/565] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:13.590775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24510f-667d-4a14-a868-49b36f6c4ea4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:13.686003 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907fbc5f-15b3-49a4-a52a-7c39c3c67ffc None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:13.695300 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:13.700254 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa24510f-667d-4a14-a868-49b36f6c4ea4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:13.716783 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:13.719779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3563d-0092-4122-934b-69e3cc96e616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:13.720382 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3563d-0092-4122-934b-69e3cc96e616 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:13.720658 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3563d-0092-4122-934b-69e3cc96e616 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:13.720923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec3563d-0092-4122-934b-69e3cc96e616 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:13.721570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3563d-0092-4122-934b-69e3cc96e616 None admin] RBAC: Adding query filter params (name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:13.721898 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3563d-0092-4122-934b-69e3cc96e616 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:13.723275 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec3563d-0092-4122-934b-69e3cc96e616 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:13.731879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 289/566] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:13.732654 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3563d-0092-4122-934b-69e3cc96e616 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:13.736479 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b5391-5d16-4100-a288-309bea8f3570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:13.736479 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b5391-5d16-4100-a288-309bea8f3570 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:13.736479 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b5391-5d16-4100-a288-309bea8f3570 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:13.736479 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744b5391-5d16-4100-a288-309bea8f3570 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:13.745792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744b5391-5d16-4100-a288-309bea8f3570 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:13.750513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-744b5391-5d16-4100-a288-309bea8f3570 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:13.750513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:13.750513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:13.750513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:13.750513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:13.750513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:13.750513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:13.750513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:13.750513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:13.750513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:13.750513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:13.750513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:13.750513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:13.750513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:13.750513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:13.750513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:13.752112 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:13.752112 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:13.752112 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:13.752112 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:13.752112 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:13.752112 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:13.752112 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:13.752112 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:13.752112 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:13.752112 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:13.752112 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:13.752112 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:13.752112 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:13.752112 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:13.752112 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:13.752112 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:13.753216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:13.753216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:13.753216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:13.753216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:13.753216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:13.753216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:13.753216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:13.753216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:13.753216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:13.753216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:13.753216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:13.753216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:13.753216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 278/567] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:13.753216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b5391-5d16-4100-a288-309bea8f3570 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:13.840208 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec3563d-0092-4122-934b-69e3cc96e616 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:13.848350 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744b5391-5d16-4100-a288-309bea8f3570 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:13.872362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c387f-25e3-4ced-a5af-d4ae131970c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:13.872976 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c387f-25e3-4ced-a5af-d4ae131970c6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:13.873252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c387f-25e3-4ced-a5af-d4ae131970c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:13.873523 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c387f-25e3-4ced-a5af-d4ae131970c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:13.880911 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2b4020-35f8-4cf6-ba0b-64b83c216ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:13.882069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b4020-35f8-4cf6-ba0b-64b83c216ba7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:13.882602 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b4020-35f8-4cf6-ba0b-64b83c216ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:13.882876 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2b4020-35f8-4cf6-ba0b-64b83c216ba7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:13.887320 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c387f-25e3-4ced-a5af-d4ae131970c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:13.888782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c387f-25e3-4ced-a5af-d4ae131970c6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:13.889643 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b4020-35f8-4cf6-ba0b-64b83c216ba7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:13.891102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2b4020-35f8-4cf6-ba0b-64b83c216ba7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:13.902943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-0b2b4020-35f8-4cf6-ba0b-64b83c216ba7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:13.902943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:13.902943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:13.902943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:13.902943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:13.902943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:13.902943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:13.902943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:13.902943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:13.902943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:13.902943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:13.902943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:13.902943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:13.902943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:13.902943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:13.903887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:13.903887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:13.903887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:13.903887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:13.903887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:13.903887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:13.903887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:13.903887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:13.903887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:13.903887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:13.903887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:13.903887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:13.903887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:13.903887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:13.903887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:13.903887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:13.903887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:13.904799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:13.904799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:13.904799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:13.904799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:13.904799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:13.904799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:13.904799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:13.904799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:13.905234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-934c387f-25e3-4ced-a5af-d4ae131970c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:13.905234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:13.905234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:13.905234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:13.905234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:13.905234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:13.905234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:13.905234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:13.905234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:13.905234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:13.905234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:13.905234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:13.905234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:13.905234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:13.905234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:13.905234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:13.906128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:13.906128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:13.906128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:13.906128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:13.906128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:13.906128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:13.906128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:13.906128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:13.906128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:13.906128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:13.906128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:13.906128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:13.906128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:13.906128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:13.906128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:13.906128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:13.906128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:13.907026 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:13.907026 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:13.907026 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:13.907194 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 279/568] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:13.907194 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d25dc4-01d5-4217-8c28-4a034ff4dea3 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:13.907316 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 290/569] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:13.907391 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d25dc4-01d5-4217-8c28-4a034ff4dea3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:13.907391 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d25dc4-01d5-4217-8c28-4a034ff4dea3 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:13.907516 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c387f-25e3-4ced-a5af-d4ae131970c6 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:13.907584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 280/570] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:13.909184 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d25dc4-01d5-4217-8c28-4a034ff4dea3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:13.936282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:13.945919 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:14.010466 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d25dc4-01d5-4217-8c28-4a034ff4dea3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:14.011499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c387f-25e3-4ced-a5af-d4ae131970c6 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:14.044339 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6332fc-5db6-40d8-b1b0-1c156523f3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:14.044953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6332fc-5db6-40d8-b1b0-1c156523f3a7 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:14.045229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6332fc-5db6-40d8-b1b0-1c156523f3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:14.045497 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6332fc-5db6-40d8-b1b0-1c156523f3a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:14.045720 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41b758-b92e-4e61-9109-ca0a2ab3ba6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:14.046314 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41b758-b92e-4e61-9109-ca0a2ab3ba6d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:14.046594 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41b758-b92e-4e61-9109-ca0a2ab3ba6d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:14.046866 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf41b758-b92e-4e61-9109-ca0a2ab3ba6d None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:14.047521 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41b758-b92e-4e61-9109-ca0a2ab3ba6d None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:14.047819 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41b758-b92e-4e61-9109-ca0a2ab3ba6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:14.049181 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf41b758-b92e-4e61-9109-ca0a2ab3ba6d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:14.056151 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6332fc-5db6-40d8-b1b0-1c156523f3a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:14.056891 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 281/571] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:14.057578 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6332fc-5db6-40d8-b1b0-1c156523f3a7 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:14.057679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41b758-b92e-4e61-9109-ca0a2ab3ba6d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:14.072425 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-bc6332fc-5db6-40d8-b1b0-1c156523f3a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:14.072425 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:14.072425 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:14.072425 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:14.072425 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:14.072425 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:14.072425 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:14.072425 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:14.072425 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:14.072425 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:14.072425 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:14.072425 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:14.072425 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:14.072425 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:14.072425 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:14.072425 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:14.073576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:14.073576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:14.073576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:14.073576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:14.073576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:14.073576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:14.073576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:14.073576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:14.073576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:14.073576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:14.073576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:14.073576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:14.073576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:14.073576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:14.073576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:14.073576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:14.073576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:14.074554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:14.074554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:14.074554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:14.074554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 291/572] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:14.074795 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0e297-10d5-4b09-91b3-96c00b7855ef None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:14.075118 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0e297-10d5-4b09-91b3-96c00b7855ef None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:14.075313 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0e297-10d5-4b09-91b3-96c00b7855ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:14.093401 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-4cf0e297-10d5-4b09-91b3-96c00b7855ef None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:14.094670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4cf0e297-10d5-4b09-91b3-96c00b7855ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:14.155785 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:14.159410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 292/573] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:14.159545 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf41b758-b92e-4e61-9109-ca0a2ab3ba6d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:14.160215 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0e297-10d5-4b09-91b3-96c00b7855ef None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:14.163258 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:14.194814 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6b06f-3cd6-45f3-9a43-07c43e1b40f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:14.195411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6b06f-3cd6-45f3-9a43-07c43e1b40f0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:14.195692 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6b06f-3cd6-45f3-9a43-07c43e1b40f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:14.195964 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c6b06f-3cd6-45f3-9a43-07c43e1b40f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:14.196681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6b06f-3cd6-45f3-9a43-07c43e1b40f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:14.196952 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6b06f-3cd6-45f3-9a43-07c43e1b40f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:14.198411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c6b06f-3cd6-45f3-9a43-07c43e1b40f0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:14.210163 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 282/574] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:14.210947 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6b06f-3cd6-45f3-9a43-07c43e1b40f0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:14.277019 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0e297-10d5-4b09-91b3-96c00b7855ef None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:14.311458 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c6b06f-3cd6-45f3-9a43-07c43e1b40f0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:14.312893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54b235-df4d-4489-86e6-b583402860e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:14.313454 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54b235-df4d-4489-86e6-b583402860e4 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:14.313778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54b235-df4d-4489-86e6-b583402860e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:14.314697 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b54b235-df4d-4489-86e6-b583402860e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:14.314697 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54b235-df4d-4489-86e6-b583402860e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:14.314965 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54b235-df4d-4489-86e6-b583402860e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:14.316318 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b54b235-df4d-4489-86e6-b583402860e4 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:14.328344 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 293/575] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:14.330899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54b235-df4d-4489-86e6-b583402860e4 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:14.350329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c98d1-e97f-418b-96e0-ec96c21898d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:14.351113 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c98d1-e97f-418b-96e0-ec96c21898d5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:14.351422 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c98d1-e97f-418b-96e0-ec96c21898d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:14.351808 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597c98d1-e97f-418b-96e0-ec96c21898d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:14.362800 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c98d1-e97f-418b-96e0-ec96c21898d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:14.364242 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597c98d1-e97f-418b-96e0-ec96c21898d5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:14.379837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-597c98d1-e97f-418b-96e0-ec96c21898d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:14.379837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:14.379837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:14.379837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:14.379837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:14.379837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:14.379837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:14.379837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:14.379837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:14.379837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:14.379837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:14.379837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:14.379837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:14.379837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:14.379837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:14.379837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:14.380796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:14.380796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:14.380796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:14.380796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:14.380796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:14.380796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:14.380796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:14.380796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:14.380796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:14.380796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:14.380796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:14.380796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:14.380796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:14.380796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:14.380796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:14.380796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:14.380796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:14.382581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:14.382581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:14.382581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:14.382581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 283/576] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:14.382581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c98d1-e97f-418b-96e0-ec96c21898d5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:14.398208 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:14.403677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:14.442042 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b54b235-df4d-4489-86e6-b583402860e4 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:14.475662 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e395bd-62f1-4c72-b6a6-0812e5da01bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:14.476266 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e395bd-62f1-4c72-b6a6-0812e5da01bd None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:14.476559 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e395bd-62f1-4c72-b6a6-0812e5da01bd None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:14.476831 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e395bd-62f1-4c72-b6a6-0812e5da01bd None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:14.477467 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e395bd-62f1-4c72-b6a6-0812e5da01bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:14.477805 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e395bd-62f1-4c72-b6a6-0812e5da01bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:14.479170 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e395bd-62f1-4c72-b6a6-0812e5da01bd None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:14.484537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597c98d1-e97f-418b-96e0-ec96c21898d5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:14.490545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 294/577] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:14.491850 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e395bd-62f1-4c72-b6a6-0812e5da01bd None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:14.522643 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915a559-e843-49bc-a0c0-3a33f9d06209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:14.523242 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915a559-e843-49bc-a0c0-3a33f9d06209 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:14.523517 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915a559-e843-49bc-a0c0-3a33f9d06209 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:14.523784 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5915a559-e843-49bc-a0c0-3a33f9d06209 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:14.524501 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915a559-e843-49bc-a0c0-3a33f9d06209 None admin] RBAC: Adding query filter params (role.id=b253c1f3cd6a4197a85ca5f672852073, scope.project.id=ad67761fec0a430181877e216e90e7d4, user.id=c00e78bf5e5c4db29c47dce1e87f3f5a) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:14.524804 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915a559-e843-49bc-a0c0-3a33f9d06209 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:14.526273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5915a559-e843-49bc-a0c0-3a33f9d06209 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:14.531514 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 284/578] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:14 2022] GET /identity/v3/role_assignments?user.id=c00e78bf5e5c4db29c47dce1e87f3f5a&scope.project.id=ad67761fec0a430181877e216e90e7d4&role.id=b253c1f3cd6a4197a85ca5f672852073 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:14.532226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915a559-e843-49bc-a0c0-3a33f9d06209 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:14.610593 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e395bd-62f1-4c72-b6a6-0812e5da01bd None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:14.618739 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:14.638788 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:14.646835 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5915a559-e843-49bc-a0c0-3a33f9d06209 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:14.650193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8465848-1485-4f1f-8a9a-a3b9ae0abc43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:14.650845 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8465848-1485-4f1f-8a9a-a3b9ae0abc43 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:14.651118 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8465848-1485-4f1f-8a9a-a3b9ae0abc43 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:14.651386 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8465848-1485-4f1f-8a9a-a3b9ae0abc43 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:14.658850 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8465848-1485-4f1f-8a9a-a3b9ae0abc43 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:14.660417 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8465848-1485-4f1f-8a9a-a3b9ae0abc43 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:14.673345 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-f8465848-1485-4f1f-8a9a-a3b9ae0abc43 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:14.673345 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:14.673345 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:14.673345 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:14.673345 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:14.673345 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:14.673345 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:14.673345 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:14.673345 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:14.673345 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:14.673345 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:14.673345 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:14.673345 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:14.673345 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:14.673345 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:14.674410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:14.674410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:14.674410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:14.674410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:14.674410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:14.674410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:14.674410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:14.674410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:14.674410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:14.674410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:14.674410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:14.674410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:14.674410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:14.674410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:14.674410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:14.674410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:14.674410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:14.675334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:14.675334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:14.675334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:14.675334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:14.675334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:14.675334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:14.675334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:14.675334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:14.677921 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 295/579] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:14.680679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8465848-1485-4f1f-8a9a-a3b9ae0abc43 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:14.688271 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e6d75-134f-426a-8020-13a9ae188b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:14.688888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e6d75-134f-426a-8020-13a9ae188b37 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:14.689164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e6d75-134f-426a-8020-13a9ae188b37 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:14.689431 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e6d75-134f-426a-8020-13a9ae188b37 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:14.690109 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e6d75-134f-426a-8020-13a9ae188b37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:14.690416 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e6d75-134f-426a-8020-13a9ae188b37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:14.691807 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e6d75-134f-426a-8020-13a9ae188b37 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:14.705802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 285/580] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:14.706144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e6d75-134f-426a-8020-13a9ae188b37 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:14.791861 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8465848-1485-4f1f-8a9a-a3b9ae0abc43 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:14.813153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e6d75-134f-426a-8020-13a9ae188b37 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:14.826335 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92817b6-895d-4a66-9bda-ceda49d065da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:14.826958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92817b6-895d-4a66-9bda-ceda49d065da None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:14.827232 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92817b6-895d-4a66-9bda-ceda49d065da None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:14.827495 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92817b6-895d-4a66-9bda-ceda49d065da None admin] PATH_INFO: `/v3/roles/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:14.837974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92817b6-895d-4a66-9bda-ceda49d065da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:14.843204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-d92817b6-895d-4a66-9bda-ceda49d065da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:14.843204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:14.843204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:14.843204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:14.843204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:14.843204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:14.843204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:14.843204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:14.843204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:14.843204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:14.843204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:14.843204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:14.843204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:14.843204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:14.843204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:14.843204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:14.844178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:14.844178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:14.844178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:14.844178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:14.844178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:14.844178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:14.844178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:14.844178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:14.844178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:14.844178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:14.844178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:14.844178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:14.844178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:14.844178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:14.844178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:14.844178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:14.845159 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:14.845159 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:14.845159 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:14.845159 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:14.845159 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:14.845159 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:14.845159 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:14.845159 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:14.845159 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:14.845159 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:14.845159 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:14.845159 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:14.849064 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 296/581] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:14.849809 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92817b6-895d-4a66-9bda-ceda49d065da None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:14.852065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b97f88-c4c9-4977-9a20-a84a4094c57b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:14.852701 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b97f88-c4c9-4977-9a20-a84a4094c57b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:14.853002 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b97f88-c4c9-4977-9a20-a84a4094c57b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:14.853244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b97f88-c4c9-4977-9a20-a84a4094c57b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:14.856162 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:14.862007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b97f88-c4c9-4977-9a20-a84a4094c57b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:14.863450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b97f88-c4c9-4977-9a20-a84a4094c57b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:14.875730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-f5b97f88-c4c9-4977-9a20-a84a4094c57b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 19:44:14.875730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:14.875730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:14.875730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:14.875730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:14.875730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:14.875730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:14.875730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:14.875730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:14.875730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:14.875730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:14.875730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:14.875730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:14.875730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:14.875730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:14.875730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:14.876705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:14.876705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:14.876705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:14.876705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:14.876705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:14.876705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:14.876705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:14.876705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:14.876705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:14.876705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:14.876705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:14.876705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:14.876705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:14.876705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:14.876705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:14.876705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:14.876705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:14.876705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:14.882965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:14.882965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:14.882965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:14.882965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:14.882965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:14.882965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:14.882965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:14.882965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:14.882965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 19:44:14.882965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:14.882965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 286/582] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:14 2022] GET /identity/v3/users/glance => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:14.882965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b97f88-c4c9-4977-9a20-a84a4094c57b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:14.908308 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:14.963459 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92817b6-895d-4a66-9bda-ceda49d065da None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:14.992110 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b97f88-c4c9-4977-9a20-a84a4094c57b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:15.008055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8270d48-2976-4a72-a017-809d76f1485b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:15.008055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8270d48-2976-4a72-a017-809d76f1485b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:15.008055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8270d48-2976-4a72-a017-809d76f1485b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:15.008055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8270d48-2976-4a72-a017-809d76f1485b None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:15.008451 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8270d48-2976-4a72-a017-809d76f1485b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:15.008451 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8270d48-2976-4a72-a017-809d76f1485b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:15.008451 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8270d48-2976-4a72-a017-809d76f1485b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:15.020909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 297/583] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:15.021794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8270d48-2976-4a72-a017-809d76f1485b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:15.027791 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0862f-1504-4c0f-8beb-790a5b203eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:15.028413 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0862f-1504-4c0f-8beb-790a5b203eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:15.028685 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0862f-1504-4c0f-8beb-790a5b203eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:15.028952 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c0862f-1504-4c0f-8beb-790a5b203eb3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:15.037206 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0862f-1504-4c0f-8beb-790a5b203eb3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:15.039298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c0862f-1504-4c0f-8beb-790a5b203eb3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:15.050450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-a4c0862f-1504-4c0f-8beb-790a5b203eb3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:44:15.050450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:15.050450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:15.050450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:15.050450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:15.050450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:15.050450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:15.050450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:15.050450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:15.050450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:15.050450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:15.050450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:15.050450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:15.050450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:15.050450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:15.050450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:15.051549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:15.051549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:15.051549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:15.051549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:15.051549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:15.051549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:15.051549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:15.051549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:15.051549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:15.051549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:15.051549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:15.051549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:15.051549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:15.051549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:15.051549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:15.051549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:15.051549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:15.051549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:15.053106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:15.053106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:15.053106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:15.053106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:15.053106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:15.053106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:15.053106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:15.053106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:15.053106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:44:15.053106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:15.053106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 287/584] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:15.053106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0862f-1504-4c0f-8beb-790a5b203eb3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:15.110752 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:15.136997 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8270d48-2976-4a72-a017-809d76f1485b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:15.140460 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:15.156538 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c0862f-1504-4c0f-8beb-790a5b203eb3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:15.174684 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f8740-c025-4f51-a388-9ffa192f307a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:15.175743 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f8740-c025-4f51-a388-9ffa192f307a None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:15.176301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f8740-c025-4f51-a388-9ffa192f307a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:15.177002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20f8740-c025-4f51-a388-9ffa192f307a None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:15.177659 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f8740-c025-4f51-a388-9ffa192f307a None admin] RBAC: Adding query filter params (name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:15.177988 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f8740-c025-4f51-a388-9ffa192f307a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:15.179381 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20f8740-c025-4f51-a388-9ffa192f307a None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:15.188126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 298/585] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:15.188739 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f8740-c025-4f51-a388-9ffa192f307a None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:15.195313 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f06e7-be8c-4087-93fb-d09b52fb4142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:15.195919 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f06e7-be8c-4087-93fb-d09b52fb4142 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:15.196194 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f06e7-be8c-4087-93fb-d09b52fb4142 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:15.196460 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577f06e7-be8c-4087-93fb-d09b52fb4142 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:15.197181 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f06e7-be8c-4087-93fb-d09b52fb4142 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:15.197484 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f06e7-be8c-4087-93fb-d09b52fb4142 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:15.198935 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577f06e7-be8c-4087-93fb-d09b52fb4142 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:15.221350 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 288/586] 10.222.0.59 () {56 vars in 1137 bytes} [Tue Sep 13 19:44:15 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:15.221350 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f06e7-be8c-4087-93fb-d09b52fb4142 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:15.302071 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20f8740-c025-4f51-a388-9ffa192f307a None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:15.320515 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577f06e7-be8c-4087-93fb-d09b52fb4142 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:15.343002 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:15.363360 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6fe69b-f0ec-439b-b93e-cc92a03c0697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:15.363956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fe69b-f0ec-439b-b93e-cc92a03c0697 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:15.364231 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fe69b-f0ec-439b-b93e-cc92a03c0697 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:15.364499 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6fe69b-f0ec-439b-b93e-cc92a03c0697 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:15.365211 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6fe69b-f0ec-439b-b93e-cc92a03c0697 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:15.365511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6fe69b-f0ec-439b-b93e-cc92a03c0697 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:15.366123 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b08fa-18ba-4f96-aa9f-59fa3eaf60e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:15.366782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b08fa-18ba-4f96-aa9f-59fa3eaf60e0 None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:15.366995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6fe69b-f0ec-439b-b93e-cc92a03c0697 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:15.367092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b08fa-18ba-4f96-aa9f-59fa3eaf60e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:15.367325 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b08fa-18ba-4f96-aa9f-59fa3eaf60e0 None admin] PATH_INFO: `/v3/projects/ad67761fec0a430181877e216e90e7d4/users/3919b24291f54df99a9da0f5d3164ccf/roles/b253c1f3cd6a4197a85ca5f672852073` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:15.389245 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 289/587] 10.222.0.59 () {56 vars in 1137 bytes} [Tue Sep 13 19:44:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:15.389484 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b08fa-18ba-4f96-aa9f-59fa3eaf60e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad67761fec0a430181877e216e90e7d4, user_id=3919b24291f54df99a9da0f5d3164ccf, role_id=b253c1f3cd6a4197a85ca5f672852073)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:15.389582 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6fe69b-f0ec-439b-b93e-cc92a03c0697 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:15.389668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b08fa-18ba-4f96-aa9f-59fa3eaf60e0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:15.482882 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 299/588] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Sep 13 19:44:15 2022] PUT /identity/v3/projects/ad67761fec0a430181877e216e90e7d4/users/3919b24291f54df99a9da0f5d3164ccf/roles/b253c1f3cd6a4197a85ca5f672852073 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:44:15.483785 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b08fa-18ba-4f96-aa9f-59fa3eaf60e0 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:15.494655 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6fe69b-f0ec-439b-b93e-cc92a03c0697 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:15.514778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:15.539441 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1559ed-37e6-4090-b01e-4a80dc5dacf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:15.540081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1559ed-37e6-4090-b01e-4a80dc5dacf1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:15.540352 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1559ed-37e6-4090-b01e-4a80dc5dacf1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:15.540617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1559ed-37e6-4090-b01e-4a80dc5dacf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:15.561354 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1559ed-37e6-4090-b01e-4a80dc5dacf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:15.563784 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1559ed-37e6-4090-b01e-4a80dc5dacf1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:15.586653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-6d1559ed-37e6-4090-b01e-4a80dc5dacf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:15.586653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:15.586653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:15.586653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:15.586653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:15.586653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:15.586653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:15.586653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:15.586653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:15.586653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:15.586653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:15.586653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:15.586653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:15.586653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:15.586653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:15.586653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:15.587724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:15.587724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:15.587724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:15.587724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:15.587724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:15.587724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:15.587724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:15.587724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:15.587724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:15.587724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:15.587724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:15.587724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:15.587724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:15.587724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:15.587724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:15.587724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:15.587724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:15.588631 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:15.588631 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:15.588631 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:15.591326 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 290/589] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:15.592509 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1559ed-37e6-4090-b01e-4a80dc5dacf1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:15.624356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b08fa-18ba-4f96-aa9f-59fa3eaf60e0 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:15.626457 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:15.666041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826d18e-a6e5-4e26-b42b-50eadde83d05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:15.666821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826d18e-a6e5-4e26-b42b-50eadde83d05 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:15.667196 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826d18e-a6e5-4e26-b42b-50eadde83d05 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:15.667585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826d18e-a6e5-4e26-b42b-50eadde83d05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:15.679961 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826d18e-a6e5-4e26-b42b-50eadde83d05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:15.681402 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826d18e-a6e5-4e26-b42b-50eadde83d05 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:15.696930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-6826d18e-a6e5-4e26-b42b-50eadde83d05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:15.696930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:15.696930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:15.696930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:15.696930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:15.696930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:15.696930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:15.696930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:15.696930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:15.696930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:15.696930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:15.696930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:15.696930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:15.696930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:15.696930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:15.696930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:15.698126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:15.698126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:15.698126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:15.698126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:15.698126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:15.698126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:15.698126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:15.698126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:15.698126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:15.698126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:15.698126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:15.698126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:15.698126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:15.698126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:15.698126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:15.698126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:15.698126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:15.699288 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:15.699288 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:15.699288 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:15.699288 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 300/590] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:15.699288 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826d18e-a6e5-4e26-b42b-50eadde83d05 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:15.735033 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1559ed-37e6-4090-b01e-4a80dc5dacf1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:15.776623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:15.782357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f2af7-ed9c-47e1-8f51-58dd9ce85e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:15.782983 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f2af7-ed9c-47e1-8f51-58dd9ce85e7e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:15.783258 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f2af7-ed9c-47e1-8f51-58dd9ce85e7e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:15.783568 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7f2af7-ed9c-47e1-8f51-58dd9ce85e7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:15.798090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f2af7-ed9c-47e1-8f51-58dd9ce85e7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:15.800075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7f2af7-ed9c-47e1-8f51-58dd9ce85e7e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:15.812358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826d18e-a6e5-4e26-b42b-50eadde83d05 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:15.818700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-9e7f2af7-ed9c-47e1-8f51-58dd9ce85e7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:15.818700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:15.818700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:15.818700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:15.818700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:15.818700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:15.818700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:15.818700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:15.818700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:15.818700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:15.818700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:15.818700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:15.818700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:15.818700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:15.818700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:15.818700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:15.820751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:15.820751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:15.820751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:15.820751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:15.820751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:15.820751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:15.820751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:15.820751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:15.820751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:15.820751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:15.820751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:15.820751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:15.820751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:15.820751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:15.820751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:15.820751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:15.820751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:15.822939 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:15.822939 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:15.822939 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:15.822939 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 291/591] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:15.827411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f2af7-ed9c-47e1-8f51-58dd9ce85e7e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:15.853554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aade3bf-2a09-4736-8931-16fcee57d444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:15.854350 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aade3bf-2a09-4736-8931-16fcee57d444 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:15.854729 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aade3bf-2a09-4736-8931-16fcee57d444 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:15.855106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aade3bf-2a09-4736-8931-16fcee57d444 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:15.855860 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aade3bf-2a09-4736-8931-16fcee57d444 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:15.856299 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aade3bf-2a09-4736-8931-16fcee57d444 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:15.857850 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aade3bf-2a09-4736-8931-16fcee57d444 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:15.871327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 301/592] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:15.872276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aade3bf-2a09-4736-8931-16fcee57d444 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:15.936483 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:15.972044 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7f2af7-ed9c-47e1-8f51-58dd9ce85e7e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:15.988179 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aade3bf-2a09-4736-8931-16fcee57d444 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:16.023200 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dcfee-1d3b-45ed-b7bc-c6dadba55bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:16.023200 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dcfee-1d3b-45ed-b7bc-c6dadba55bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:16.023200 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dcfee-1d3b-45ed-b7bc-c6dadba55bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:16.023200 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097dcfee-1d3b-45ed-b7bc-c6dadba55bf2 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:16.023608 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dcfee-1d3b-45ed-b7bc-c6dadba55bf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:16.023608 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dcfee-1d3b-45ed-b7bc-c6dadba55bf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:16.023608 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097dcfee-1d3b-45ed-b7bc-c6dadba55bf2 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:16.024190 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:16.032265 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afc5ed-3f15-4678-905e-264ed6291fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:16.032941 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afc5ed-3f15-4678-905e-264ed6291fae None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:16.033216 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afc5ed-3f15-4678-905e-264ed6291fae None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:16.033965 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8afc5ed-3f15-4678-905e-264ed6291fae None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:16.034297 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afc5ed-3f15-4678-905e-264ed6291fae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:16.034596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afc5ed-3f15-4678-905e-264ed6291fae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:16.041857 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8afc5ed-3f15-4678-905e-264ed6291fae None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:16.042282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 292/593] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:16.043293 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dcfee-1d3b-45ed-b7bc-c6dadba55bf2 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:16.049596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 302/594] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:16.055359 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afc5ed-3f15-4678-905e-264ed6291fae None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:16.154685 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097dcfee-1d3b-45ed-b7bc-c6dadba55bf2 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:16.167693 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8afc5ed-3f15-4678-905e-264ed6291fae None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:16.192088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374003b-492f-4476-81e5-f3c66d52dbcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:16.192952 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374003b-492f-4476-81e5-f3c66d52dbcc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:16.193372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374003b-492f-4476-81e5-f3c66d52dbcc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:16.194139 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374003b-492f-4476-81e5-f3c66d52dbcc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:16.196368 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:16.202769 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374003b-492f-4476-81e5-f3c66d52dbcc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:16.204469 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4374003b-492f-4476-81e5-f3c66d52dbcc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:16.208163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4e0a3-4b8d-4991-8c49-856bd5e67636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:16.209475 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4e0a3-4b8d-4991-8c49-856bd5e67636 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:16.209475 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4e0a3-4b8d-4991-8c49-856bd5e67636 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:16.209475 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a4e0a3-4b8d-4991-8c49-856bd5e67636 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:16.216876 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4e0a3-4b8d-4991-8c49-856bd5e67636 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:16.218395 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a4e0a3-4b8d-4991-8c49-856bd5e67636 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:16.218590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-4374003b-492f-4476-81e5-f3c66d52dbcc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 19:44:16.218590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:16.218590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:16.218590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:16.218590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:16.218590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:16.218590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:16.218590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:16.218590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:16.218590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:16.218590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:16.218590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:16.218590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:16.218590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:16.218590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:16.218590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:16.219659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:16.219659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:16.219659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:16.219659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:16.219659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:16.219659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:16.219659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:16.219659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:16.219659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:16.219659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:16.219659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:16.219659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:16.219659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:16.219659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:16.219659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:16.219659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:16.219659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:16.219659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:16.220736 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:16.220736 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:16.220736 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:16.220736 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:16.220736 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:16.220736 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:16.220736 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:16.220736 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:16.220736 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 19:44:16.220736 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:16.222816 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 293/595] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:16.223811 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374003b-492f-4476-81e5-f3c66d52dbcc None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:16.234623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-83a4e0a3-4b8d-4991-8c49-856bd5e67636 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:16.234623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:16.234623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:16.234623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:16.234623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:16.234623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:16.234623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:16.234623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:16.234623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:16.234623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:16.234623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:16.234623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:16.234623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:16.234623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:16.234623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:16.235561 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:16.235561 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:16.235561 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:16.235561 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:16.235561 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:16.235561 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:16.235561 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:16.235561 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:16.235561 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:16.235561 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:16.235561 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:16.235561 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:16.235561 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:16.235561 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:16.235561 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:16.235561 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:16.235561 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:16.236458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:16.236458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:16.236458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:16.236458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:16.236458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:16.236458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:16.236458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:16.236458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:16.236458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 303/596] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:16.236946 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4e0a3-4b8d-4991-8c49-856bd5e67636 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:16.295623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:16.338465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4374003b-492f-4476-81e5-f3c66d52dbcc None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:16.360781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a4e0a3-4b8d-4991-8c49-856bd5e67636 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:16.376029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7d2fe-49d5-41b9-988f-ff9ae44c59a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:16.376984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7d2fe-49d5-41b9-988f-ff9ae44c59a3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:16.377471 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7d2fe-49d5-41b9-988f-ff9ae44c59a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:16.378003 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b7d2fe-49d5-41b9-988f-ff9ae44c59a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:16.385275 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7d2fe-49d5-41b9-988f-ff9ae44c59a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:16.386944 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b7d2fe-49d5-41b9-988f-ff9ae44c59a3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:16.399557 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-a4b7d2fe-49d5-41b9-988f-ff9ae44c59a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:16.399557 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:16.399557 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:16.399557 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:16.399557 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:16.399557 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:16.399557 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:16.399557 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:16.399557 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:16.399557 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:16.399557 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:16.399557 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:16.399557 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:16.399557 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:16.399557 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:16.400456 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:16.400456 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:16.400456 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:16.400456 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:16.400456 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:16.400456 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:16.400456 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:16.400456 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:16.400456 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:16.400456 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:16.400456 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:16.400456 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:16.400456 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:16.400456 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:16.400456 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:16.400456 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:16.400456 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:16.401450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:16.401450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:16.401450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:16.401450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:16.401450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:16.401450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:16.401450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:16.401450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:16.407736 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 294/597] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:16.407872 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21b303-62bd-49b9-80f5-f80d8314470c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:16.407872 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21b303-62bd-49b9-80f5-f80d8314470c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:16.407872 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21b303-62bd-49b9-80f5-f80d8314470c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:16.407872 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae21b303-62bd-49b9-80f5-f80d8314470c None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:16.408170 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21b303-62bd-49b9-80f5-f80d8314470c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:16.408170 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21b303-62bd-49b9-80f5-f80d8314470c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:16.408311 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7d2fe-49d5-41b9-988f-ff9ae44c59a3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:16.408387 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae21b303-62bd-49b9-80f5-f80d8314470c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:16.431697 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 304/598] 10.222.0.59 () {56 vars in 1139 bytes} [Tue Sep 13 19:44:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:16.432650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21b303-62bd-49b9-80f5-f80d8314470c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:16.477845 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:16.536864 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b7d2fe-49d5-41b9-988f-ff9ae44c59a3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:16.558115 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae21b303-62bd-49b9-80f5-f80d8314470c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:16.567130 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:16.576473 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc2c63-70ad-4d4e-902a-eec423e1527f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:16.577442 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc2c63-70ad-4d4e-902a-eec423e1527f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:16.597465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc2c63-70ad-4d4e-902a-eec423e1527f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:16.597465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabc2c63-70ad-4d4e-902a-eec423e1527f None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:16.597465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc2c63-70ad-4d4e-902a-eec423e1527f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:16.597465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc2c63-70ad-4d4e-902a-eec423e1527f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:16.597465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabc2c63-70ad-4d4e-902a-eec423e1527f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:16.597465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 295/599] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:16.598474 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc2c63-70ad-4d4e-902a-eec423e1527f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:16.606485 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f0b87-4557-472e-af9b-e68c3a076c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:16.607225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f0b87-4557-472e-af9b-e68c3a076c75 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:16.607641 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f0b87-4557-472e-af9b-e68c3a076c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:16.607980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764f0b87-4557-472e-af9b-e68c3a076c75 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:16.608748 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f0b87-4557-472e-af9b-e68c3a076c75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:16.609120 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f0b87-4557-472e-af9b-e68c3a076c75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:16.611425 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764f0b87-4557-472e-af9b-e68c3a076c75 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:16.632483 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 305/600] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:16.632483 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f0b87-4557-472e-af9b-e68c3a076c75 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:16.710384 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabc2c63-70ad-4d4e-902a-eec423e1527f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:16.724382 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:16.744236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e7559-9d30-4c03-802a-e26dc7419ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:16.744862 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e7559-9d30-4c03-802a-e26dc7419ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:16.745141 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e7559-9d30-4c03-802a-e26dc7419ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:16.745417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8e7559-9d30-4c03-802a-e26dc7419ac9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:16.748274 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764f0b87-4557-472e-af9b-e68c3a076c75 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:16.755224 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e7559-9d30-4c03-802a-e26dc7419ac9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:16.757478 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8e7559-9d30-4c03-802a-e26dc7419ac9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:16.774451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-da8e7559-9d30-4c03-802a-e26dc7419ac9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:16.774451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:16.774451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:16.774451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:16.774451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:16.774451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:16.774451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:16.774451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:16.774451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:16.774451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:16.774451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:16.774451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:16.774451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:16.774451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:16.774451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:16.774451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:16.775415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:16.775415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:16.775415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:16.775415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:16.775415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:16.775415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:16.775415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:16.775415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:16.775415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:16.775415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:16.775415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:16.775415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:16.775415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:16.775415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:16.775415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:16.775415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:16.775415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:16.776314 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:16.776314 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:16.776314 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:16.776314 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 296/601] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:16.776314 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e7559-9d30-4c03-802a-e26dc7419ac9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:16.789668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c4daf-0568-4617-943f-83f02e58f677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:16.790357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c4daf-0568-4617-943f-83f02e58f677 None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:16.790634 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c4daf-0568-4617-943f-83f02e58f677 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:16.790904 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c4daf-0568-4617-943f-83f02e58f677 None admin] PATH_INFO: `/v3/projects/ad67761fec0a430181877e216e90e7d4/users/44093d63c1aa45b781d2ce30239ed598/roles/b253c1f3cd6a4197a85ca5f672852073` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:16.805660 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c4daf-0568-4617-943f-83f02e58f677 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad67761fec0a430181877e216e90e7d4, user_id=44093d63c1aa45b781d2ce30239ed598, role_id=b253c1f3cd6a4197a85ca5f672852073)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:16.807110 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c4daf-0568-4617-943f-83f02e58f677 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:16.878196 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8e7559-9d30-4c03-802a-e26dc7419ac9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:16.885875 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 306/602] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Sep 13 19:44:16 2022] PUT /identity/v3/projects/ad67761fec0a430181877e216e90e7d4/users/44093d63c1aa45b781d2ce30239ed598/roles/b253c1f3cd6a4197a85ca5f672852073 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:44:16.885875 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11515da-fbcf-4b43-ac4a-fc8f90538c7b None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:16.885875 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11515da-fbcf-4b43-ac4a-fc8f90538c7b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:16.885875 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11515da-fbcf-4b43-ac4a-fc8f90538c7b None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:16.885875 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 307/603] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:16.885875 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11515da-fbcf-4b43-ac4a-fc8f90538c7b None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:16.908312 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:16.938874 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84254fe-8fd2-4e42-ac09-596c6b64a954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:16.939566 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84254fe-8fd2-4e42-ac09-596c6b64a954 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:16.939845 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84254fe-8fd2-4e42-ac09-596c6b64a954 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:16.940117 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84254fe-8fd2-4e42-ac09-596c6b64a954 None admin] PATH_INFO: `/v3/projects/ad67761fec0a430181877e216e90e7d4/users/fbdff73734304485ac9884d6b44ea73c/roles/b253c1f3cd6a4197a85ca5f672852073` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:16.963207 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84254fe-8fd2-4e42-ac09-596c6b64a954 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad67761fec0a430181877e216e90e7d4, user_id=fbdff73734304485ac9884d6b44ea73c, role_id=b253c1f3cd6a4197a85ca5f672852073)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:16.965163 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84254fe-8fd2-4e42-ac09-596c6b64a954 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:17.008658 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11515da-fbcf-4b43-ac4a-fc8f90538c7b None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:17.045007 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7f7df-91b7-4f2d-ac40-3f4da318f522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:17.045620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7f7df-91b7-4f2d-ac40-3f4da318f522 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:17.045922 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7f7df-91b7-4f2d-ac40-3f4da318f522 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:17.046188 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a7f7df-91b7-4f2d-ac40-3f4da318f522 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:17.046835 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7f7df-91b7-4f2d-ac40-3f4da318f522 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:17.047155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7f7df-91b7-4f2d-ac40-3f4da318f522 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:17.048534 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a7f7df-91b7-4f2d-ac40-3f4da318f522 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:17.064973 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 297/604] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Sep 13 19:44:16 2022] PUT /identity/v3/projects/ad67761fec0a430181877e216e90e7d4/users/fbdff73734304485ac9884d6b44ea73c/roles/b253c1f3cd6a4197a85ca5f672852073 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:44:17.071533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c9484-150d-4d50-b14f-72634a12bb48 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:17.071533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c9484-150d-4d50-b14f-72634a12bb48 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:17.071533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1c9484-150d-4d50-b14f-72634a12bb48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:17.071759 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 308/605] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:17.071759 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7f7df-91b7-4f2d-ac40-3f4da318f522 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:17.089802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8c1c9484-150d-4d50-b14f-72634a12bb48 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:17.091407 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8c1c9484-150d-4d50-b14f-72634a12bb48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:17.106699 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:17.177935 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:17.197908 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 298/606] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:17.209721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a7f7df-91b7-4f2d-ac40-3f4da318f522 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:17.251949 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17707f62-16e5-49f8-a630-f6ba8fb48fe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:17.252898 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17707f62-16e5-49f8-a630-f6ba8fb48fe2 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:17.253321 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17707f62-16e5-49f8-a630-f6ba8fb48fe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:17.253763 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17707f62-16e5-49f8-a630-f6ba8fb48fe2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:17.262821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17707f62-16e5-49f8-a630-f6ba8fb48fe2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:17.264718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17707f62-16e5-49f8-a630-f6ba8fb48fe2 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:17.278489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-17707f62-16e5-49f8-a630-f6ba8fb48fe2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:17.278489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:17.278489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:17.278489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:17.278489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:17.278489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:17.278489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:17.278489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:17.278489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:17.278489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:17.278489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:17.278489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:17.278489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:17.278489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:17.278489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:17.279730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:17.279730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:17.279730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:17.279730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:17.279730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:17.279730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:17.279730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:17.279730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:17.279730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:17.279730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:17.279730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:17.279730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:17.279730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:17.279730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:17.279730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:17.279730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:17.279730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:17.280841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:17.280841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:17.280841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:17.280841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:17.280841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:17.280841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:17.280841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:17.280841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:17.283071 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 309/607] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:17.289505 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c9484-150d-4d50-b14f-72634a12bb48 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:17.408852 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1c9484-150d-4d50-b14f-72634a12bb48 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:17.444731 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c7a17-5b23-4aa1-809d-02c876c04f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:17.445338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c7a17-5b23-4aa1-809d-02c876c04f17 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:17.445614 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c7a17-5b23-4aa1-809d-02c876c04f17 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:17.445909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8c7a17-5b23-4aa1-809d-02c876c04f17 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:17.446598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c7a17-5b23-4aa1-809d-02c876c04f17 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:17.446899 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c7a17-5b23-4aa1-809d-02c876c04f17 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:17.448325 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8c7a17-5b23-4aa1-809d-02c876c04f17 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:17.460418 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 299/608] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:17.466028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17707f62-16e5-49f8-a630-f6ba8fb48fe2 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:17.531988 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c7a17-5b23-4aa1-809d-02c876c04f17 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:17.550005 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:17.590921 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17707f62-16e5-49f8-a630-f6ba8fb48fe2 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:17.660654 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28052962-a581-473d-917f-7aa790b979cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:17.661334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28052962-a581-473d-917f-7aa790b979cf None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:17.661615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28052962-a581-473d-917f-7aa790b979cf None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:17.661913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28052962-a581-473d-917f-7aa790b979cf None admin] PATH_INFO: `/v3/projects/ad67761fec0a430181877e216e90e7d4/users/b86b85c457d84ac99359ac93add704d2/roles/b253c1f3cd6a4197a85ca5f672852073` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:17.670053 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:17.682625 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28052962-a581-473d-917f-7aa790b979cf None admin] RBAC: Authorizing `identity:create_grant(project_id=ad67761fec0a430181877e216e90e7d4, user_id=b86b85c457d84ac99359ac93add704d2, role_id=b253c1f3cd6a4197a85ca5f672852073)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:17.684253 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28052962-a581-473d-917f-7aa790b979cf None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:17.712832 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8c7a17-5b23-4aa1-809d-02c876c04f17 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:17.749894 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd015e4f-4338-4dbc-9b9a-c6cc15d083fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:17.750576 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd015e4f-4338-4dbc-9b9a-c6cc15d083fe None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:17.750936 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd015e4f-4338-4dbc-9b9a-c6cc15d083fe None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:17.751182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd015e4f-4338-4dbc-9b9a-c6cc15d083fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:17.763069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd015e4f-4338-4dbc-9b9a-c6cc15d083fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:17.776004 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 310/609] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Sep 13 19:44:17 2022] PUT /identity/v3/projects/ad67761fec0a430181877e216e90e7d4/users/b86b85c457d84ac99359ac93add704d2/roles/b253c1f3cd6a4197a85ca5f672852073 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:44:17.776210 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-cd015e4f-4338-4dbc-9b9a-c6cc15d083fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:17.776210 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:17.776210 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:17.776210 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:17.776210 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:17.776210 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:17.776210 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:17.776210 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:17.776210 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:17.776210 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:17.776210 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:17.776210 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:17.776210 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:17.776210 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:17.776210 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:17.776210 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:17.777096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:17.777096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:17.777096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:17.777096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:17.777096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:17.777096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:17.777096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:17.777096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:17.777096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:17.777096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:17.777096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:17.777096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:17.777096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:17.777096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:17.777096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:17.777096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:17.777991 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:17.777991 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:17.777991 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:17.777991 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:17.777991 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:17.777991 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:17.777991 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:17.777991 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:17.777991 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:17.777991 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:17.777991 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:17.777991 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:17.777991 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 300/610] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:17.791006 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28052962-a581-473d-917f-7aa790b979cf None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:17.846220 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4b7a4-1d67-43b7-8230-562545337a4b None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:17.846533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4b7a4-1d67-43b7-8230-562545337a4b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:17.846761 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e4b7a4-1d67-43b7-8230-562545337a4b None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:17.848310 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 301/611] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:44:17.863450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74304b6-2d64-4b60-ad9c-c15ecdddf18b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:17.863727 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74304b6-2d64-4b60-ad9c-c15ecdddf18b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:17.864000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74304b6-2d64-4b60-ad9c-c15ecdddf18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:17.906104 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f74304b6-2d64-4b60-ad9c-c15ecdddf18b None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:17.907318 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f74304b6-2d64-4b60-ad9c-c15ecdddf18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:17.928594 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28052962-a581-473d-917f-7aa790b979cf None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:17.976160 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83566496-302c-4606-9071-8e13786e95eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:17.976782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83566496-302c-4606-9071-8e13786e95eb None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:17.977616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83566496-302c-4606-9071-8e13786e95eb None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:17.977918 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83566496-302c-4606-9071-8e13786e95eb None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:17.978599 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83566496-302c-4606-9071-8e13786e95eb None admin] RBAC: Adding query filter params (name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:17.979638 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83566496-302c-4606-9071-8e13786e95eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:17.980267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83566496-302c-4606-9071-8e13786e95eb None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:17.997495 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 311/612] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:18.003861 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83566496-302c-4606-9071-8e13786e95eb None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:18.017864 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:18.027639 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 302/613] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:18.059120 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:18.111494 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83566496-302c-4606-9071-8e13786e95eb None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:18.147202 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6008c1-8362-4f1c-bd2a-9a51346c30d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:18.147830 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6008c1-8362-4f1c-bd2a-9a51346c30d3 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:18.148107 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6008c1-8362-4f1c-bd2a-9a51346c30d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:18.148382 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6008c1-8362-4f1c-bd2a-9a51346c30d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:18.159965 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6008c1-8362-4f1c-bd2a-9a51346c30d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:18.161395 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6008c1-8362-4f1c-bd2a-9a51346c30d3 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:18.175798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-2f6008c1-8362-4f1c-bd2a-9a51346c30d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:18.175798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:18.175798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:18.175798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:18.175798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:18.175798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:18.175798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:18.175798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:18.175798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:18.175798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:18.175798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:18.175798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:18.175798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:18.175798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:18.175798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:18.175798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:18.176779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:18.176779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:18.176779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:18.176779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:18.176779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:18.176779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:18.176779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:18.176779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:18.176779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:18.176779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:18.176779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:18.176779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:18.176779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:18.176779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:18.176779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:18.176779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:18.176779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:18.177674 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:18.177674 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:18.177674 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:18.177674 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 312/614] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:18.183349 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74304b6-2d64-4b60-ad9c-c15ecdddf18b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:18.312309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74304b6-2d64-4b60-ad9c-c15ecdddf18b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:18.340741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6008c1-8362-4f1c-bd2a-9a51346c30d3 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:18.347328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58095afd-2b50-4952-a22f-00f54605a3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:18.347933 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58095afd-2b50-4952-a22f-00f54605a3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:18.348207 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58095afd-2b50-4952-a22f-00f54605a3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:18.348471 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58095afd-2b50-4952-a22f-00f54605a3c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:18.349102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58095afd-2b50-4952-a22f-00f54605a3c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:18.349397 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58095afd-2b50-4952-a22f-00f54605a3c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:18.351307 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58095afd-2b50-4952-a22f-00f54605a3c7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:18.363249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 303/615] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:18.369151 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58095afd-2b50-4952-a22f-00f54605a3c7 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:18.453445 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:18.497458 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58095afd-2b50-4952-a22f-00f54605a3c7 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:18.510699 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:18.515767 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6008c1-8362-4f1c-bd2a-9a51346c30d3 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:18.538702 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c39eb-2245-4ff8-bdea-105f3d3b5370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:18.541082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c39eb-2245-4ff8-bdea-105f3d3b5370 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:18.541564 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c39eb-2245-4ff8-bdea-105f3d3b5370 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:18.542121 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12c39eb-2245-4ff8-bdea-105f3d3b5370 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:18.551624 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c39eb-2245-4ff8-bdea-105f3d3b5370 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:18.553996 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12c39eb-2245-4ff8-bdea-105f3d3b5370 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:18.566938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-c12c39eb-2245-4ff8-bdea-105f3d3b5370 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:44:18.566938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:18.566938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:18.566938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:18.566938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:18.566938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:18.566938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:18.566938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:18.566938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:18.566938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:18.566938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:18.566938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:18.566938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:18.566938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:18.566938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:18.566938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:18.567897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:18.567897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:18.567897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:18.567897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:18.567897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:18.567897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:18.567897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:18.567897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:18.567897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:18.567897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:18.567897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:18.567897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:18.567897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:18.567897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:18.567897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:18.567897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:18.567897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:18.567897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:18.568889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:18.568889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:18.568889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:18.568889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:18.568889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:18.568889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:18.568889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:18.568889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:18.568889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:44:18.568889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:18.578118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 304/616] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:44:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:18.578118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c39eb-2245-4ff8-bdea-105f3d3b5370 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:18.604665 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab3768-0aee-45e5-a883-e8cb6f935a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:18.605601 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab3768-0aee-45e5-a883-e8cb6f935a51 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:18.605946 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab3768-0aee-45e5-a883-e8cb6f935a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:18.606220 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ab3768-0aee-45e5-a883-e8cb6f935a51 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:18.617753 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ab3768-0aee-45e5-a883-e8cb6f935a51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:18.623195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-98ab3768-0aee-45e5-a883-e8cb6f935a51 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:18.623195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:18.623195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:18.623195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:18.623195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:18.623195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:18.623195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:18.623195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:18.623195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:18.623195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:18.623195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:18.623195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:18.623195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:18.623195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:18.623195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:18.623195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:18.624334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:18.624334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:18.624334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:18.624334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:18.624334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:18.624334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:18.624334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:18.624334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:18.624334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:18.624334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:18.624334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:18.624334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:18.624334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:18.624334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:18.624334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:18.624334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:18.625404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:18.625404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:18.625404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:18.625404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:18.625404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:18.625404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:18.625404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:18.625404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:18.625404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:18.625404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:18.625404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:18.625404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:18.626605 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 313/617] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:18.632625 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab3768-0aee-45e5-a883-e8cb6f935a51 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:18.778399 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12c39eb-2245-4ff8-bdea-105f3d3b5370 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:18.817020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:18.825160 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ab3768-0aee-45e5-a883-e8cb6f935a51 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:18.856463 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59f507-161d-49d5-a3b0-3fc8e10e07cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:18.857171 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59f507-161d-49d5-a3b0-3fc8e10e07cf None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:18.857452 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59f507-161d-49d5-a3b0-3fc8e10e07cf None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:18.857743 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab59f507-161d-49d5-a3b0-3fc8e10e07cf None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:18.858470 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab59f507-161d-49d5-a3b0-3fc8e10e07cf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:18.858867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab59f507-161d-49d5-a3b0-3fc8e10e07cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:18.860383 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab59f507-161d-49d5-a3b0-3fc8e10e07cf None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:18.867926 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20ea3a-fdb1-4e98-b293-fe653383fe03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:18.868580 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20ea3a-fdb1-4e98-b293-fe653383fe03 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:18.868864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20ea3a-fdb1-4e98-b293-fe653383fe03 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:18.869136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20ea3a-fdb1-4e98-b293-fe653383fe03 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:18.869832 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20ea3a-fdb1-4e98-b293-fe653383fe03 None admin] RBAC: Adding query filter params (name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:18.870256 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20ea3a-fdb1-4e98-b293-fe653383fe03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:18.871701 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd20ea3a-fdb1-4e98-b293-fe653383fe03 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:18.880511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 314/618] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:18.886799 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20ea3a-fdb1-4e98-b293-fe653383fe03 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:18.908520 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 305/619] 10.222.0.59 () {56 vars in 1135 bytes} [Tue Sep 13 19:44:18 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:18.913764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59f507-161d-49d5-a3b0-3fc8e10e07cf None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:18.926074 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:18.998890 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd20ea3a-fdb1-4e98-b293-fe653383fe03 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:19.065878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca39bd-e5fe-43b2-94a6-6b7cc8a5b0d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:19.066564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca39bd-e5fe-43b2-94a6-6b7cc8a5b0d8 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:19.066807 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca39bd-e5fe-43b2-94a6-6b7cc8a5b0d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:19.067138 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca39bd-e5fe-43b2-94a6-6b7cc8a5b0d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:19.088780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca39bd-e5fe-43b2-94a6-6b7cc8a5b0d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:19.090263 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca39bd-e5fe-43b2-94a6-6b7cc8a5b0d8 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:19.103805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab59f507-161d-49d5-a3b0-3fc8e10e07cf None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:19.124205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-c2ca39bd-e5fe-43b2-94a6-6b7cc8a5b0d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:19.124205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:19.124205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:19.124205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:19.124205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:19.124205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:19.124205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:19.124205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:19.124205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:19.124205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:19.124205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:19.124205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:19.124205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:19.124205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:19.124205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:19.124205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:19.125278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:19.125278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:19.125278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:19.125278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:19.125278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:19.125278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:19.125278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:19.125278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:19.125278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:19.125278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:19.125278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:19.125278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:19.125278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:19.125278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:19.125278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:19.125278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:19.125278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:19.126896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:19.126896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:19.126896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:19.126896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 315/620] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:19.135080 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca39bd-e5fe-43b2-94a6-6b7cc8a5b0d8 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:19.158249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7022d-017e-4f1f-865c-e30298bf2b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:19.158976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7022d-017e-4f1f-865c-e30298bf2b2a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:19.159310 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7022d-017e-4f1f-865c-e30298bf2b2a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:19.159582 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a7022d-017e-4f1f-865c-e30298bf2b2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:19.170587 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7022d-017e-4f1f-865c-e30298bf2b2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:19.172049 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a7022d-017e-4f1f-865c-e30298bf2b2a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:19.188338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-e1a7022d-017e-4f1f-865c-e30298bf2b2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:19.188338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:19.188338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:19.188338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:19.188338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:19.188338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:19.188338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:19.188338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:19.188338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:19.188338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:19.188338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:19.188338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:19.188338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:19.188338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:19.188338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:19.188338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:19.189328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:19.189328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:19.189328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:19.189328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:19.189328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:19.189328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:19.189328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:19.189328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:19.189328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:19.189328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:19.189328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:19.189328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:19.189328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:19.189328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:19.189328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:19.189328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:19.189328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:19.190830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:19.190830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:19.190830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:19.190830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 306/621] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:19.196020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7022d-017e-4f1f-865c-e30298bf2b2a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:19.250039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:19.268901 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:19.295797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca39bd-e5fe-43b2-94a6-6b7cc8a5b0d8 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:19.332092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb39c64-713f-4adf-a55e-59d66088d887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:19.332626 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb39c64-713f-4adf-a55e-59d66088d887 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:19.332903 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb39c64-713f-4adf-a55e-59d66088d887 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:19.333173 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb39c64-713f-4adf-a55e-59d66088d887 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:19.333853 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb39c64-713f-4adf-a55e-59d66088d887 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:19.334180 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb39c64-713f-4adf-a55e-59d66088d887 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:19.335613 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb39c64-713f-4adf-a55e-59d66088d887 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:19.349387 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 316/622] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:19.355114 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb39c64-713f-4adf-a55e-59d66088d887 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:19.401681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a7022d-017e-4f1f-865c-e30298bf2b2a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:19.474332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac8469-383c-4c4e-955a-5210c5e07d11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:19.475858 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac8469-383c-4c4e-955a-5210c5e07d11 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:19.476139 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac8469-383c-4c4e-955a-5210c5e07d11 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:19.476409 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac8469-383c-4c4e-955a-5210c5e07d11 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:19.477054 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac8469-383c-4c4e-955a-5210c5e07d11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:19.477351 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac8469-383c-4c4e-955a-5210c5e07d11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:19.481088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac8469-383c-4c4e-955a-5210c5e07d11 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:19.508746 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 307/623] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:19.519002 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc5b23-0b0c-4d8d-9f86-8647033da7f9 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:19.519289 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc5b23-0b0c-4d8d-9f86-8647033da7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:19.519564 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9cc5b23-0b0c-4d8d-9f86-8647033da7f9 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:19.521128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 308/624] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:44:19.526834 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b7e6a-5823-45b4-95d3-4c3862dafb3a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:19.527110 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b7e6a-5823-45b4-95d3-4c3862dafb3a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:19.527379 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924b7e6a-5823-45b4-95d3-4c3862dafb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:19.535751 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb39c64-713f-4adf-a55e-59d66088d887 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:19.545394 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-924b7e6a-5823-45b4-95d3-4c3862dafb3a None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:19.546641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-924b7e6a-5823-45b4-95d3-4c3862dafb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:19.575658 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80422c-f132-4921-a3ba-e044a9c967a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:19.576287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80422c-f132-4921-a3ba-e044a9c967a4 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:19.576565 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80422c-f132-4921-a3ba-e044a9c967a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:19.576896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b80422c-f132-4921-a3ba-e044a9c967a4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:19.579937 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:19.585955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80422c-f132-4921-a3ba-e044a9c967a4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:19.587546 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b80422c-f132-4921-a3ba-e044a9c967a4 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:19.601379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-8b80422c-f132-4921-a3ba-e044a9c967a4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:44:19.601379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:19.601379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:19.601379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:19.601379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:19.601379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:19.601379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:19.601379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:19.601379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:19.601379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:19.601379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:19.601379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:19.601379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:19.601379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:19.601379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:19.601379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:19.602452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:19.602452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:19.602452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:19.602452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:19.602452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:19.602452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:19.602452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:19.602452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:19.602452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:19.602452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:19.602452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:19.602452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:19.602452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:19.602452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:19.602452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:19.602452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:19.602452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:19.602452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:19.603507 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:19.603507 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:19.603507 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:19.603507 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:19.603507 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:19.603507 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:19.603507 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:19.603507 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:19.603507 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:44:19.603507 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:19.603507 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 317/625] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Sep 13 19:44:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:19.604140 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80422c-f132-4921-a3ba-e044a9c967a4 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:19.625801 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 309/626] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:44:19.626973 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b7e6a-5823-45b4-95d3-4c3862dafb3a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:19.666040 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:19.770541 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b80422c-f132-4921-a3ba-e044a9c967a4 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:19.822579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9420d-32f0-43a8-93fc-48319b01037d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:19.823271 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9420d-32f0-43a8-93fc-48319b01037d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:19.823623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9420d-32f0-43a8-93fc-48319b01037d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:19.823862 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9420d-32f0-43a8-93fc-48319b01037d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:19.830658 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924b7e6a-5823-45b4-95d3-4c3862dafb3a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:19.831684 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9420d-32f0-43a8-93fc-48319b01037d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:19.833121 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9420d-32f0-43a8-93fc-48319b01037d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:19.844783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-63a9420d-32f0-43a8-93fc-48319b01037d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:19.844783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:19.844783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:19.844783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:19.844783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:19.844783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:19.844783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:19.844783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:19.844783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:19.844783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:19.844783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:19.844783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:19.844783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:19.844783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:19.844783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:19.845731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:19.845731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:19.845731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:19.845731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:19.845731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:19.845731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:19.845731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:19.845731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:19.845731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:19.845731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:19.845731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:19.845731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:19.845731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:19.845731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:19.845731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:19.845731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:19.845731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:19.846658 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:19.846658 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:19.846658 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:19.846658 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:19.846658 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:19.846658 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:19.846658 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:19.846658 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:19.846658 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 318/627] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:19.847635 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128d3ce-4c3c-485c-ae29-591cb11af99a None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:19.847635 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128d3ce-4c3c-485c-ae29-591cb11af99a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:19.847878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128d3ce-4c3c-485c-ae29-591cb11af99a None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:19.851216 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 319/628] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:19.855264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128d3ce-4c3c-485c-ae29-591cb11af99a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:19.881810 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62783193-626e-408e-8fcb-097e6f2ff72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:19.882673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62783193-626e-408e-8fcb-097e6f2ff72b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:19.882948 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62783193-626e-408e-8fcb-097e6f2ff72b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:19.883212 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62783193-626e-408e-8fcb-097e6f2ff72b None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:19.883939 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62783193-626e-408e-8fcb-097e6f2ff72b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:19.884240 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62783193-626e-408e-8fcb-097e6f2ff72b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:19.885799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62783193-626e-408e-8fcb-097e6f2ff72b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:19.907827 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 310/629] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Sep 13 19:44:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:19.909348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d093f-48eb-4e70-88b4-0908dfd5a9ad None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:19.909909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d093f-48eb-4e70-88b4-0908dfd5a9ad None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:19.909909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49d093f-48eb-4e70-88b4-0908dfd5a9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:19.930392 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:19.931974 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d49d093f-48eb-4e70-88b4-0908dfd5a9ad None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:19.933152 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d49d093f-48eb-4e70-88b4-0908dfd5a9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:19.984225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128d3ce-4c3c-485c-ae29-591cb11af99a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:20.004943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 311/630] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:20.005671 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d093f-48eb-4e70-88b4-0908dfd5a9ad None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:20.009933 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:20.035679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff1748-501a-4060-91e9-3c4c74aa6392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:20.036897 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff1748-501a-4060-91e9-3c4c74aa6392 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:20.037922 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff1748-501a-4060-91e9-3c4c74aa6392 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:20.038505 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff1748-501a-4060-91e9-3c4c74aa6392 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:20.040501 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff1748-501a-4060-91e9-3c4c74aa6392 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:20.041229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff1748-501a-4060-91e9-3c4c74aa6392 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:20.043186 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ff1748-501a-4060-91e9-3c4c74aa6392 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:20.064823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 320/631] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:20.064823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff1748-501a-4060-91e9-3c4c74aa6392 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:20.119829 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49d093f-48eb-4e70-88b4-0908dfd5a9ad None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:20.159168 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57589071-be5a-402b-9f4b-c08b83fd360d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:20.159776 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57589071-be5a-402b-9f4b-c08b83fd360d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:20.160100 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57589071-be5a-402b-9f4b-c08b83fd360d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:20.160368 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57589071-be5a-402b-9f4b-c08b83fd360d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:20.200837 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff1748-501a-4060-91e9-3c4c74aa6392 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:20.222879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:20.232459 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57589071-be5a-402b-9f4b-c08b83fd360d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:20.233966 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57589071-be5a-402b-9f4b-c08b83fd360d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:20.237556 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:20.251839 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec17b44-9510-4826-87be-d3a78b91ec07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:20.252930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec17b44-9510-4826-87be-d3a78b91ec07 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:20.253408 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec17b44-9510-4826-87be-d3a78b91ec07 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:20.254064 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec17b44-9510-4826-87be-d3a78b91ec07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:20.270951 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec17b44-9510-4826-87be-d3a78b91ec07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:20.276822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-cec17b44-9510-4826-87be-d3a78b91ec07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:20.276822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:20.276822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:20.276822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:20.276822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:20.276822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:20.276822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:20.276822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:20.276822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:20.276822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:20.276822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:20.276822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:20.276822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:20.276822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:20.276822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:20.276822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:20.277892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:20.277892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:20.277892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:20.277892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:20.277892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:20.277892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:20.277892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:20.277892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:20.277892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:20.277892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:20.277892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:20.277892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:20.277892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:20.277892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:20.277892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:20.277892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:20.278929 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:20.278929 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:20.278929 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:20.278929 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:20.278929 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:20.278929 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:20.278929 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:20.278929 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:20.278929 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:20.278929 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:20.278929 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:20.278929 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:20.281830 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 321/632] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:20.283213 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec17b44-9510-4826-87be-d3a78b91ec07 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:20.341031 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 312/633] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:20.342203 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57589071-be5a-402b-9f4b-c08b83fd360d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:20.399018 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec17b44-9510-4826-87be-d3a78b91ec07 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:20.434223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f5c14-dd90-4b21-886b-cd9ae77cdc53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:20.434876 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f5c14-dd90-4b21-886b-cd9ae77cdc53 None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:20.435154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f5c14-dd90-4b21-886b-cd9ae77cdc53 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:20.435425 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879f5c14-dd90-4b21-886b-cd9ae77cdc53 None admin] PATH_INFO: `/v3/projects/ad67761fec0a430181877e216e90e7d4/users/c00e78bf5e5c4db29c47dce1e87f3f5a/roles/b253c1f3cd6a4197a85ca5f672852073` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:20.449508 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57589071-be5a-402b-9f4b-c08b83fd360d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:20.449785 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f5c14-dd90-4b21-886b-cd9ae77cdc53 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad67761fec0a430181877e216e90e7d4, user_id=c00e78bf5e5c4db29c47dce1e87f3f5a, role_id=b253c1f3cd6a4197a85ca5f672852073)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:20.451169 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879f5c14-dd90-4b21-886b-cd9ae77cdc53 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:20.451877 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:20.484607 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db20766-f6aa-4d6b-9919-9bb3214f2de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:20.485291 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db20766-f6aa-4d6b-9919-9bb3214f2de2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:20.485576 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db20766-f6aa-4d6b-9919-9bb3214f2de2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:20.485881 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db20766-f6aa-4d6b-9919-9bb3214f2de2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:20.496303 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db20766-f6aa-4d6b-9919-9bb3214f2de2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:20.501069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-6db20766-f6aa-4d6b-9919-9bb3214f2de2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:20.501069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:20.501069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:20.501069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:20.501069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:20.501069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:20.501069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:20.501069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:20.501069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:20.501069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:20.501069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:20.501069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:20.501069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:20.501069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:20.501069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:20.501069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:20.502226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:20.502226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:20.502226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:20.502226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:20.502226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:20.502226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:20.502226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:20.502226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:20.502226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:20.502226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:20.502226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:20.502226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:20.502226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:20.502226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:20.502226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:20.502226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:20.503325 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:20.503325 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:20.503325 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:20.503325 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:20.503325 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:20.503325 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:20.503325 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:20.503325 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:20.503325 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:20.503325 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:20.503325 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:20.503325 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:20.503325 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 313/634] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:20.503325 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db20766-f6aa-4d6b-9919-9bb3214f2de2 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:20.524225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 322/635] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Sep 13 19:44:20 2022] PUT /identity/v3/projects/ad67761fec0a430181877e216e90e7d4/users/c00e78bf5e5c4db29c47dce1e87f3f5a/roles/b253c1f3cd6a4197a85ca5f672852073 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:44:20.525058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f5c14-dd90-4b21-886b-cd9ae77cdc53 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:20.556963 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:20.617625 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db20766-f6aa-4d6b-9919-9bb3214f2de2 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:20.643626 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879f5c14-dd90-4b21-886b-cd9ae77cdc53 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:20.654084 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef09df-13b8-4119-8342-e31419e2b0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:20.654610 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef09df-13b8-4119-8342-e31419e2b0c3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:20.654889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef09df-13b8-4119-8342-e31419e2b0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:20.655165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef09df-13b8-4119-8342-e31419e2b0c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:20.655847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef09df-13b8-4119-8342-e31419e2b0c3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:20.656147 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef09df-13b8-4119-8342-e31419e2b0c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:20.657553 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef09df-13b8-4119-8342-e31419e2b0c3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:20.670912 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 314/636] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:20.670912 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbf3db-9c23-4037-8b8a-197a15c1daea None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:20.670912 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbf3db-9c23-4037-8b8a-197a15c1daea None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:20.670912 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccbf3db-9c23-4037-8b8a-197a15c1daea None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:20.670912 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 315/637] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:20.670912 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbf3db-9c23-4037-8b8a-197a15c1daea None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:20.689459 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d79fda-b64f-4fdd-b030-0df0ce093f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:20.690237 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d79fda-b64f-4fdd-b030-0df0ce093f4f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:20.690519 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d79fda-b64f-4fdd-b030-0df0ce093f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:20.690922 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d79fda-b64f-4fdd-b030-0df0ce093f4f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:20.703426 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d79fda-b64f-4fdd-b030-0df0ce093f4f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:20.704883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d79fda-b64f-4fdd-b030-0df0ce093f4f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:20.706035 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:20.723058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-c2d79fda-b64f-4fdd-b030-0df0ce093f4f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:20.723058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:20.723058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:20.723058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:20.723058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:20.723058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:20.723058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:20.723058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:20.723058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:20.723058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:20.723058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:20.723058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:20.723058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:20.723058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:20.723058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:20.723058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:20.724095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:20.724095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:20.724095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:20.724095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:20.724095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:20.724095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:20.724095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:20.724095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:20.724095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:20.724095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:20.724095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:20.724095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:20.724095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:20.724095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:20.724095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:20.724095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:20.724095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:20.725076 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:20.725076 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:20.725076 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:20.725076 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 323/638] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:20.725306 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d79fda-b64f-4fdd-b030-0df0ce093f4f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:20.797206 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccbf3db-9c23-4037-8b8a-197a15c1daea None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:20.805064 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:20.831349 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d79fda-b64f-4fdd-b030-0df0ce093f4f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:20.833171 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-914897d0-3be1-4ec1-a12b-533dc50917d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:20.833801 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914897d0-3be1-4ec1-a12b-533dc50917d2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:20.834630 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914897d0-3be1-4ec1-a12b-533dc50917d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:20.835573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914897d0-3be1-4ec1-a12b-533dc50917d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:20.835680 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914897d0-3be1-4ec1-a12b-533dc50917d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:20.835900 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914897d0-3be1-4ec1-a12b-533dc50917d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:20.837266 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-914897d0-3be1-4ec1-a12b-533dc50917d2 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:20.851119 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 316/639] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:20.851119 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d885a0-5c6e-4be5-8a88-c607d70e6761 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:20.851119 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d885a0-5c6e-4be5-8a88-c607d70e6761 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:20.851119 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d885a0-5c6e-4be5-8a88-c607d70e6761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:20.867398 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-49d885a0-5c6e-4be5-8a88-c607d70e6761 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:20.868715 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-49d885a0-5c6e-4be5-8a88-c607d70e6761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:20.873383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24e635-0949-4e18-a502-792bc4764d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:20.874137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24e635-0949-4e18-a502-792bc4764d8d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:20.874481 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24e635-0949-4e18-a502-792bc4764d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:20.874822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e24e635-0949-4e18-a502-792bc4764d8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:20.891763 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24e635-0949-4e18-a502-792bc4764d8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:20.893216 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e24e635-0949-4e18-a502-792bc4764d8d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:20.907628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-4e24e635-0949-4e18-a502-792bc4764d8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:20.907628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:20.907628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:20.907628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:20.907628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:20.907628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:20.907628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:20.907628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:20.907628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:20.907628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:20.907628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:20.907628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:20.907628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:20.907628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:20.907628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:20.907628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:20.908637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:20.908637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:20.908637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:20.908637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:20.908637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:20.908637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:20.908637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:20.908637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:20.908637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:20.908637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:20.908637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:20.908637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:20.908637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:20.908637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:20.908637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:20.908637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:20.908637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:20.909544 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:20.909544 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:20.909544 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:20.913595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 324/640] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:20.914421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24e635-0949-4e18-a502-792bc4764d8d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:20.947601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 317/641] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:20.954719 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d885a0-5c6e-4be5-8a88-c607d70e6761 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:20.980473 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:21.023537 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e24e635-0949-4e18-a502-792bc4764d8d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:21.056435 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:21.069185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bae793-0f5d-4afa-8291-ed69ea20fa5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:21.070179 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bae793-0f5d-4afa-8291-ed69ea20fa5c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:21.070930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bae793-0f5d-4afa-8291-ed69ea20fa5c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:21.071809 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bae793-0f5d-4afa-8291-ed69ea20fa5c None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:21.072671 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bae793-0f5d-4afa-8291-ed69ea20fa5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:21.073188 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bae793-0f5d-4afa-8291-ed69ea20fa5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:21.075341 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bae793-0f5d-4afa-8291-ed69ea20fa5c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:21.086810 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d885a0-5c6e-4be5-8a88-c607d70e6761 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:21.095441 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 325/642] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:21.096398 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bae793-0f5d-4afa-8291-ed69ea20fa5c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:21.132809 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a5f0e-0fc4-4342-a316-e1333de34c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:21.133817 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a5f0e-0fc4-4342-a316-e1333de34c43 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:21.134324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a5f0e-0fc4-4342-a316-e1333de34c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:21.135030 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a5f0e-0fc4-4342-a316-e1333de34c43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:21.148251 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a5f0e-0fc4-4342-a316-e1333de34c43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:21.150699 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016a5f0e-0fc4-4342-a316-e1333de34c43 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:21.170348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-016a5f0e-0fc4-4342-a316-e1333de34c43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:21.170348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:21.170348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:21.170348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:21.170348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:21.170348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:21.170348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:21.170348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:21.170348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:21.170348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:21.170348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:21.170348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:21.170348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:21.170348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:21.170348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:21.170348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:21.171396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:21.171396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:21.171396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:21.171396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:21.171396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:21.171396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:21.171396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:21.171396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:21.171396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:21.171396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:21.171396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:21.171396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:21.171396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:21.171396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:21.171396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:21.171396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:21.171396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:21.172331 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:21.172331 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:21.172331 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:21.179623 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 318/643] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:21.179623 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a5f0e-0fc4-4342-a316-e1333de34c43 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:21.214058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bae793-0f5d-4afa-8291-ed69ea20fa5c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:21.250172 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3146159-d35c-4d45-95a4-ca410857c066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:21.250784 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3146159-d35c-4d45-95a4-ca410857c066 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:21.251115 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3146159-d35c-4d45-95a4-ca410857c066 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:21.251394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3146159-d35c-4d45-95a4-ca410857c066 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:21.252304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3146159-d35c-4d45-95a4-ca410857c066 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:21.252713 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3146159-d35c-4d45-95a4-ca410857c066 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:21.254800 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3146159-d35c-4d45-95a4-ca410857c066 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:21.266498 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:21.273952 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 326/644] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:21.273952 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3146159-d35c-4d45-95a4-ca410857c066 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:21.305792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016a5f0e-0fc4-4342-a316-e1333de34c43 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:21.326361 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:21.346157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e90cf9-7629-4001-8e74-81e0c3acfd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:21.346959 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e90cf9-7629-4001-8e74-81e0c3acfd0d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:21.347205 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e90cf9-7629-4001-8e74-81e0c3acfd0d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:21.347478 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e90cf9-7629-4001-8e74-81e0c3acfd0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:21.354908 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e90cf9-7629-4001-8e74-81e0c3acfd0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:21.356351 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e90cf9-7629-4001-8e74-81e0c3acfd0d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:21.368332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-50e90cf9-7629-4001-8e74-81e0c3acfd0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:21.368332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:21.368332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:21.368332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:21.368332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:21.368332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:21.368332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:21.368332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:21.368332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:21.368332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:21.368332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:21.368332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:21.368332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:21.368332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:21.368332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:21.369247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:21.369247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:21.369247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:21.369247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:21.369247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:21.369247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:21.369247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:21.369247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:21.369247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:21.369247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:21.369247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:21.369247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:21.369247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:21.369247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:21.369247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:21.369247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:21.369247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:21.370371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:21.370371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:21.370371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:21.370371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:21.370371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:21.370371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:21.370371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:21.370371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:21.370371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 319/645] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:21.370371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e90cf9-7629-4001-8e74-81e0c3acfd0d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:21.388054 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3146159-d35c-4d45-95a4-ca410857c066 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:21.425304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94153c-2ed9-4e69-835c-ac32dc1b7977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:21.425862 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94153c-2ed9-4e69-835c-ac32dc1b7977 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:21.426143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94153c-2ed9-4e69-835c-ac32dc1b7977 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:21.426420 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b94153c-2ed9-4e69-835c-ac32dc1b7977 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:21.427061 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94153c-2ed9-4e69-835c-ac32dc1b7977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:21.427363 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94153c-2ed9-4e69-835c-ac32dc1b7977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:21.429299 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b94153c-2ed9-4e69-835c-ac32dc1b7977 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:21.446184 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 327/646] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:21.446184 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94153c-2ed9-4e69-835c-ac32dc1b7977 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:21.482527 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e90cf9-7629-4001-8e74-81e0c3acfd0d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:21.510431 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:21.516450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61f0ec-4d93-4102-8fed-d79a29b38131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:21.517069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61f0ec-4d93-4102-8fed-d79a29b38131 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:21.517349 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61f0ec-4d93-4102-8fed-d79a29b38131 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:21.517621 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee61f0ec-4d93-4102-8fed-d79a29b38131 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:21.527976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee61f0ec-4d93-4102-8fed-d79a29b38131 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:21.532754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ee61f0ec-4d93-4102-8fed-d79a29b38131 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:21.532754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:21.532754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:21.532754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:21.532754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:21.532754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:21.532754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:21.532754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:21.532754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:21.532754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:21.532754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:21.532754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:21.532754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:21.532754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:21.532754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:21.532754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:21.533681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:21.533681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:21.533681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:21.533681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:21.533681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:21.533681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:21.533681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:21.533681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:21.533681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:21.533681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:21.533681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:21.533681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:21.533681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:21.533681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:21.533681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:21.533681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:21.534614 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:21.534614 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:21.534614 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:21.534614 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:21.534614 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:21.534614 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:21.534614 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:21.534614 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:21.534614 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:21.534614 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:21.534614 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:21.534614 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:21.534614 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 320/647] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:21.534614 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61f0ec-4d93-4102-8fed-d79a29b38131 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:21.553189 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b94153c-2ed9-4e69-835c-ac32dc1b7977 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:21.563071 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:21.592529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c123fe-a057-458e-99af-7fb41b7a9c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:21.593200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c123fe-a057-458e-99af-7fb41b7a9c9c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:21.593763 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c123fe-a057-458e-99af-7fb41b7a9c9c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:21.594282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c123fe-a057-458e-99af-7fb41b7a9c9c None admin] PATH_INFO: `/v3/users/glance` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:21.603588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c123fe-a057-458e-99af-7fb41b7a9c9c None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:21.604603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c123fe-a057-458e-99af-7fb41b7a9c9c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:21.616400 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-01c123fe-a057-458e-99af-7fb41b7a9c9c None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 13 19:44:21.616400 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:21.616400 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:21.616400 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:21.616400 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:21.616400 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:21.616400 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:21.616400 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:21.616400 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:21.616400 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:21.616400 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:21.616400 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:21.616400 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:21.616400 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:21.616400 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:21.616400 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:21.617562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:21.617562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:21.617562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:21.617562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:21.617562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:21.617562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:21.617562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:21.617562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:21.617562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:21.617562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:21.617562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:21.617562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:21.617562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:21.617562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:21.617562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:21.617562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:21.617562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:21.617562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:21.618799 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:21.618799 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:21.618799 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:21.618799 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:21.618799 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:21.618799 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:21.618799 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:21.618799 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:21.618799 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 13 19:44:21.618799 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:21.621941 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 328/648] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:21.622775 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c123fe-a057-458e-99af-7fb41b7a9c9c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:21.658761 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee61f0ec-4d93-4102-8fed-d79a29b38131 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:21.698273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d44070-723c-45d8-9dd9-99189ee0da8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:21.699254 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d44070-723c-45d8-9dd9-99189ee0da8c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:21.700443 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d44070-723c-45d8-9dd9-99189ee0da8c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:21.700874 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d44070-723c-45d8-9dd9-99189ee0da8c None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:21.701733 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d44070-723c-45d8-9dd9-99189ee0da8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:21.702223 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d44070-723c-45d8-9dd9-99189ee0da8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:21.703813 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d44070-723c-45d8-9dd9-99189ee0da8c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:21.723396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 321/649] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:21.723396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d44070-723c-45d8-9dd9-99189ee0da8c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:21.738171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c123fe-a057-458e-99af-7fb41b7a9c9c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:21.775674 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d75a7-2326-462f-80f4-fc75e6c365da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:21.776306 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d75a7-2326-462f-80f4-fc75e6c365da None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:21.776587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d75a7-2326-462f-80f4-fc75e6c365da None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:21.776858 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d75a7-2326-462f-80f4-fc75e6c365da None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:21.777709 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:21.784938 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d75a7-2326-462f-80f4-fc75e6c365da None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:21.786424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d75a7-2326-462f-80f4-fc75e6c365da None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:21.797873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-2e2d75a7-2326-462f-80f4-fc75e6c365da None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:44:21.797873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:21.797873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:21.797873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:21.797873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:21.797873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:21.797873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:21.797873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:21.797873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:21.797873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:21.797873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:21.797873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:21.797873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:21.797873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:21.797873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:21.797873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:21.804864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:21.804864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:21.804864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:21.804864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:21.804864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:21.804864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:21.804864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:21.804864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:21.804864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:21.804864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:21.804864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:21.804864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:21.804864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:21.804864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:21.804864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:21.804864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:21.804864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:21.804864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:21.806128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:21.806128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:21.806128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:21.806128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:21.806128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:21.806128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:21.806128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:21.806128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:21.806128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:44:21.806128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:21.806128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 329/650] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:21.806128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d75a7-2326-462f-80f4-fc75e6c365da None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:21.833493 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d44070-723c-45d8-9dd9-99189ee0da8c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:21.834841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:21.871113 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72efba-4169-40ae-9b88-732106e01a36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:21.871906 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72efba-4169-40ae-9b88-732106e01a36 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:21.872189 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72efba-4169-40ae-9b88-732106e01a36 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:21.872463 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b72efba-4169-40ae-9b88-732106e01a36 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:21.873122 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72efba-4169-40ae-9b88-732106e01a36 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:21.873429 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72efba-4169-40ae-9b88-732106e01a36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:21.874821 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b72efba-4169-40ae-9b88-732106e01a36 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:21.890609 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 322/651] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:21.891517 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72efba-4169-40ae-9b88-732106e01a36 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:21.915124 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d75a7-2326-462f-80f4-fc75e6c365da None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:21.952556 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b2fc1-a8db-48d0-aace-1babc3a49c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:21.953360 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b2fc1-a8db-48d0-aace-1babc3a49c0c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:21.953643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b2fc1-a8db-48d0-aace-1babc3a49c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:21.953947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b2fc1-a8db-48d0-aace-1babc3a49c0c None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:21.954661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b2fc1-a8db-48d0-aace-1babc3a49c0c None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:21.954966 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b2fc1-a8db-48d0-aace-1babc3a49c0c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:21.956399 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3b2fc1-a8db-48d0-aace-1babc3a49c0c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:21.974054 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 330/652] 10.222.0.59 () {56 vars in 1137 bytes} [Tue Sep 13 19:44:21 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:21.974873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b2fc1-a8db-48d0-aace-1babc3a49c0c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:22.001795 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b72efba-4169-40ae-9b88-732106e01a36 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:22.016604 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:22.038719 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84735c90-1673-49e0-91ff-3eadbcd2633e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:22.039466 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84735c90-1673-49e0-91ff-3eadbcd2633e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:22.039754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84735c90-1673-49e0-91ff-3eadbcd2633e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:22.040029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84735c90-1673-49e0-91ff-3eadbcd2633e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:22.040745 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84735c90-1673-49e0-91ff-3eadbcd2633e None admin] RBAC: Adding query filter params (role.id=b253c1f3cd6a4197a85ca5f672852073, scope.project.id=ad67761fec0a430181877e216e90e7d4, user.id=3919b24291f54df99a9da0f5d3164ccf) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:22.041051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84735c90-1673-49e0-91ff-3eadbcd2633e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:22.042631 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84735c90-1673-49e0-91ff-3eadbcd2633e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:22.057748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 323/653] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:21 2022] GET /identity/v3/role_assignments?user.id=3919b24291f54df99a9da0f5d3164ccf&scope.project.id=ad67761fec0a430181877e216e90e7d4&role.id=b253c1f3cd6a4197a85ca5f672852073 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:22.057748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84735c90-1673-49e0-91ff-3eadbcd2633e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:22.070048 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:22.088381 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b2fc1-a8db-48d0-aace-1babc3a49c0c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:22.138009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484c77d-6b97-4231-997b-78624f9314fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:22.138933 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484c77d-6b97-4231-997b-78624f9314fe None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:22.139219 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484c77d-6b97-4231-997b-78624f9314fe None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:22.139498 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c484c77d-6b97-4231-997b-78624f9314fe None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:22.140534 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484c77d-6b97-4231-997b-78624f9314fe None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:22.140854 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484c77d-6b97-4231-997b-78624f9314fe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:22.143211 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c484c77d-6b97-4231-997b-78624f9314fe None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:22.170700 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 331/654] 10.222.0.59 () {56 vars in 1137 bytes} [Tue Sep 13 19:44:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:22.171687 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484c77d-6b97-4231-997b-78624f9314fe None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:22.196986 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84735c90-1673-49e0-91ff-3eadbcd2633e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:22.235290 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac5db9-ed1d-45de-9c30-33a47715d6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:22.236323 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac5db9-ed1d-45de-9c30-33a47715d6b6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:22.236806 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac5db9-ed1d-45de-9c30-33a47715d6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:22.237296 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ac5db9-ed1d-45de-9c30-33a47715d6b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:22.253609 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac5db9-ed1d-45de-9c30-33a47715d6b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:22.255082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ac5db9-ed1d-45de-9c30-33a47715d6b6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:22.275174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-b4ac5db9-ed1d-45de-9c30-33a47715d6b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:22.275174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:22.275174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:22.275174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:22.275174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:22.275174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:22.275174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:22.275174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:22.275174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:22.275174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:22.275174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:22.275174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:22.275174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:22.275174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:22.275174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:22.275174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:22.276186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:22.276186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:22.276186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:22.276186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:22.276186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:22.276186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:22.276186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:22.276186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:22.276186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:22.276186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:22.276186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:22.276186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:22.276186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:22.276186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:22.276186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:22.276186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:22.276186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:22.277206 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:22.277206 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:22.277206 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:22.277206 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 324/655] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:22.277437 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac5db9-ed1d-45de-9c30-33a47715d6b6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:22.310380 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c484c77d-6b97-4231-997b-78624f9314fe None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:22.311313 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:22.353847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b4dcd-b754-4c72-8fbb-1f6779236949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:22.354771 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b4dcd-b754-4c72-8fbb-1f6779236949 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:22.355237 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b4dcd-b754-4c72-8fbb-1f6779236949 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:22.355694 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156b4dcd-b754-4c72-8fbb-1f6779236949 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:22.372850 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:22.397988 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ac5db9-ed1d-45de-9c30-33a47715d6b6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:22.434365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee57aa-ee9f-49f5-bd35-42a457904edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:22.435141 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee57aa-ee9f-49f5-bd35-42a457904edf None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:22.435524 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee57aa-ee9f-49f5-bd35-42a457904edf None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:22.435899 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eee57aa-ee9f-49f5-bd35-42a457904edf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:22.441840 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b4dcd-b754-4c72-8fbb-1f6779236949 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:22.443609 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156b4dcd-b754-4c72-8fbb-1f6779236949 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:22.509378 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee57aa-ee9f-49f5-bd35-42a457904edf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:22.510960 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eee57aa-ee9f-49f5-bd35-42a457904edf None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:22.541723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:22.563700 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 332/656] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:22.565230 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b4dcd-b754-4c72-8fbb-1f6779236949 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:22.626361 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:22.631528 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 325/657] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:22.632919 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee57aa-ee9f-49f5-bd35-42a457904edf None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:22.696119 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156b4dcd-b754-4c72-8fbb-1f6779236949 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:22.738446 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335524b-e252-458e-987c-898d87d65817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:22.739065 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335524b-e252-458e-987c-898d87d65817 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:22.739343 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335524b-e252-458e-987c-898d87d65817 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:22.739780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a335524b-e252-458e-987c-898d87d65817 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:22.740278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a335524b-e252-458e-987c-898d87d65817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:22.740586 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a335524b-e252-458e-987c-898d87d65817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:22.742002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a335524b-e252-458e-987c-898d87d65817 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:22.742826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eee57aa-ee9f-49f5-bd35-42a457904edf None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:22.753713 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 333/658] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:22.754428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335524b-e252-458e-987c-898d87d65817 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:22.775976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:22.786691 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccdf8de-bc25-427d-88b9-8a86083f28c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:22.787717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdf8de-bc25-427d-88b9-8a86083f28c6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:22.791967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdf8de-bc25-427d-88b9-8a86083f28c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:22.791967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccdf8de-bc25-427d-88b9-8a86083f28c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:22.800103 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdf8de-bc25-427d-88b9-8a86083f28c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:22.801588 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccdf8de-bc25-427d-88b9-8a86083f28c6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:22.817282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-bccdf8de-bc25-427d-88b9-8a86083f28c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:22.817282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:22.817282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:22.817282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:22.817282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:22.817282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:22.817282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:22.817282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:22.817282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:22.817282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:22.817282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:22.817282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:22.817282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:22.817282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:22.817282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:22.817282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:22.819093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:22.819093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:22.819093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:22.819093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:22.819093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:22.819093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:22.819093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:22.819093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:22.819093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:22.819093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:22.819093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:22.819093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:22.819093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:22.819093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:22.819093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:22.819093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:22.819093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:22.820009 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:22.820009 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:22.820009 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:22.821823 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 326/659] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:22.823543 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c8cb8-91b0-44a2-9b14-7574c5c3e985 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:22.824061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c8cb8-91b0-44a2-9b14-7574c5c3e985 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:22.824341 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448c8cb8-91b0-44a2-9b14-7574c5c3e985 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:22.830150 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 327/660] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:22.830150 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c8cb8-91b0-44a2-9b14-7574c5c3e985 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:22.859718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a335524b-e252-458e-987c-898d87d65817 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:22.862830 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:22.902275 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4be062-74ba-43d1-b6a0-f56696323db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:22.902914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4be062-74ba-43d1-b6a0-f56696323db2 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:22.903195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4be062-74ba-43d1-b6a0-f56696323db2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:22.903470 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4be062-74ba-43d1-b6a0-f56696323db2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:22.915537 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4be062-74ba-43d1-b6a0-f56696323db2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:22.916723 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4be062-74ba-43d1-b6a0-f56696323db2 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:22.931877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-bf4be062-74ba-43d1-b6a0-f56696323db2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:22.931877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:22.931877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:22.931877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:22.931877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:22.931877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:22.931877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:22.931877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:22.931877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:22.931877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:22.931877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:22.931877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:22.931877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:22.931877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:22.931877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:22.931877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:22.932879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:22.932879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:22.932879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:22.932879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:22.932879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:22.932879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:22.932879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:22.932879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:22.932879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:22.932879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:22.932879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:22.932879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:22.932879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:22.932879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:22.932879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:22.932879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:22.932879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:22.933821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:22.933821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:22.933821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:22.933821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 334/661] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:22.933821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4be062-74ba-43d1-b6a0-f56696323db2 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:22.957912 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448c8cb8-91b0-44a2-9b14-7574c5c3e985 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:22.994660 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9dfc7ac-7dc4-478e-8c1d-3b37b8fb6192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:22.995955 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfc7ac-7dc4-478e-8c1d-3b37b8fb6192 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:22.996645 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfc7ac-7dc4-478e-8c1d-3b37b8fb6192 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:22.997096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9dfc7ac-7dc4-478e-8c1d-3b37b8fb6192 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:23.007271 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfc7ac-7dc4-478e-8c1d-3b37b8fb6192 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:23.010035 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9dfc7ac-7dc4-478e-8c1d-3b37b8fb6192 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:23.024047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-f9dfc7ac-7dc4-478e-8c1d-3b37b8fb6192 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 19:44:23.024047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:23.024047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:23.024047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:23.024047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:23.024047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:23.024047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:23.024047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:23.024047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:23.024047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:23.024047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:23.024047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:23.024047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:23.024047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:23.024047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:23.024047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:23.025074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:23.025074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:23.025074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:23.025074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:23.025074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:23.025074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:23.025074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:23.025074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:23.025074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:23.025074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:23.025074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:23.025074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:23.025074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:23.025074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:23.025074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:23.025074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:23.025074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:23.025074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:23.026143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:23.026143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:23.026143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:23.026143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:23.026143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:23.026143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:23.026143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:23.026143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:23.026143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 13 19:44:23.026143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:23.026143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 328/662] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:23.026879 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38ffb8-6a2a-4193-9bd9-b3f2350c77d9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:23.026879 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38ffb8-6a2a-4193-9bd9-b3f2350c77d9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:23.027007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd38ffb8-6a2a-4193-9bd9-b3f2350c77d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:23.043732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4be062-74ba-43d1-b6a0-f56696323db2 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:23.045582 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-fd38ffb8-6a2a-4193-9bd9-b3f2350c77d9 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:23.046796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fd38ffb8-6a2a-4193-9bd9-b3f2350c77d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:23.080393 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4065fa-5ed1-4961-8787-09318e22d61b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:23.081144 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4065fa-5ed1-4961-8787-09318e22d61b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:23.081432 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4065fa-5ed1-4961-8787-09318e22d61b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:23.081744 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4065fa-5ed1-4961-8787-09318e22d61b None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:23.082317 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:23.082431 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4065fa-5ed1-4961-8787-09318e22d61b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:23.082692 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4065fa-5ed1-4961-8787-09318e22d61b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:23.084695 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4065fa-5ed1-4961-8787-09318e22d61b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:23.103068 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 335/663] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:23.103262 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4065fa-5ed1-4961-8787-09318e22d61b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:23.125755 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 329/664] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:23.125755 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38ffb8-6a2a-4193-9bd9-b3f2350c77d9 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:23.147246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:23.225934 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4065fa-5ed1-4961-8787-09318e22d61b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:23.244202 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd38ffb8-6a2a-4193-9bd9-b3f2350c77d9 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:23.265762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac092a7-449d-4ecb-8c97-ce30960b9258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:23.266373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac092a7-449d-4ecb-8c97-ce30960b9258 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:23.266654 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac092a7-449d-4ecb-8c97-ce30960b9258 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:23.266930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac092a7-449d-4ecb-8c97-ce30960b9258 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:23.267567 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac092a7-449d-4ecb-8c97-ce30960b9258 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:23.267873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac092a7-449d-4ecb-8c97-ce30960b9258 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:23.269238 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac092a7-449d-4ecb-8c97-ce30960b9258 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:23.285354 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 336/665] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:23.285354 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac092a7-449d-4ecb-8c97-ce30960b9258 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:23.295469 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778f6d3-3a9b-4d50-ad8f-6aea1c7ffb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:23.296767 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778f6d3-3a9b-4d50-ad8f-6aea1c7ffb02 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:23.297202 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778f6d3-3a9b-4d50-ad8f-6aea1c7ffb02 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:23.297950 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3778f6d3-3a9b-4d50-ad8f-6aea1c7ffb02 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:23.298855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778f6d3-3a9b-4d50-ad8f-6aea1c7ffb02 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:23.299617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778f6d3-3a9b-4d50-ad8f-6aea1c7ffb02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:23.302109 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3778f6d3-3a9b-4d50-ad8f-6aea1c7ffb02 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:23.327995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 330/666] 10.222.0.59 () {56 vars in 1139 bytes} [Tue Sep 13 19:44:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:23.329583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778f6d3-3a9b-4d50-ad8f-6aea1c7ffb02 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:23.366669 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:23.371128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:23.396250 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac092a7-449d-4ecb-8c97-ce30960b9258 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:23.433337 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15396ee-befe-4621-a092-f59ca561a548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:23.434003 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15396ee-befe-4621-a092-f59ca561a548 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:23.434281 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15396ee-befe-4621-a092-f59ca561a548 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:23.434550 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15396ee-befe-4621-a092-f59ca561a548 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:23.442150 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15396ee-befe-4621-a092-f59ca561a548 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:23.444391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15396ee-befe-4621-a092-f59ca561a548 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:23.453290 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3778f6d3-3a9b-4d50-ad8f-6aea1c7ffb02 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:23.457209 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-f15396ee-befe-4621-a092-f59ca561a548 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:23.457209 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:23.457209 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:23.457209 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:23.457209 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:23.457209 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:23.457209 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:23.457209 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:23.457209 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:23.457209 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:23.457209 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:23.457209 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:23.457209 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:23.457209 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:23.457209 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:23.458137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:23.458137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:23.458137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:23.458137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:23.458137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:23.458137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:23.458137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:23.458137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:23.458137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:23.458137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:23.458137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:23.458137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:23.458137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:23.458137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:23.458137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:23.458137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:23.458137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:23.459112 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:23.459112 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:23.459112 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:23.459112 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:23.459112 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:23.459112 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:23.459112 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:23.459112 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:23.459112 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 337/667] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:23.459603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15396ee-befe-4621-a092-f59ca561a548 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:23.488805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf8786-d430-4042-b623-e299e6613db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:23.489433 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf8786-d430-4042-b623-e299e6613db9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:23.489737 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf8786-d430-4042-b623-e299e6613db9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:23.490535 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf8786-d430-4042-b623-e299e6613db9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:23.497591 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf8786-d430-4042-b623-e299e6613db9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:23.499222 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf8786-d430-4042-b623-e299e6613db9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:23.511934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-70cf8786-d430-4042-b623-e299e6613db9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:23.511934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:23.511934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:23.511934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:23.511934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:23.511934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:23.511934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:23.511934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:23.511934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:23.511934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:23.511934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:23.511934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:23.511934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:23.511934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:23.511934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:23.513080 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:23.513080 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:23.513080 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:23.513080 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:23.513080 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:23.513080 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:23.513080 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:23.513080 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:23.513080 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:23.513080 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:23.513080 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:23.513080 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:23.513080 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:23.513080 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:23.513080 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:23.513080 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:23.513080 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:23.514246 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:23.514246 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:23.514246 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:23.514246 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:23.514246 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:23.514246 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:23.514246 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:23.514246 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:23.514246 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 331/668] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:23.514246 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf8786-d430-4042-b623-e299e6613db9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:23.578288 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15396ee-befe-4621-a092-f59ca561a548 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:23.604536 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:23.611791 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979dce95-b9eb-4cd3-a265-6e4195c49770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:23.612397 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dce95-b9eb-4cd3-a265-6e4195c49770 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:23.612675 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dce95-b9eb-4cd3-a265-6e4195c49770 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:23.612945 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979dce95-b9eb-4cd3-a265-6e4195c49770 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:23.617189 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf8786-d430-4042-b623-e299e6613db9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:23.620178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:23.651538 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e60571-ce09-4880-83ea-250e86d03cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:23.652149 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e60571-ce09-4880-83ea-250e86d03cbf None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:23.652425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e60571-ce09-4880-83ea-250e86d03cbf None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:23.652692 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e60571-ce09-4880-83ea-250e86d03cbf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:23.663250 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68e60571-ce09-4880-83ea-250e86d03cbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:23.668440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-68e60571-ce09-4880-83ea-250e86d03cbf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:23.668440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:23.668440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:23.668440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:23.668440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:23.668440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:23.668440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:23.668440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:23.668440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:23.668440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:23.668440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:23.668440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:23.668440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:23.668440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:23.668440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:23.668440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:23.669393 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:23.669393 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:23.669393 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:23.669393 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:23.669393 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:23.669393 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:23.669393 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:23.669393 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:23.669393 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:23.669393 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:23.669393 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:23.669393 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:23.669393 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:23.669393 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:23.669393 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:23.669393 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:23.670369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:23.670369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:23.670369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:23.670369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:23.670369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:23.670369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:23.670369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:23.670369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:23.670369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:23.670369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:23.670369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:23.670369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:23.674370 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 332/669] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:23.675167 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e60571-ce09-4880-83ea-250e86d03cbf None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:23.687719 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979dce95-b9eb-4cd3-a265-6e4195c49770 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:23.689259 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979dce95-b9eb-4cd3-a265-6e4195c49770 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:23.777417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e60571-ce09-4880-83ea-250e86d03cbf None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:23.809864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 338/670] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:23.811007 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979dce95-b9eb-4cd3-a265-6e4195c49770 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:23.813038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cf184-b141-4123-9311-de995a8afd56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:23.813770 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cf184-b141-4123-9311-de995a8afd56 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:23.814149 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cf184-b141-4123-9311-de995a8afd56 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:23.814537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3cf184-b141-4123-9311-de995a8afd56 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:23.815321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3cf184-b141-4123-9311-de995a8afd56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:23.815721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3cf184-b141-4123-9311-de995a8afd56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:23.817239 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3cf184-b141-4123-9311-de995a8afd56 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:23.834492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 333/671] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:23.835291 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cf184-b141-4123-9311-de995a8afd56 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:23.846003 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:23.848220 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:23.921210 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979dce95-b9eb-4cd3-a265-6e4195c49770 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:23.940928 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3cf184-b141-4123-9311-de995a8afd56 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:23.958331 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde71c11-9cf0-4166-b665-c3499b443f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:23.959548 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde71c11-9cf0-4166-b665-c3499b443f31 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:23.959994 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde71c11-9cf0-4166-b665-c3499b443f31 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:23.960280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde71c11-9cf0-4166-b665-c3499b443f31 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:23.960975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde71c11-9cf0-4166-b665-c3499b443f31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:23.961302 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde71c11-9cf0-4166-b665-c3499b443f31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:23.962773 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde71c11-9cf0-4166-b665-c3499b443f31 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:23.977727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 339/672] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:23.977727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde71c11-9cf0-4166-b665-c3499b443f31 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:23.982433 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9ac48-3b5e-4471-8d0d-3397bc56bf74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:23.983041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9ac48-3b5e-4471-8d0d-3397bc56bf74 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:23.983313 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9ac48-3b5e-4471-8d0d-3397bc56bf74 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:23.983577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a9ac48-3b5e-4471-8d0d-3397bc56bf74 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:23.984237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9ac48-3b5e-4471-8d0d-3397bc56bf74 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:23.984532 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9ac48-3b5e-4471-8d0d-3397bc56bf74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:23.985911 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a9ac48-3b5e-4471-8d0d-3397bc56bf74 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:24.000119 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 334/673] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:24.000119 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9ac48-3b5e-4471-8d0d-3397bc56bf74 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:24.067443 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:24.084137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:24.090435 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde71c11-9cf0-4166-b665-c3499b443f31 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:24.100101 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a9ac48-3b5e-4471-8d0d-3397bc56bf74 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:24.125086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae16600-3379-48d4-8b18-52522527432b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:24.126181 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae16600-3379-48d4-8b18-52522527432b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:24.126678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae16600-3379-48d4-8b18-52522527432b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:24.127146 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae16600-3379-48d4-8b18-52522527432b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:24.133830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044b1bb-53fe-4eeb-9531-87da492c3345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:24.134424 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044b1bb-53fe-4eeb-9531-87da492c3345 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:24.134702 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044b1bb-53fe-4eeb-9531-87da492c3345 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:24.134975 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0044b1bb-53fe-4eeb-9531-87da492c3345 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:24.135691 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044b1bb-53fe-4eeb-9531-87da492c3345 None admin] RBAC: Adding query filter params (role.id=b253c1f3cd6a4197a85ca5f672852073, scope.project.id=ad67761fec0a430181877e216e90e7d4, user.id=44093d63c1aa45b781d2ce30239ed598) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:24.135997 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044b1bb-53fe-4eeb-9531-87da492c3345 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:24.137416 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0044b1bb-53fe-4eeb-9531-87da492c3345 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:24.141022 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae16600-3379-48d4-8b18-52522527432b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:24.142646 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae16600-3379-48d4-8b18-52522527432b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:24.143183 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 335/674] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:23 2022] GET /identity/v3/role_assignments?user.id=44093d63c1aa45b781d2ce30239ed598&scope.project.id=ad67761fec0a430181877e216e90e7d4&role.id=b253c1f3cd6a4197a85ca5f672852073 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:24.143950 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044b1bb-53fe-4eeb-9531-87da492c3345 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:24.159307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-3ae16600-3379-48d4-8b18-52522527432b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:24.159307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:24.159307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:24.159307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:24.159307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:24.159307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:24.159307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:24.159307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:24.159307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:24.159307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:24.159307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:24.159307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:24.159307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:24.159307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:24.159307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:24.159307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:24.160362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:24.160362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:24.160362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:24.160362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:24.160362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:24.160362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:24.160362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:24.160362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:24.160362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:24.160362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:24.160362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:24.160362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:24.160362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:24.160362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:24.160362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:24.160362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:24.160362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:24.161297 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:24.161297 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:24.161297 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:24.163619 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 340/675] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:24.164643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae16600-3379-48d4-8b18-52522527432b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:24.288526 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae16600-3379-48d4-8b18-52522527432b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:24.303555 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0044b1bb-53fe-4eeb-9531-87da492c3345 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:24.327930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae655fc3-74be-4893-b4b4-66ebd834b161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:24.328834 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae655fc3-74be-4893-b4b4-66ebd834b161 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:24.329296 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae655fc3-74be-4893-b4b4-66ebd834b161 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:24.329896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae655fc3-74be-4893-b4b4-66ebd834b161 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:24.343405 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae655fc3-74be-4893-b4b4-66ebd834b161 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:24.343666 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9415de-8732-4f40-96bb-78defcece602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:24.344412 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9415de-8732-4f40-96bb-78defcece602 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:24.344758 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9415de-8732-4f40-96bb-78defcece602 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:24.345099 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9415de-8732-4f40-96bb-78defcece602 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:24.345926 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9415de-8732-4f40-96bb-78defcece602 None admin] RBAC: Adding query filter params (role.id=b253c1f3cd6a4197a85ca5f672852073, scope.project.id=ad67761fec0a430181877e216e90e7d4, user.id=fbdff73734304485ac9884d6b44ea73c) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:24.346035 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae655fc3-74be-4893-b4b4-66ebd834b161 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:24.346303 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9415de-8732-4f40-96bb-78defcece602 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:24.348417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9415de-8732-4f40-96bb-78defcece602 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:24.350794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:24.355906 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:24.361726 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 336/676] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:24 2022] GET /identity/v3/role_assignments?user.id=fbdff73734304485ac9884d6b44ea73c&scope.project.id=ad67761fec0a430181877e216e90e7d4&role.id=b253c1f3cd6a4197a85ca5f672852073 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:24.361726 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9415de-8732-4f40-96bb-78defcece602 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:24.373577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-ae655fc3-74be-4893-b4b4-66ebd834b161 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:24.373577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:24.373577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:24.373577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:24.373577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:24.373577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:24.373577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:24.373577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:24.373577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:24.373577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:24.373577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:24.373577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:24.373577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:24.373577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:24.373577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:24.373577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:24.374969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:24.374969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:24.374969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:24.374969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:24.374969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:24.374969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:24.374969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:24.374969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:24.374969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:24.374969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:24.374969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:24.374969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:24.374969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:24.374969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:24.374969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:24.374969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:24.374969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:24.375881 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:24.375881 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:24.375881 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:24.375881 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 341/677] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:24.384114 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6192b7-f6f5-4e3c-90e4-68226acbd0de None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:24.384390 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6192b7-f6f5-4e3c-90e4-68226acbd0de None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:24.384664 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6192b7-f6f5-4e3c-90e4-68226acbd0de None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:24.386225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 342/678] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:44:24.386824 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6192b7-f6f5-4e3c-90e4-68226acbd0de None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:24.493599 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9415de-8732-4f40-96bb-78defcece602 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:24.522955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6192b7-f6f5-4e3c-90e4-68226acbd0de None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:24.536454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d9292-4910-4734-ba6a-527b44a88df4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:24.537284 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d9292-4910-4734-ba6a-527b44a88df4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:24.537715 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d9292-4910-4734-ba6a-527b44a88df4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:24.538100 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d9292-4910-4734-ba6a-527b44a88df4 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:24.538858 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d9292-4910-4734-ba6a-527b44a88df4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:24.539168 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d9292-4910-4734-ba6a-527b44a88df4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:24.540562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d9292-4910-4734-ba6a-527b44a88df4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:24.554280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 337/679] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:24.555489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053191e6-81e5-450f-9f62-686ec8753bd6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:24.555780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053191e6-81e5-450f-9f62-686ec8753bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:24.556054 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053191e6-81e5-450f-9f62-686ec8753bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:24.562947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9789328-8b27-4aae-9d2d-05cc8ee81448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:24.564652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9789328-8b27-4aae-9d2d-05cc8ee81448 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:24.565091 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9789328-8b27-4aae-9d2d-05cc8ee81448 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:24.565387 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9789328-8b27-4aae-9d2d-05cc8ee81448 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:24.569375 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9789328-8b27-4aae-9d2d-05cc8ee81448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:24.569375 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9789328-8b27-4aae-9d2d-05cc8ee81448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:24.569375 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9789328-8b27-4aae-9d2d-05cc8ee81448 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:24.576079 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-053191e6-81e5-450f-9f62-686ec8753bd6 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:24.577925 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-053191e6-81e5-450f-9f62-686ec8753bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:24.584276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 343/680] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:24.585134 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9789328-8b27-4aae-9d2d-05cc8ee81448 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:24.652448 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:24.667466 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 338/681] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:24.668359 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053191e6-81e5-450f-9f62-686ec8753bd6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:24.668897 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:24.710524 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9789328-8b27-4aae-9d2d-05cc8ee81448 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:24.752174 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f7029-0c8f-43c9-9773-1bfc230873a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:24.753290 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f7029-0c8f-43c9-9773-1bfc230873a4 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:24.753566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f7029-0c8f-43c9-9773-1bfc230873a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:24.754013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f7029-0c8f-43c9-9773-1bfc230873a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:24.763992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f7029-0c8f-43c9-9773-1bfc230873a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:24.765726 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888f7029-0c8f-43c9-9773-1bfc230873a4 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:24.776979 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053191e6-81e5-450f-9f62-686ec8753bd6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:24.778075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-888f7029-0c8f-43c9-9773-1bfc230873a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:24.778075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:24.778075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:24.778075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:24.778075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:24.778075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:24.778075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:24.778075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:24.778075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:24.778075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:24.778075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:24.778075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:24.778075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:24.778075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:24.778075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:24.779077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:24.779077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:24.779077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:24.779077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:24.779077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:24.779077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:24.779077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:24.779077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:24.779077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:24.779077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:24.779077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:24.779077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:24.779077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:24.779077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:24.779077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:24.779077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:24.779077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:24.779965 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:24.779965 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:24.779965 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:24.779965 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:24.779965 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:24.779965 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:24.779965 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:24.779965 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:24.780686 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 344/682] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:24.785598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f7029-0c8f-43c9-9773-1bfc230873a4 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:24.838438 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42762389-50db-4c79-aff1-13736d9bf5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:24.839125 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42762389-50db-4c79-aff1-13736d9bf5f0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:24.839401 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42762389-50db-4c79-aff1-13736d9bf5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:24.839683 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42762389-50db-4c79-aff1-13736d9bf5f0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:24.858245 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42762389-50db-4c79-aff1-13736d9bf5f0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:24.859701 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42762389-50db-4c79-aff1-13736d9bf5f0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:24.886851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-42762389-50db-4c79-aff1-13736d9bf5f0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:44:24.886851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:24.886851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:24.886851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:24.886851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:24.886851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:24.886851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:24.886851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:24.886851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:24.886851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:24.886851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:24.886851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:24.886851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:24.886851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:24.886851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:24.886851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:24.887868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:24.887868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:24.887868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:24.887868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:24.887868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:24.887868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:24.887868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:24.887868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:24.887868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:24.887868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:24.887868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:24.887868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:24.887868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:24.887868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:24.887868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:24.887868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:24.887868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:24.887868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:24.888823 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:24.888823 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:24.888823 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:24.888823 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:24.888823 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:24.888823 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:24.888823 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:24.888823 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:24.888823 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:44:24.888823 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:24.897713 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 339/683] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:44:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:24.910802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42762389-50db-4c79-aff1-13736d9bf5f0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:24.912483 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f7029-0c8f-43c9-9773-1bfc230873a4 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:24.938211 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:24.961124 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76e298-9d86-4647-b860-6fc06d3b58e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:24.962199 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76e298-9d86-4647-b860-6fc06d3b58e8 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:24.962689 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76e298-9d86-4647-b860-6fc06d3b58e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:24.963318 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f76e298-9d86-4647-b860-6fc06d3b58e8 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:24.964513 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76e298-9d86-4647-b860-6fc06d3b58e8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:24.965226 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76e298-9d86-4647-b860-6fc06d3b58e8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:24.967335 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f76e298-9d86-4647-b860-6fc06d3b58e8 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:24.983353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 345/684] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:24.993348 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76e298-9d86-4647-b860-6fc06d3b58e8 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:25.008186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:25.090882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42762389-50db-4c79-aff1-13736d9bf5f0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:25.118903 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f76e298-9d86-4647-b860-6fc06d3b58e8 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:25.134213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268197e8-3878-4d76-a9a4-856488b76a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:25.134818 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268197e8-3878-4d76-a9a4-856488b76a7f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:25.135155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268197e8-3878-4d76-a9a4-856488b76a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:25.135578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268197e8-3878-4d76-a9a4-856488b76a7f None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:25.136314 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268197e8-3878-4d76-a9a4-856488b76a7f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:25.136989 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268197e8-3878-4d76-a9a4-856488b76a7f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:25.138737 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268197e8-3878-4d76-a9a4-856488b76a7f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:25.161518 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c97f02-6fe2-4ac9-855a-cb683c332cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:25.165786 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 340/685] 10.222.0.59 () {56 vars in 1135 bytes} [Tue Sep 13 19:44:24 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:25.165786 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268197e8-3878-4d76-a9a4-856488b76a7f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:25.166709 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c97f02-6fe2-4ac9-855a-cb683c332cad None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:25.167151 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c97f02-6fe2-4ac9-855a-cb683c332cad None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:25.168337 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c97f02-6fe2-4ac9-855a-cb683c332cad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:25.169235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c97f02-6fe2-4ac9-855a-cb683c332cad None admin] RBAC: Adding query filter params (role.id=b253c1f3cd6a4197a85ca5f672852073, scope.project.id=ad67761fec0a430181877e216e90e7d4, user.id=b86b85c457d84ac99359ac93add704d2) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:25.169547 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c97f02-6fe2-4ac9-855a-cb683c332cad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:25.175568 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c97f02-6fe2-4ac9-855a-cb683c332cad None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:25.185574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 346/686] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:24 2022] GET /identity/v3/role_assignments?user.id=b86b85c457d84ac99359ac93add704d2&scope.project.id=ad67761fec0a430181877e216e90e7d4&role.id=b253c1f3cd6a4197a85ca5f672852073 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:25.187206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c97f02-6fe2-4ac9-855a-cb683c332cad None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:25.287653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:25.356747 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268197e8-3878-4d76-a9a4-856488b76a7f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:25.370448 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:25.393078 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c97f02-6fe2-4ac9-855a-cb683c332cad None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:25.414772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5304e1-dcdf-4fcf-b16d-9f4c51628600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:25.415273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5304e1-dcdf-4fcf-b16d-9f4c51628600 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:25.415554 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5304e1-dcdf-4fcf-b16d-9f4c51628600 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:25.415823 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5304e1-dcdf-4fcf-b16d-9f4c51628600 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:25.429261 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5304e1-dcdf-4fcf-b16d-9f4c51628600 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:25.435082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-fd5304e1-dcdf-4fcf-b16d-9f4c51628600 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:44:25.435082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:25.435082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:25.435082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:25.435082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:25.435082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:25.435082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:25.435082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:25.435082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:25.435082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:25.435082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:25.435082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:25.435082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:25.435082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:25.435082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:25.435082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:25.436048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:25.436048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:25.436048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:25.436048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:25.436048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:25.436048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:25.436048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:25.436048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:25.436048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:25.436048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:25.436048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:25.436048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:25.436048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:25.436048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:25.436048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:25.436048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:25.436903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:25.436903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:25.436903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:25.436903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:25.436903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:25.436903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:25.436903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:25.436903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:25.436903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:25.436903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:25.436903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:44:25.436903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:25.436903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 341/687] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:44:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:25.440239 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa07219-6227-464a-a57c-3b009d947270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:25.441052 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa07219-6227-464a-a57c-3b009d947270 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:25.441496 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa07219-6227-464a-a57c-3b009d947270 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:25.441980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa07219-6227-464a-a57c-3b009d947270 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:25.442597 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5304e1-dcdf-4fcf-b16d-9f4c51628600 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:25.530013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa07219-6227-464a-a57c-3b009d947270 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:25.532392 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa07219-6227-464a-a57c-3b009d947270 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:25.574853 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5304e1-dcdf-4fcf-b16d-9f4c51628600 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:25.584194 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:25.629637 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e421fe-1a79-4297-a3e1-1efea06091b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:25.630676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e421fe-1a79-4297-a3e1-1efea06091b1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:25.632543 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e421fe-1a79-4297-a3e1-1efea06091b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:25.632996 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e421fe-1a79-4297-a3e1-1efea06091b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:25.633856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e421fe-1a79-4297-a3e1-1efea06091b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:25.634990 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e421fe-1a79-4297-a3e1-1efea06091b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:25.636701 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e421fe-1a79-4297-a3e1-1efea06091b1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:25.655512 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 342/688] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:25.663051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e421fe-1a79-4297-a3e1-1efea06091b1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:25.676055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 347/689] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:25.681719 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa07219-6227-464a-a57c-3b009d947270 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:25.718523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:25.826693 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa07219-6227-464a-a57c-3b009d947270 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:25.862357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e421fe-1a79-4297-a3e1-1efea06091b1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:25.897669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b38ea-2e49-4ec1-9923-e3f9d8312a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:25.898621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b38ea-2e49-4ec1-9923-e3f9d8312a80 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:25.899104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b38ea-2e49-4ec1-9923-e3f9d8312a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:25.899548 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284b38ea-2e49-4ec1-9923-e3f9d8312a80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:25.910888 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b38ea-2e49-4ec1-9923-e3f9d8312a80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:25.912828 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284b38ea-2e49-4ec1-9923-e3f9d8312a80 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:25.916432 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:25.933187 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-284b38ea-2e49-4ec1-9923-e3f9d8312a80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:25.933187 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:25.933187 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:25.933187 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:25.933187 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:25.933187 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:25.933187 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:25.933187 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:25.933187 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:25.933187 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:25.933187 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:25.933187 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:25.933187 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:25.933187 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:25.933187 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:25.933187 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:25.934193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:25.934193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:25.934193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:25.934193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:25.934193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:25.934193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:25.934193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:25.934193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:25.934193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:25.934193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:25.934193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:25.934193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:25.934193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:25.934193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:25.934193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:25.934193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:25.934193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:25.935229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:25.935229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:25.935229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:25.937650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 348/690] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:25.946694 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b38ea-2e49-4ec1-9923-e3f9d8312a80 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:25.950058 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6eed08-5d6f-41eb-8cdc-cfc5ed5525d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:25.950765 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6eed08-5d6f-41eb-8cdc-cfc5ed5525d9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:25.951004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6eed08-5d6f-41eb-8cdc-cfc5ed5525d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:25.951274 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6eed08-5d6f-41eb-8cdc-cfc5ed5525d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:25.973029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6eed08-5d6f-41eb-8cdc-cfc5ed5525d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:25.975603 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6eed08-5d6f-41eb-8cdc-cfc5ed5525d9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:25.999601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-0a6eed08-5d6f-41eb-8cdc-cfc5ed5525d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:25.999601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:25.999601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:25.999601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:25.999601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:25.999601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:25.999601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:25.999601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:25.999601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:25.999601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:25.999601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:25.999601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:25.999601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:25.999601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:25.999601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:25.999601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:26.000573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:26.000573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:26.000573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:26.000573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:26.000573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:26.000573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:26.000573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:26.000573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:26.000573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:26.000573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:26.000573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:26.000573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:26.000573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:26.000573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:26.000573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:26.000573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:26.000573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:26.001566 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:26.001566 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:26.001566 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:26.002903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 343/691] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:26.008216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6eed08-5d6f-41eb-8cdc-cfc5ed5525d9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:26.137747 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284b38ea-2e49-4ec1-9923-e3f9d8312a80 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:26.140837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:26.171028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6eed08-5d6f-41eb-8cdc-cfc5ed5525d9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:26.206684 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574dd9c0-4ef1-4a65-9d21-eb82b36e0ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:26.207267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dd9c0-4ef1-4a65-9d21-eb82b36e0ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:26.207545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dd9c0-4ef1-4a65-9d21-eb82b36e0ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:26.207828 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574dd9c0-4ef1-4a65-9d21-eb82b36e0ec5 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:26.208483 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574dd9c0-4ef1-4a65-9d21-eb82b36e0ec5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:26.208835 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574dd9c0-4ef1-4a65-9d21-eb82b36e0ec5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:26.211208 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574dd9c0-4ef1-4a65-9d21-eb82b36e0ec5 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:26.236698 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 349/692] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:26.238568 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d379b-8243-47c4-9b64-fcc2addb4e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:26.240424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574dd9c0-4ef1-4a65-9d21-eb82b36e0ec5 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:26.241019 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d379b-8243-47c4-9b64-fcc2addb4e49 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:26.241298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d379b-8243-47c4-9b64-fcc2addb4e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:26.241620 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d379b-8243-47c4-9b64-fcc2addb4e49 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:26.242288 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d379b-8243-47c4-9b64-fcc2addb4e49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:26.242984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d379b-8243-47c4-9b64-fcc2addb4e49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:26.244358 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d379b-8243-47c4-9b64-fcc2addb4e49 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:26.269573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 344/693] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:26.276069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d379b-8243-47c4-9b64-fcc2addb4e49 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:26.350878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:26.432955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574dd9c0-4ef1-4a65-9d21-eb82b36e0ec5 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:26.453157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d379b-8243-47c4-9b64-fcc2addb4e49 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:26.497704 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1508d13-f48e-4c9e-a155-1ab6af32a725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:26.498343 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1508d13-f48e-4c9e-a155-1ab6af32a725 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:26.498615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1508d13-f48e-4c9e-a155-1ab6af32a725 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:26.500014 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1508d13-f48e-4c9e-a155-1ab6af32a725 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:26.514176 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1508d13-f48e-4c9e-a155-1ab6af32a725 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:26.515621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1508d13-f48e-4c9e-a155-1ab6af32a725 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:26.517168 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e876182-ff29-488a-a9d3-ceec6af240ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:26.517867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e876182-ff29-488a-a9d3-ceec6af240ab None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:26.518140 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e876182-ff29-488a-a9d3-ceec6af240ab None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:26.518402 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e876182-ff29-488a-a9d3-ceec6af240ab None admin] PATH_INFO: `/v3/users/nova` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:26.532832 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e876182-ff29-488a-a9d3-ceec6af240ab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:26.534326 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e876182-ff29-488a-a9d3-ceec6af240ab None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:26.538161 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:26.539490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-b1508d13-f48e-4c9e-a155-1ab6af32a725 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:26.539490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:26.539490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:26.539490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:26.539490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:26.539490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:26.539490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:26.539490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:26.539490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:26.539490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:26.539490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:26.539490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:26.539490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:26.539490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:26.539490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:26.540391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:26.540391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:26.540391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:26.540391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:26.540391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:26.540391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:26.540391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:26.540391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:26.540391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:26.540391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:26.540391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:26.540391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:26.540391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:26.540391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:26.540391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:26.540391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:26.540391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:26.541299 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:26.541299 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:26.541299 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:26.541299 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:26.541299 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:26.541299 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:26.541299 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:26.541299 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:26.541299 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 350/694] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:26.555717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-8e876182-ff29-488a-a9d3-ceec6af240ab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:44:26.555717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:26.555717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:26.555717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:26.555717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:26.555717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:26.555717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:26.555717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:26.555717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:26.555717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:26.555717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:26.555717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:26.555717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:26.555717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:26.555717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:26.555717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:26.557012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:26.557012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:26.557012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:26.557012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:26.557012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:26.557012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:26.557012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:26.557012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:26.557012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:26.557012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:26.557012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:26.557012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:26.557012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:26.557012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:26.557012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:26.557012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:26.557012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:26.557012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:26.558107 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:26.558107 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:26.558107 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:26.558107 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:26.558107 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:26.558107 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:26.558107 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:26.558107 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:26.558107 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:44:26.558107 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:26.558107 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 345/695] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Sep 13 19:44:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:26.558697 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1508d13-f48e-4c9e-a155-1ab6af32a725 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:26.564983 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e876182-ff29-488a-a9d3-ceec6af240ab None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:26.740506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1508d13-f48e-4c9e-a155-1ab6af32a725 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:26.776395 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:26.793147 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e876182-ff29-488a-a9d3-ceec6af240ab None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:26.822038 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d418f10-9f73-4b69-ae0e-0953b0327e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:26.825556 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d418f10-9f73-4b69-ae0e-0953b0327e93 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:26.825882 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d418f10-9f73-4b69-ae0e-0953b0327e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:26.826161 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d418f10-9f73-4b69-ae0e-0953b0327e93 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:26.827142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d418f10-9f73-4b69-ae0e-0953b0327e93 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:26.827461 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d418f10-9f73-4b69-ae0e-0953b0327e93 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:26.828904 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d418f10-9f73-4b69-ae0e-0953b0327e93 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:26.831658 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde809d-f966-4853-9987-0a4dc9ef9030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:26.832527 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde809d-f966-4853-9987-0a4dc9ef9030 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:26.833013 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde809d-f966-4853-9987-0a4dc9ef9030 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:26.833553 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efde809d-f966-4853-9987-0a4dc9ef9030 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:26.834630 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde809d-f966-4853-9987-0a4dc9ef9030 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:26.835189 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde809d-f966-4853-9987-0a4dc9ef9030 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:26.836870 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efde809d-f966-4853-9987-0a4dc9ef9030 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:26.861054 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 351/696] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:26.865207 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 346/697] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Sep 13 19:44:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:26.865822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f66bc-389e-41b8-90f2-41218e14601f None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:26.866107 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f66bc-389e-41b8-90f2-41218e14601f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:26.866633 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f66bc-389e-41b8-90f2-41218e14601f None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:26.868169 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 352/698] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:44:26.870379 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde809d-f966-4853-9987-0a4dc9ef9030 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:26.871484 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f66bc-389e-41b8-90f2-41218e14601f None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:26.936917 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:26.979836 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efde809d-f966-4853-9987-0a4dc9ef9030 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:26.986711 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f66bc-389e-41b8-90f2-41218e14601f None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:27.018805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c65edd-27a1-4135-b6a9-490b0ad62acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:27.019767 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c65edd-27a1-4135-b6a9-490b0ad62acc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:27.020249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c65edd-27a1-4135-b6a9-490b0ad62acc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:27.020723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c65edd-27a1-4135-b6a9-490b0ad62acc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:27.022132 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c65edd-27a1-4135-b6a9-490b0ad62acc None admin] RBAC: Adding query filter params (role.id=b253c1f3cd6a4197a85ca5f672852073, scope.project.id=ad67761fec0a430181877e216e90e7d4, user.id=c00e78bf5e5c4db29c47dce1e87f3f5a) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:27.022564 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c65edd-27a1-4135-b6a9-490b0ad62acc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:27.022884 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36b0fa-9317-4ebe-bcce-cfcda57fecf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:27.023488 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36b0fa-9317-4ebe-bcce-cfcda57fecf5 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:27.023766 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36b0fa-9317-4ebe-bcce-cfcda57fecf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:27.023983 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c65edd-27a1-4135-b6a9-490b0ad62acc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:27.024080 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e36b0fa-9317-4ebe-bcce-cfcda57fecf5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:27.029985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 347/699] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:26 2022] GET /identity/v3/role_assignments?user.id=c00e78bf5e5c4db29c47dce1e87f3f5a&scope.project.id=ad67761fec0a430181877e216e90e7d4&role.id=b253c1f3cd6a4197a85ca5f672852073 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:27.030866 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0a883-249c-4e71-9b50-f185571fdfac None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:27.031142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0a883-249c-4e71-9b50-f185571fdfac None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:27.031412 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f0a883-249c-4e71-9b50-f185571fdfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:27.050927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-75f0a883-249c-4e71-9b50-f185571fdfac None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:27.052276 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-75f0a883-249c-4e71-9b50-f185571fdfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:27.092586 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:27.122823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36b0fa-9317-4ebe-bcce-cfcda57fecf5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:27.124489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e36b0fa-9317-4ebe-bcce-cfcda57fecf5 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:27.149916 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 348/700] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:27.149916 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bce635-c292-4bf1-acdc-3360431fd8c7 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:27.149916 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bce635-c292-4bf1-acdc-3360431fd8c7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:27.149916 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bce635-c292-4bf1-acdc-3360431fd8c7 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:27.150613 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 349/701] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:27.163462 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5f71a-72ba-450f-9d33-b929202c5e7c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:27.163840 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5f71a-72ba-450f-9d33-b929202c5e7c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:27.164119 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd5f71a-72ba-450f-9d33-b929202c5e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:27.204371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4cd5f71a-72ba-450f-9d33-b929202c5e7c None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:27.205595 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4cd5f71a-72ba-450f-9d33-b929202c5e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:27.277427 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:27.282013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 353/702] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 13 19:44:27.283170 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36b0fa-9317-4ebe-bcce-cfcda57fecf5 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:27.305782 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 350/703] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:27.372626 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:27.398276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e36b0fa-9317-4ebe-bcce-cfcda57fecf5 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:27.433895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269297a-4175-42f7-aea7-05f8b182dd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:27.434619 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269297a-4175-42f7-aea7-05f8b182dd3b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:27.434835 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269297a-4175-42f7-aea7-05f8b182dd3b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:27.435158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9269297a-4175-42f7-aea7-05f8b182dd3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:27.446517 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269297a-4175-42f7-aea7-05f8b182dd3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:27.447938 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9269297a-4175-42f7-aea7-05f8b182dd3b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:27.463366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-9269297a-4175-42f7-aea7-05f8b182dd3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:27.463366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:27.463366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:27.463366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:27.463366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:27.463366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:27.463366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:27.463366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:27.463366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:27.463366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:27.463366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:27.463366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:27.463366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:27.463366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:27.463366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:27.463366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:27.464414 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:27.464414 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:27.464414 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:27.464414 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:27.464414 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:27.464414 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:27.464414 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:27.464414 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:27.464414 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:27.464414 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:27.464414 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:27.464414 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:27.464414 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:27.464414 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:27.464414 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:27.464414 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:27.464414 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:27.465320 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:27.465320 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:27.465320 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:27.465320 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 354/704] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:27.470390 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5f71a-72ba-450f-9d33-b929202c5e7c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:27.474717 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269297a-4175-42f7-aea7-05f8b182dd3b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:27.611660 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9269297a-4175-42f7-aea7-05f8b182dd3b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:27.612181 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd5f71a-72ba-450f-9d33-b929202c5e7c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:27.646159 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:27.653652 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a9386-9586-4886-baac-a58bd38fe26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:27.660951 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a9386-9586-4886-baac-a58bd38fe26e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:27.660951 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a9386-9586-4886-baac-a58bd38fe26e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:27.660951 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189a9386-9586-4886-baac-a58bd38fe26e None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:27.661249 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbad97-d4dd-4d56-b4dc-717ae145d6b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:27.661249 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbad97-d4dd-4d56-b4dc-717ae145d6b9 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:27.661249 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbad97-d4dd-4d56-b4dc-717ae145d6b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:27.661564 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a9386-9586-4886-baac-a58bd38fe26e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:27.661650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dbad97-d4dd-4d56-b4dc-717ae145d6b9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:27.661766 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a9386-9586-4886-baac-a58bd38fe26e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:27.661866 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbad97-d4dd-4d56-b4dc-717ae145d6b9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:27.661866 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dbad97-d4dd-4d56-b4dc-717ae145d6b9 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:27.662033 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189a9386-9586-4886-baac-a58bd38fe26e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:27.673853 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 351/705] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:27.674415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-d2dbad97-d4dd-4d56-b4dc-717ae145d6b9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:44:27.674415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:27.674415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:44:27.674415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:44:27.674415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:44:27.674415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:44:27.674415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:44:27.674415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:27.674415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:44:27.674415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:27.674415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:44:27.674415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:27.674415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:27.674415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:27.674415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:27.674415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:27.674415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:27.675438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:27.675438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:27.675438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:27.675438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:27.675438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:27.675438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:27.675438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:44:27.675438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:44:27.675438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:44:27.675438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:44:27.675438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:27.675438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:27.675438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:27.675438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:27.675438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:27.675438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:27.676293 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:27.676293 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:27.676293 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:27.676293 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:27.676293 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:27.676293 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:27.676293 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:27.676293 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:27.676293 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:27.676293 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:27.676293 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:44:27.676293 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:27.676293 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:44:27.676293 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:27.678401 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a9386-9586-4886-baac-a58bd38fe26e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:27.681010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 355/706] 10.222.0.59 () {56 vars in 1129 bytes} [Tue Sep 13 19:44:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:27.682836 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbad97-d4dd-4d56-b4dc-717ae145d6b9 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:27.728640 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:27.794669 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189a9386-9586-4886-baac-a58bd38fe26e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:27.803209 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dbad97-d4dd-4d56-b4dc-717ae145d6b9 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:27.832371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be017cc5-fe52-44f8-b866-ea3558e99ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:27.833000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be017cc5-fe52-44f8-b866-ea3558e99ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:27.833307 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be017cc5-fe52-44f8-b866-ea3558e99ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:27.833581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be017cc5-fe52-44f8-b866-ea3558e99ec2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:27.839453 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838560c6-6964-4fbc-a02b-571eed846a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:27.840079 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838560c6-6964-4fbc-a02b-571eed846a27 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:27.840356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838560c6-6964-4fbc-a02b-571eed846a27 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:27.840624 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838560c6-6964-4fbc-a02b-571eed846a27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:27.845072 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be017cc5-fe52-44f8-b866-ea3558e99ec2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:27.846545 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be017cc5-fe52-44f8-b866-ea3558e99ec2 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:27.847759 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838560c6-6964-4fbc-a02b-571eed846a27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:27.849778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838560c6-6964-4fbc-a02b-571eed846a27 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:27.860654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-be017cc5-fe52-44f8-b866-ea3558e99ec2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:27.860654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:27.860654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:27.860654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:27.860654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:27.860654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:27.860654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:27.860654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:27.860654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:27.860654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:27.860654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:27.860654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:27.860654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:27.860654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:27.860654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:27.860654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:27.861649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:27.861649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:27.861649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:27.861649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:27.861649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:27.861649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:27.861649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:27.861649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:27.861649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:27.861649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:27.861649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:27.861649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:27.861649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:27.861649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:27.861649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:27.861649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:27.861649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:27.868999 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:27.868999 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:27.868999 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:27.868999 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 352/707] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:27.869295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-838560c6-6964-4fbc-a02b-571eed846a27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:27.869295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:27.869295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:27.869295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:27.869295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:27.869295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:27.869295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:27.869295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:27.869295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:27.869295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:27.869295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:27.869295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:27.869295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:27.869295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:27.869295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:27.870665 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:27.870665 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:27.870665 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:27.870665 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:27.870665 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:27.870665 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:27.870665 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:27.870665 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:27.870665 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:27.870665 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:27.870665 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:27.870665 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:27.870665 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:27.870665 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:27.870665 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:27.870665 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:27.870665 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:27.871590 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:27.871590 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:27.871590 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:27.871590 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:27.871590 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:27.871590 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:27.871590 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:27.871590 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:27.872058 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be017cc5-fe52-44f8-b866-ea3558e99ec2 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:27.872132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 356/708] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:27.872132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05092c6e-88c5-4cd2-82d9-6a0ac18d0d59 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:27.872132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05092c6e-88c5-4cd2-82d9-6a0ac18d0d59 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:27.872132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05092c6e-88c5-4cd2-82d9-6a0ac18d0d59 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:27.872132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 357/709] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:27.872132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05092c6e-88c5-4cd2-82d9-6a0ac18d0d59 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:27.931032 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:27.971276 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:27.978318 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be017cc5-fe52-44f8-b866-ea3558e99ec2 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:27.982498 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05092c6e-88c5-4cd2-82d9-6a0ac18d0d59 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:28.013773 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee9cc6-741a-48b1-ae8d-570c878d4f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:28.014535 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee9cc6-741a-48b1-ae8d-570c878d4f2b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:28.014816 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee9cc6-741a-48b1-ae8d-570c878d4f2b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:28.015382 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ee9cc6-741a-48b1-ae8d-570c878d4f2b None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:28.016009 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee9cc6-741a-48b1-ae8d-570c878d4f2b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:28.016310 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee9cc6-741a-48b1-ae8d-570c878d4f2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:28.017665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ee9cc6-741a-48b1-ae8d-570c878d4f2b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:28.019912 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b0e85e-251f-4b40-a35e-b20cdc36cfd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:28.020804 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0e85e-251f-4b40-a35e-b20cdc36cfd6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:28.021088 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0e85e-251f-4b40-a35e-b20cdc36cfd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:28.021359 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b0e85e-251f-4b40-a35e-b20cdc36cfd6 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:28.022022 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0e85e-251f-4b40-a35e-b20cdc36cfd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:28.022527 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 353/710] 10.222.0.59 () {56 vars in 1124 bytes} [Tue Sep 13 19:44:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:28.023140 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee9cc6-741a-48b1-ae8d-570c878d4f2b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:28.026677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0e85e-251f-4b40-a35e-b20cdc36cfd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:28.028132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b0e85e-251f-4b40-a35e-b20cdc36cfd6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:28.041787 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 358/711] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:28.046818 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d1e1c-797d-4926-a1f9-44f38ca8dcee None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:28.047109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d1e1c-797d-4926-a1f9-44f38ca8dcee None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:28.047392 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831d1e1c-797d-4926-a1f9-44f38ca8dcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:28.065278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-831d1e1c-797d-4926-a1f9-44f38ca8dcee None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:28.066496 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-831d1e1c-797d-4926-a1f9-44f38ca8dcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:28.132699 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ee9cc6-741a-48b1-ae8d-570c878d4f2b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:28.135144 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 359/712] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:28.135974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d1e1c-797d-4926-a1f9-44f38ca8dcee None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:28.170920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05dc9e-9f37-4bcf-81bf-b4979c820bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:28.172222 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05dc9e-9f37-4bcf-81bf-b4979c820bdf None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:28.172807 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05dc9e-9f37-4bcf-81bf-b4979c820bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:28.173291 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05dc9e-9f37-4bcf-81bf-b4979c820bdf None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:28.174234 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05dc9e-9f37-4bcf-81bf-b4979c820bdf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:28.174752 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05dc9e-9f37-4bcf-81bf-b4979c820bdf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:28.176369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05dc9e-9f37-4bcf-81bf-b4979c820bdf None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:28.189974 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 354/713] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:28.191112 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05dc9e-9f37-4bcf-81bf-b4979c820bdf None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:28.208619 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:28.211268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:28.266160 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831d1e1c-797d-4926-a1f9-44f38ca8dcee None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:28.297568 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05dc9e-9f37-4bcf-81bf-b4979c820bdf None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:28.312311 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ffb09-00de-443a-9545-d9ad21a58977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:28.313427 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ffb09-00de-443a-9545-d9ad21a58977 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:28.314057 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ffb09-00de-443a-9545-d9ad21a58977 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:28.314581 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91ffb09-00de-443a-9545-d9ad21a58977 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:28.315520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ffb09-00de-443a-9545-d9ad21a58977 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:28.318935 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ffb09-00de-443a-9545-d9ad21a58977 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:28.318935 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91ffb09-00de-443a-9545-d9ad21a58977 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:28.326543 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 360/714] 10.222.0.59 () {56 vars in 1124 bytes} [Tue Sep 13 19:44:28 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:28.327836 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ffb09-00de-443a-9545-d9ad21a58977 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:28.360656 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88760a-1124-4bd7-a1e4-2f3cfb864027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:28.361712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88760a-1124-4bd7-a1e4-2f3cfb864027 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:28.362290 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88760a-1124-4bd7-a1e4-2f3cfb864027 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:28.362816 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f88760a-1124-4bd7-a1e4-2f3cfb864027 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:28.365954 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88760a-1124-4bd7-a1e4-2f3cfb864027 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:28.367727 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f88760a-1124-4bd7-a1e4-2f3cfb864027 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:28.476627 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 355/715] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Sep 13 19:44:28 2022] POST /identity/v3/users => generated 254 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:44:28.476627 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88760a-1124-4bd7-a1e4-2f3cfb864027 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:28.491753 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91ffb09-00de-443a-9545-d9ad21a58977 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:28.505725 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:28.557405 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ae592-8370-42a5-b6cd-99884c202e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:28.558190 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ae592-8370-42a5-b6cd-99884c202e73 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:28.558571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ae592-8370-42a5-b6cd-99884c202e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:28.558916 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397ae592-8370-42a5-b6cd-99884c202e73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:28.559789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ae592-8370-42a5-b6cd-99884c202e73 None admin] RBAC: Adding query filter params (role.id=cd02ef2043de492a8bff6c165485f255, scope.project.id=ad67761fec0a430181877e216e90e7d4, user.id=3919b24291f54df99a9da0f5d3164ccf) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:28.560100 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ae592-8370-42a5-b6cd-99884c202e73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:28.561559 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397ae592-8370-42a5-b6cd-99884c202e73 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:28.569910 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 361/716] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:28 2022] GET /identity/v3/role_assignments?user.id=3919b24291f54df99a9da0f5d3164ccf&scope.project.id=ad67761fec0a430181877e216e90e7d4&role.id=cd02ef2043de492a8bff6c165485f255 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:28.573996 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:28.607367 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f88760a-1124-4bd7-a1e4-2f3cfb864027 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:28.651377 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122a8da-72bf-405d-9bba-667130c30a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:28.652033 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122a8da-72bf-405d-9bba-667130c30a09 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:28.652313 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122a8da-72bf-405d-9bba-667130c30a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:28.652579 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2122a8da-72bf-405d-9bba-667130c30a09 None admin] PATH_INFO: `/v3/services/network` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:28.653175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122a8da-72bf-405d-9bba-667130c30a09 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:28.654614 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2122a8da-72bf-405d-9bba-667130c30a09 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:28.667764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-2122a8da-72bf-405d-9bba-667130c30a09 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:44:28.667764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:28.667764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:44:28.667764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:44:28.667764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:44:28.667764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:44:28.667764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:44:28.667764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:28.667764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:44:28.667764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:28.667764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:44:28.667764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:28.667764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:28.667764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:28.667764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:28.667764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:28.667764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:28.668849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:28.668849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:28.668849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:28.668849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:28.668849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:28.668849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:28.668849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:44:28.668849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:44:28.668849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:44:28.668849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:44:28.668849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:28.668849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:28.668849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:28.668849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:28.668849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:28.668849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:28.669754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:28.669754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:28.669754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:28.669754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:28.669754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:28.669754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:28.669754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:28.669754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:28.669754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:28.669754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:28.669754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:44:28.669754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:28.669754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:44:28.669754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:28.669754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 356/717] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:28 2022] GET /identity/v3/services/network => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:28.675189 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ae592-8370-42a5-b6cd-99884c202e73 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:28.800950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397ae592-8370-42a5-b6cd-99884c202e73 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:28.844601 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfeab33-4b69-42fd-84cd-1b9eb56d08e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:28.845213 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfeab33-4b69-42fd-84cd-1b9eb56d08e5 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:28.845490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfeab33-4b69-42fd-84cd-1b9eb56d08e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:28.845816 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfeab33-4b69-42fd-84cd-1b9eb56d08e5 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:28.846524 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfeab33-4b69-42fd-84cd-1b9eb56d08e5 None admin] RBAC: Adding query filter params (name=network) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:28.846830 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfeab33-4b69-42fd-84cd-1b9eb56d08e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:28.848195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfeab33-4b69-42fd-84cd-1b9eb56d08e5 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:28.855593 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 362/718] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Sep 13 19:44:28 2022] GET /identity/v3/services?name=network => generated 124 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:28.861494 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122a8da-72bf-405d-9bba-667130c30a09 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:28.982165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2122a8da-72bf-405d-9bba-667130c30a09 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:29.019541 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbca52b-6d29-4f8e-abfb-3f9af25bf744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:29.020591 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbca52b-6d29-4f8e-abfb-3f9af25bf744 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:29.021623 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbca52b-6d29-4f8e-abfb-3f9af25bf744 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:29.022120 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbca52b-6d29-4f8e-abfb-3f9af25bf744 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:29.022998 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbca52b-6d29-4f8e-abfb-3f9af25bf744 None admin] RBAC: Adding query filter params (type=network) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:29.023493 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbca52b-6d29-4f8e-abfb-3f9af25bf744 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:29.025107 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbca52b-6d29-4f8e-abfb-3f9af25bf744 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:29.033977 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 357/719] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Sep 13 19:44:28 2022] GET /identity/v3/services?type=network => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:29.671663 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a061ec-9acf-4f0f-9706-5cc2c97b9c75 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:29.672225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a061ec-9acf-4f0f-9706-5cc2c97b9c75 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:29.672225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a061ec-9acf-4f0f-9706-5cc2c97b9c75 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:29.673878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 363/720] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:29.679900 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c9769-4598-4fd5-9d34-21c902216995 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:29.680759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c9769-4598-4fd5-9d34-21c902216995 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:29.681231 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2c9769-4598-4fd5-9d34-21c902216995 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:29.693922 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:29.706135 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9e2c9769-4598-4fd5-9d34-21c902216995 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:29.707427 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9e2c9769-4598-4fd5-9d34-21c902216995 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:29.789770 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 358/721] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:30.207427 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a061ec-9acf-4f0f-9706-5cc2c97b9c75 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:30.258582 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:30.325213 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a061ec-9acf-4f0f-9706-5cc2c97b9c75 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:30.367549 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea0f9f-2107-4624-a1d3-340ef0e44c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:30.368182 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea0f9f-2107-4624-a1d3-340ef0e44c9f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:30.368456 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea0f9f-2107-4624-a1d3-340ef0e44c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:30.368787 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea0f9f-2107-4624-a1d3-340ef0e44c9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:30.379017 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea0f9f-2107-4624-a1d3-340ef0e44c9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:30.385023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-aeea0f9f-2107-4624-a1d3-340ef0e44c9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:44:30.385023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:30.385023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:30.385023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:30.385023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:30.385023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:30.385023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:30.385023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:30.385023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:30.385023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:30.385023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:30.385023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:30.385023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:30.385023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:30.385023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:30.385023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:30.386067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:30.386067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:30.386067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:30.386067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:30.386067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:30.386067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:30.386067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:30.386067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:30.386067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:30.386067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:30.386067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:30.386067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:30.386067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:30.386067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:30.386067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:30.386067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:30.386948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:30.386948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:30.386948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:30.386948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:30.386948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:30.386948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:30.386948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:30.386948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:30.386948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:30.386948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:30.386948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:44:30.386948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:30.386948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 364/722] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:44:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:30.392271 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c9769-4598-4fd5-9d34-21c902216995 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:30.497324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2c9769-4598-4fd5-9d34-21c902216995 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:30.532780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:30.537717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ba340-ec03-4857-92bd-980c294f835d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:30.541924 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ba340-ec03-4857-92bd-980c294f835d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:30.542208 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ba340-ec03-4857-92bd-980c294f835d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:30.542478 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703ba340-ec03-4857-92bd-980c294f835d None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:30.543133 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ba340-ec03-4857-92bd-980c294f835d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:30.546386 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ba340-ec03-4857-92bd-980c294f835d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:30.546386 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703ba340-ec03-4857-92bd-980c294f835d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:30.553462 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 359/723] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:30.558893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea0f9f-2107-4624-a1d3-340ef0e44c9f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:30.668658 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:30.675263 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea0f9f-2107-4624-a1d3-340ef0e44c9f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:30.710753 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1e662-6f7b-4388-99dd-4e838324690e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:30.711382 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1e662-6f7b-4388-99dd-4e838324690e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:30.711658 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1e662-6f7b-4388-99dd-4e838324690e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:30.711928 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea1e662-6f7b-4388-99dd-4e838324690e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:30.722756 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1e662-6f7b-4388-99dd-4e838324690e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:30.724831 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea1e662-6f7b-4388-99dd-4e838324690e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:30.738980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-6ea1e662-6f7b-4388-99dd-4e838324690e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:30.738980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:30.738980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:30.738980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:30.738980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:30.738980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:30.738980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:30.738980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:30.738980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:30.738980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:30.738980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:30.738980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:30.738980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:30.738980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:30.738980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:30.738980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:30.740056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:30.740056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:30.740056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:30.740056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:30.740056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:30.740056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:30.740056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:30.740056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:30.740056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:30.740056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:30.740056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:30.740056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:30.740056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:30.740056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:30.740056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:30.740056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:30.740056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:30.740973 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:30.740973 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:30.740973 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:30.740973 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 365/724] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:30.746797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ba340-ec03-4857-92bd-980c294f835d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:30.907856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703ba340-ec03-4857-92bd-980c294f835d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:30.959025 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5974f84d-98bd-492d-b453-d681620a36e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:30.959633 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974f84d-98bd-492d-b453-d681620a36e7 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:30.959910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974f84d-98bd-492d-b453-d681620a36e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:30.960184 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5974f84d-98bd-492d-b453-d681620a36e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:30.960823 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974f84d-98bd-492d-b453-d681620a36e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:30.961126 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974f84d-98bd-492d-b453-d681620a36e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:30.962525 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5974f84d-98bd-492d-b453-d681620a36e7 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:30.987122 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 360/725] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:30.992776 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1e662-6f7b-4388-99dd-4e838324690e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:31.038318 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99230d6d-b3fd-4ce2-9156-2e08a185a77c None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:31.038962 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99230d6d-b3fd-4ce2-9156-2e08a185a77c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:31.039523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99230d6d-b3fd-4ce2-9156-2e08a185a77c None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:31.041459 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 361/726] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:31.052006 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260cbb5-2271-4c79-9885-b6842611cf29 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:31.052552 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260cbb5-2271-4c79-9885-b6842611cf29 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:31.053119 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6260cbb5-2271-4c79-9885-b6842611cf29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:31.081886 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6260cbb5-2271-4c79-9885-b6842611cf29 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:31.083998 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6260cbb5-2271-4c79-9885-b6842611cf29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:31.149247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:31.160144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 362/727] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 13 19:44:31.177720 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea1e662-6f7b-4388-99dd-4e838324690e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:31.237106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2343a8-060d-4f57-bc84-9a5c7dc2fbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:31.237772 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2343a8-060d-4f57-bc84-9a5c7dc2fbe2 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:31.238058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2343a8-060d-4f57-bc84-9a5c7dc2fbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:31.238335 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2343a8-060d-4f57-bc84-9a5c7dc2fbe2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:31.255279 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2343a8-060d-4f57-bc84-9a5c7dc2fbe2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:31.257010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2343a8-060d-4f57-bc84-9a5c7dc2fbe2 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:31.271823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-8c2343a8-060d-4f57-bc84-9a5c7dc2fbe2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:44:31.271823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:31.271823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:31.271823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:31.271823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:31.271823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:31.271823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:31.271823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:31.271823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:31.271823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:31.271823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:31.271823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:31.271823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:31.271823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:31.271823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:31.271823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:31.272812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:31.272812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:31.272812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:31.272812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:31.272812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:31.272812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:31.272812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:31.272812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:31.272812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:31.272812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:31.272812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:31.272812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:31.272812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:31.272812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:31.272812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:31.272812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:31.272812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:31.272812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:31.274210 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:31.274210 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:31.274210 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:31.274210 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:31.274210 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:31.274210 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:31.274210 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:31.274210 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:31.274210 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:44:31.274210 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:31.274210 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 366/728] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:44:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:31.280875 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260cbb5-2271-4c79-9885-b6842611cf29 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:31.460429 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6260cbb5-2271-4c79-9885-b6842611cf29 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:31.497715 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2343a8-060d-4f57-bc84-9a5c7dc2fbe2 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:31.508024 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:31.511310 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537f8e6d-9d26-45f8-b636-9ba9ab6d99c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:31.511928 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f8e6d-9d26-45f8-b636-9ba9ab6d99c1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:31.512207 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f8e6d-9d26-45f8-b636-9ba9ab6d99c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:31.512475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537f8e6d-9d26-45f8-b636-9ba9ab6d99c1 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:31.513207 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f8e6d-9d26-45f8-b636-9ba9ab6d99c1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:31.513511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f8e6d-9d26-45f8-b636-9ba9ab6d99c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:31.514977 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537f8e6d-9d26-45f8-b636-9ba9ab6d99c1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:31.550006 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 363/729] 10.222.0.59 () {56 vars in 1135 bytes} [Tue Sep 13 19:44:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:31.553228 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e32fc2-9798-4bf7-9a99-8b63188baa90 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:31.553513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e32fc2-9798-4bf7-9a99-8b63188baa90 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:31.553818 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e32fc2-9798-4bf7-9a99-8b63188baa90 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:31.555415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 364/730] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:31.557560 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e32fc2-9798-4bf7-9a99-8b63188baa90 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:31.607481 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:31.621860 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2343a8-060d-4f57-bc84-9a5c7dc2fbe2 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:31.657206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c51407-2429-4e85-8eab-d84add0fe089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:31.657828 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c51407-2429-4e85-8eab-d84add0fe089 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:31.658111 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c51407-2429-4e85-8eab-d84add0fe089 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:31.658390 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c51407-2429-4e85-8eab-d84add0fe089 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:31.659050 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c51407-2429-4e85-8eab-d84add0fe089 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:31.660408 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c51407-2429-4e85-8eab-d84add0fe089 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:31.669022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e32fc2-9798-4bf7-9a99-8b63188baa90 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:31.703875 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2910260-02b3-4aeb-b69a-e6adba69261f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:31.704506 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2910260-02b3-4aeb-b69a-e6adba69261f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:31.704803 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2910260-02b3-4aeb-b69a-e6adba69261f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:31.705161 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2910260-02b3-4aeb-b69a-e6adba69261f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:31.765359 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 367/731] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Sep 13 19:44:31 2022] POST /identity/v3/services => generated 251 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:44:31.775782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face573b-2f4a-414c-9fe1-c690db5d1046 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:31.776988 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face573b-2f4a-414c-9fe1-c690db5d1046 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:31.777374 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-face573b-2f4a-414c-9fe1-c690db5d1046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:31.779440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2910260-02b3-4aeb-b69a-e6adba69261f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:31.781978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2910260-02b3-4aeb-b69a-e6adba69261f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:31.804154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-face573b-2f4a-414c-9fe1-c690db5d1046 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:31.806424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-face573b-2f4a-414c-9fe1-c690db5d1046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:31.834312 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:31.882841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:31.907195 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 365/732] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 13 19:44:31.907195 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a668608-65bd-4cb5-a89f-c0d68410de38 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:31.907195 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a668608-65bd-4cb5-a89f-c0d68410de38 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:31.907195 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a668608-65bd-4cb5-a89f-c0d68410de38 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:31.907195 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 366/733] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:31.907722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f46689-1b3f-44bf-8d48-6c6d9014fcac None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:31.907795 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f46689-1b3f-44bf-8d48-6c6d9014fcac None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:31.908052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f46689-1b3f-44bf-8d48-6c6d9014fcac None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:31.909518 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 367/734] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:31 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:31.914847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f46689-1b3f-44bf-8d48-6c6d9014fcac None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:31.915728 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 368/735] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:31.926083 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872a0da-f97c-4a28-bbd0-fd4b871ed392 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:31.926083 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872a0da-f97c-4a28-bbd0-fd4b871ed392 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:31.926083 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872a0da-f97c-4a28-bbd0-fd4b871ed392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:31.939427 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e872a0da-f97c-4a28-bbd0-fd4b871ed392 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:31.941959 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e872a0da-f97c-4a28-bbd0-fd4b871ed392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:32.036926 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 369/736] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:32.038201 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338de460-8e6e-4f37-99ee-8c0250d300e7 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:32.038492 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338de460-8e6e-4f37-99ee-8c0250d300e7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:32.038816 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338de460-8e6e-4f37-99ee-8c0250d300e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:32.058943 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-338de460-8e6e-4f37-99ee-8c0250d300e7 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:32.060132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-338de460-8e6e-4f37-99ee-8c0250d300e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:32.062343 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f46689-1b3f-44bf-8d48-6c6d9014fcac None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:32.135280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef734e-f571-40b4-9c8d-4cfec21ca5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:32.135900 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef734e-f571-40b4-9c8d-4cfec21ca5cf None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:32.136144 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 370/737] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:32 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 13 19:44:32.136242 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef734e-f571-40b4-9c8d-4cfec21ca5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:32.136421 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ef734e-f571-40b4-9c8d-4cfec21ca5cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:32.148656 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef734e-f571-40b4-9c8d-4cfec21ca5cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:32.150187 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ef734e-f571-40b4-9c8d-4cfec21ca5cf None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:32.151993 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:32.173938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-21ef734e-f571-40b4-9c8d-4cfec21ca5cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:32.173938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:32.173938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:32.173938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:32.173938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:32.173938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:32.173938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:32.173938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:32.173938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:32.173938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:32.173938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:32.173938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:32.173938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:32.173938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:32.173938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:32.173938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:32.174943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:32.174943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:32.174943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:32.174943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:32.174943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:32.174943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:32.174943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:32.174943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:32.174943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:32.174943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:32.174943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:32.174943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:32.174943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:32.174943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:32.174943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:32.174943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:32.174943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:32.176486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:32.176486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:32.176486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:32.176486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 368/738] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:32.182610 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338de460-8e6e-4f37-99ee-8c0250d300e7 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:32.209655 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef734e-f571-40b4-9c8d-4cfec21ca5cf None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:32.250727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:32.312341 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338de460-8e6e-4f37-99ee-8c0250d300e7 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:32.378108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8987f-f0ab-4ca6-b441-710a3abde555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:32.378719 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8987f-f0ab-4ca6-b441-710a3abde555 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:32.378993 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8987f-f0ab-4ca6-b441-710a3abde555 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:32.379258 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f8987f-f0ab-4ca6-b441-710a3abde555 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:32.379934 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8987f-f0ab-4ca6-b441-710a3abde555 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:32.380232 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8987f-f0ab-4ca6-b441-710a3abde555 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:32.381890 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f8987f-f0ab-4ca6-b441-710a3abde555 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:32.399972 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 371/739] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:32.399972 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8987f-f0ab-4ca6-b441-710a3abde555 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:32.414937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ef734e-f571-40b4-9c8d-4cfec21ca5cf None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:32.450310 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c580c-b233-4e69-b2ac-8eaf579ac511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:32.450934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c580c-b233-4e69-b2ac-8eaf579ac511 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:32.451218 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c580c-b233-4e69-b2ac-8eaf579ac511 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:32.451491 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c580c-b233-4e69-b2ac-8eaf579ac511 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:32.462309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c580c-b233-4e69-b2ac-8eaf579ac511 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:32.468213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-f97c580c-b233-4e69-b2ac-8eaf579ac511 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:44:32.468213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:32.468213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:32.468213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:32.468213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:32.468213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:32.468213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:32.468213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:32.468213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:32.468213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:32.468213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:32.468213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:32.468213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:32.468213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:32.468213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:32.468213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:32.469173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:32.469173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:32.469173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:32.469173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:32.469173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:32.469173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:32.469173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:32.469173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:32.469173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:32.469173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:32.469173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:32.469173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:32.469173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:32.469173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:32.469173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:32.469173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:32.470532 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:32.470532 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:32.470532 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:32.470532 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:32.470532 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:32.470532 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:32.470532 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:32.470532 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:32.470532 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:32.470532 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:32.470532 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:44:32.470532 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:32.470532 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 369/740] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:44:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:32.470532 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c580c-b233-4e69-b2ac-8eaf579ac511 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:32.508872 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f8987f-f0ab-4ca6-b441-710a3abde555 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:32.522680 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:32.537103 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:32.544000 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca95c88-2ac4-4623-b9ba-34b176ced457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:32.544636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca95c88-2ac4-4623-b9ba-34b176ced457 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:32.544925 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca95c88-2ac4-4623-b9ba-34b176ced457 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:32.545203 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca95c88-2ac4-4623-b9ba-34b176ced457 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:32.560532 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca95c88-2ac4-4623-b9ba-34b176ced457 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:32.565891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-6ca95c88-2ac4-4623-b9ba-34b176ced457 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:32.565891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:32.565891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:32.565891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:32.565891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:32.565891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:32.565891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:32.565891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:32.565891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:32.565891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:32.565891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:32.565891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:32.565891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:32.565891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:32.565891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:32.565891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:32.567538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:32.567538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:32.567538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:32.567538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:32.567538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:32.567538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:32.567538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:32.567538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:32.567538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:32.567538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:32.567538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:32.567538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:32.567538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:32.567538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:32.567538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:32.567538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:32.568585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:32.568585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:32.568585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:32.568585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:32.568585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:32.568585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:32.568585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:32.568585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:32.568585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:32.568585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:32.568585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:32.568585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:32.568585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 372/741] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:32.568585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca95c88-2ac4-4623-b9ba-34b176ced457 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:32.589391 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c580c-b233-4e69-b2ac-8eaf579ac511 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:32.624023 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6789727-2cf2-40ef-9ada-5cf21d86f23c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:32.624649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6789727-2cf2-40ef-9ada-5cf21d86f23c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:32.624925 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6789727-2cf2-40ef-9ada-5cf21d86f23c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:32.625195 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6789727-2cf2-40ef-9ada-5cf21d86f23c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:32.632725 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6789727-2cf2-40ef-9ada-5cf21d86f23c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:32.634195 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6789727-2cf2-40ef-9ada-5cf21d86f23c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:32.645856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-a6789727-2cf2-40ef-9ada-5cf21d86f23c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:32.645856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:32.645856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:32.645856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:32.645856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:32.645856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:32.645856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:32.645856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:32.645856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:32.645856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:32.645856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:32.645856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:32.645856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:32.645856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:32.645856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:32.646851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:32.646851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:32.646851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:32.646851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:32.646851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:32.646851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:32.646851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:32.646851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:32.646851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:32.646851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:32.646851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:32.646851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:32.646851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:32.646851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:32.646851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:32.646851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:32.646851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:32.647784 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:32.647784 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:32.647784 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:32.647784 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:32.647784 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:32.647784 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:32.647784 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:32.647784 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:32.647784 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 370/742] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:32.647784 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6789727-2cf2-40ef-9ada-5cf21d86f23c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:32.681986 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca95c88-2ac4-4623-b9ba-34b176ced457 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:32.717566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d98fe0-e41f-4835-a689-cbf1903dde46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:32.718209 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d98fe0-e41f-4835-a689-cbf1903dde46 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:32.718494 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d98fe0-e41f-4835-a689-cbf1903dde46 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:32.718761 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d98fe0-e41f-4835-a689-cbf1903dde46 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:32.719422 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d98fe0-e41f-4835-a689-cbf1903dde46 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:32.720788 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d98fe0-e41f-4835-a689-cbf1903dde46 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:32.748083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6789727-2cf2-40ef-9ada-5cf21d86f23c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:32.762353 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:32.783180 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9b2ed-a396-456c-8f60-2f5417af2e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:32.783843 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9b2ed-a396-456c-8f60-2f5417af2e1e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:32.784057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9b2ed-a396-456c-8f60-2f5417af2e1e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:32.784322 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f9b2ed-a396-456c-8f60-2f5417af2e1e None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:32.784984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9b2ed-a396-456c-8f60-2f5417af2e1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:32.785280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9b2ed-a396-456c-8f60-2f5417af2e1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:32.786794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f9b2ed-a396-456c-8f60-2f5417af2e1e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:32.796242 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 371/743] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:32.797091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9b2ed-a396-456c-8f60-2f5417af2e1e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:32.804123 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 373/744] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Sep 13 19:44:32 2022] POST /identity/v3/services => generated 240 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:44:32.805631 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d98fe0-e41f-4835-a689-cbf1903dde46 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:32.852451 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:32.950144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f9b2ed-a396-456c-8f60-2f5417af2e1e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:32.965599 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d98fe0-e41f-4835-a689-cbf1903dde46 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:32.991443 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cb880-2c8b-4692-b100-05e02b4cb60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:32.992459 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cb880-2c8b-4692-b100-05e02b4cb60e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:32.992947 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cb880-2c8b-4692-b100-05e02b4cb60e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:32.993425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294cb880-2c8b-4692-b100-05e02b4cb60e None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:32.994370 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cb880-2c8b-4692-b100-05e02b4cb60e None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:32.994902 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cb880-2c8b-4692-b100-05e02b4cb60e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:32.996309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294cb880-2c8b-4692-b100-05e02b4cb60e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:33.005324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 372/745] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:33.006244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cb880-2c8b-4692-b100-05e02b4cb60e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:33.009237 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03518629-5368-436b-a782-04332320108d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:33.010193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03518629-5368-436b-a782-04332320108d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:33.010642 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03518629-5368-436b-a782-04332320108d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:33.010951 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03518629-5368-436b-a782-04332320108d None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:33.011658 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03518629-5368-436b-a782-04332320108d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:33.011959 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03518629-5368-436b-a782-04332320108d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:33.013442 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03518629-5368-436b-a782-04332320108d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:33.025659 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 374/746] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:33.026472 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03518629-5368-436b-a782-04332320108d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:33.055776 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:33.117917 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294cb880-2c8b-4692-b100-05e02b4cb60e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:33.125229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:33.141945 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03518629-5368-436b-a782-04332320108d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:33.155127 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c43cb5-e550-4fbd-b18f-d4f0706f7dda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:33.156093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c43cb5-e550-4fbd-b18f-d4f0706f7dda None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:33.156583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c43cb5-e550-4fbd-b18f-d4f0706f7dda None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:33.156967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c43cb5-e550-4fbd-b18f-d4f0706f7dda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:33.168472 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c43cb5-e550-4fbd-b18f-d4f0706f7dda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:33.170112 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c43cb5-e550-4fbd-b18f-d4f0706f7dda None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:33.184019 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249f026-4453-4e51-b126-ef91fa6a7b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:33.184853 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249f026-4453-4e51-b126-ef91fa6a7b8a None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:33.185300 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249f026-4453-4e51-b126-ef91fa6a7b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:33.185734 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f249f026-4453-4e51-b126-ef91fa6a7b8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:33.187039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-a9c43cb5-e550-4fbd-b18f-d4f0706f7dda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:33.187039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:33.187039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:33.187039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:33.187039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:33.187039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:33.187039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:33.187039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:33.187039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:33.187039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:33.187039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:33.187039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:33.187039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:33.187039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:33.187039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:33.187039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:33.188021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:33.188021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:33.188021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:33.188021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:33.188021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:33.188021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:33.188021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:33.188021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:33.188021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:33.188021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:33.188021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:33.188021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:33.188021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:33.188021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:33.188021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:33.188021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:33.188021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:33.189028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:33.189028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:33.189028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:33.193579 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 373/747] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:33.194466 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c43cb5-e550-4fbd-b18f-d4f0706f7dda None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:33.201776 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f249f026-4453-4e51-b126-ef91fa6a7b8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:33.204222 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f249f026-4453-4e51-b126-ef91fa6a7b8a None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:33.223797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-f249f026-4453-4e51-b126-ef91fa6a7b8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:33.223797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:33.223797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:33.223797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:33.223797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:33.223797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:33.223797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:33.223797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:33.223797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:33.223797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:33.223797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:33.223797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:33.223797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:33.223797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:33.223797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:33.223797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:33.224848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:33.224848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:33.224848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:33.224848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:33.224848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:33.224848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:33.224848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:33.224848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:33.224848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:33.224848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:33.224848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:33.224848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:33.224848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:33.224848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:33.224848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:33.224848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:33.224848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:33.225778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:33.225778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:33.225778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:33.227058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 375/748] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:33.228796 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249f026-4453-4e51-b126-ef91fa6a7b8a None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:33.297119 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:33.308010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c43cb5-e550-4fbd-b18f-d4f0706f7dda None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:33.343530 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce98fcb-75ae-4fa0-8983-0cb6c275abe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:33.345374 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce98fcb-75ae-4fa0-8983-0cb6c275abe3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:33.345374 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce98fcb-75ae-4fa0-8983-0cb6c275abe3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:33.345374 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce98fcb-75ae-4fa0-8983-0cb6c275abe3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:33.345624 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce98fcb-75ae-4fa0-8983-0cb6c275abe3 None admin] RBAC: Adding query filter params (role.id=cd02ef2043de492a8bff6c165485f255, scope.project.id=ad67761fec0a430181877e216e90e7d4, user.id=c00e78bf5e5c4db29c47dce1e87f3f5a) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:33.345881 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce98fcb-75ae-4fa0-8983-0cb6c275abe3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:33.347200 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce98fcb-75ae-4fa0-8983-0cb6c275abe3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:33.354379 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 374/749] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:33 2022] GET /identity/v3/role_assignments?user.id=c00e78bf5e5c4db29c47dce1e87f3f5a&scope.project.id=ad67761fec0a430181877e216e90e7d4&role.id=cd02ef2043de492a8bff6c165485f255 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:33.355368 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce98fcb-75ae-4fa0-8983-0cb6c275abe3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:33.369459 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f249f026-4453-4e51-b126-ef91fa6a7b8a None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:33.411172 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f33de-4b32-4f6c-95c0-0dd9d0e8f521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:33.411804 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f33de-4b32-4f6c-95c0-0dd9d0e8f521 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:33.412083 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f33de-4b32-4f6c-95c0-0dd9d0e8f521 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:33.412352 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f33de-4b32-4f6c-95c0-0dd9d0e8f521 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:33.413007 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f33de-4b32-4f6c-95c0-0dd9d0e8f521 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:33.413311 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f33de-4b32-4f6c-95c0-0dd9d0e8f521 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:33.415052 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f33de-4b32-4f6c-95c0-0dd9d0e8f521 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:33.431997 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:33.437731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 376/750] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:33.443541 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f33de-4b32-4f6c-95c0-0dd9d0e8f521 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:33.572861 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce98fcb-75ae-4fa0-8983-0cb6c275abe3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:33.579654 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f33de-4b32-4f6c-95c0-0dd9d0e8f521 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:33.612436 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07910fa0-7abd-424e-8246-66406c0c38d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:33.613000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07910fa0-7abd-424e-8246-66406c0c38d0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:33.613281 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07910fa0-7abd-424e-8246-66406c0c38d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:33.613556 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07910fa0-7abd-424e-8246-66406c0c38d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:33.614811 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07910fa0-7abd-424e-8246-66406c0c38d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:33.615274 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07910fa0-7abd-424e-8246-66406c0c38d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:33.616923 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07910fa0-7abd-424e-8246-66406c0c38d0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:33.634567 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e090179-cf35-4859-acb0-85e70dc161f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:33.635542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e090179-cf35-4859-acb0-85e70dc161f2 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:33.636029 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e090179-cf35-4859-acb0-85e70dc161f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:33.636492 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e090179-cf35-4859-acb0-85e70dc161f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:33.638658 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 375/751] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:33.646461 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07910fa0-7abd-424e-8246-66406c0c38d0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:33.650502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e090179-cf35-4859-acb0-85e70dc161f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:33.653856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e090179-cf35-4859-acb0-85e70dc161f2 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:33.678052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:33.679327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-9e090179-cf35-4859-acb0-85e70dc161f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:44:33.679327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:33.679327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:33.679327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:33.679327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:33.679327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:33.679327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:33.679327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:33.679327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:33.679327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:33.679327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:33.679327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:33.679327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:33.679327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:33.679327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:33.679327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:33.680272 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:33.680272 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:33.680272 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:33.680272 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:33.680272 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:33.680272 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:33.680272 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:33.680272 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:33.680272 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:33.680272 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:33.680272 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:33.680272 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:33.680272 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:33.680272 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:33.680272 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:33.680272 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:33.680272 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:33.680272 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:33.681231 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:33.681231 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:33.681231 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:33.681231 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:33.681231 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:33.681231 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:33.681231 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:33.681231 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:33.681231 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:44:33.681231 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:33.687259 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 377/752] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Sep 13 19:44:33 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:33.688131 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e090179-cf35-4859-acb0-85e70dc161f2 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:33.795810 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:33.819423 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07910fa0-7abd-424e-8246-66406c0c38d0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:33.844128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e090179-cf35-4859-acb0-85e70dc161f2 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:33.861753 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06523cb-1e08-4979-8bec-2ac7e1a475a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:33.861753 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06523cb-1e08-4979-8bec-2ac7e1a475a6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:33.861753 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06523cb-1e08-4979-8bec-2ac7e1a475a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:33.861753 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06523cb-1e08-4979-8bec-2ac7e1a475a6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:33.862827 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06523cb-1e08-4979-8bec-2ac7e1a475a6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:33.864777 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06523cb-1e08-4979-8bec-2ac7e1a475a6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:33.877642 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-a06523cb-1e08-4979-8bec-2ac7e1a475a6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:44:33.877642 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:33.877642 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:33.877642 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:33.877642 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:33.877642 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:33.877642 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:33.877642 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:33.877642 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:33.877642 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:33.877642 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:33.877642 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:33.877642 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:33.877642 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:33.877642 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:33.877642 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:33.878695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:33.878695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:33.878695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:33.878695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:33.878695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:33.878695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:33.878695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:33.878695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:33.878695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:33.878695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:33.878695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:33.878695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:33.878695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:33.878695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:33.878695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:33.878695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:33.878695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:33.878695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:33.879712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:33.879712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:33.879712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:33.879712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:33.879712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:33.879712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:33.879712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:33.879712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:33.879712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:44:33.879712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:33.879712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 376/753] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Sep 13 19:44:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:33.885264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06523cb-1e08-4979-8bec-2ac7e1a475a6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:33.902660 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb284e-349a-4db4-8ebe-500d0bf3bc02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:33.903758 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb284e-349a-4db4-8ebe-500d0bf3bc02 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:33.904264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb284e-349a-4db4-8ebe-500d0bf3bc02 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:33.904743 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb284e-349a-4db4-8ebe-500d0bf3bc02 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:33.905790 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb284e-349a-4db4-8ebe-500d0bf3bc02 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:33.906314 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb284e-349a-4db4-8ebe-500d0bf3bc02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:33.910234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbb284e-349a-4db4-8ebe-500d0bf3bc02 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:33.949717 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 378/754] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Sep 13 19:44:33 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:33.950608 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb284e-349a-4db4-8ebe-500d0bf3bc02 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:34.044229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:34.093828 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06523cb-1e08-4979-8bec-2ac7e1a475a6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:34.099068 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbb284e-349a-4db4-8ebe-500d0bf3bc02 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:34.118090 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:34.139458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e05489-fb78-4dee-9ad0-88519eb11b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:34.140020 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e05489-fb78-4dee-9ad0-88519eb11b3f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:34.141211 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e05489-fb78-4dee-9ad0-88519eb11b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:34.141491 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e05489-fb78-4dee-9ad0-88519eb11b3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:34.157746 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1781b793-e449-40b3-a24b-a2f7aa0179f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:34.158419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781b793-e449-40b3-a24b-a2f7aa0179f5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:34.158702 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781b793-e449-40b3-a24b-a2f7aa0179f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:34.159047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1781b793-e449-40b3-a24b-a2f7aa0179f5 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:34.160668 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781b793-e449-40b3-a24b-a2f7aa0179f5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:34.161117 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781b793-e449-40b3-a24b-a2f7aa0179f5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:34.161556 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e05489-fb78-4dee-9ad0-88519eb11b3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:34.162596 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1781b793-e449-40b3-a24b-a2f7aa0179f5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:34.163036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e05489-fb78-4dee-9ad0-88519eb11b3f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:34.186637 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 377/755] 10.222.0.59 () {56 vars in 1149 bytes} [Tue Sep 13 19:44:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:34.188030 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea61e81-8b51-4ad9-919b-9dce1ae7c417 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:34.188318 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea61e81-8b51-4ad9-919b-9dce1ae7c417 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:34.188590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea61e81-8b51-4ad9-919b-9dce1ae7c417 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:34.190013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-13e05489-fb78-4dee-9ad0-88519eb11b3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:34.190013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:34.190013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:34.190013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:34.190013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:34.190013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:34.190013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:34.190013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:34.190013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:34.190013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:34.190013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:34.190013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:34.190013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:34.190013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:34.190013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:34.190013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:34.191010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:34.191010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:34.191010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:34.191010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:34.191010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:34.191010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:34.191010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:34.191010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:34.191010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:34.191010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:34.191010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:34.191010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:34.191010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:34.191010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:34.191010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:34.191010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:34.191010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:34.192867 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:34.192867 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:34.192867 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:34.193057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 378/756] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:34.193057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea61e81-8b51-4ad9-919b-9dce1ae7c417 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:34.195811 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 379/757] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:34.197035 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1e906-3368-4d9e-ac41-4f7ef885b9b0 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:34.197316 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1e906-3368-4d9e-ac41-4f7ef885b9b0 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:34.197590 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e1e906-3368-4d9e-ac41-4f7ef885b9b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:34.221900 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-76e1e906-3368-4d9e-ac41-4f7ef885b9b0 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:34.223134 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-76e1e906-3368-4d9e-ac41-4f7ef885b9b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:34.294517 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 380/758] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:44:34.295463 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1e906-3368-4d9e-ac41-4f7ef885b9b0 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:34.327879 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea61e81-8b51-4ad9-919b-9dce1ae7c417 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:34.383327 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:34.392707 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165b68a-ff25-42f6-a32f-679654398676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:34.393264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165b68a-ff25-42f6-a32f-679654398676 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:34.393638 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165b68a-ff25-42f6-a32f-679654398676 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:34.393929 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c165b68a-ff25-42f6-a32f-679654398676 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:34.399897 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:34.403045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e1e906-3368-4d9e-ac41-4f7ef885b9b0 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:34.439428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f772a45-1a32-48e5-ab95-6c9c2a555a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:34.440044 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f772a45-1a32-48e5-ab95-6c9c2a555a4d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:34.440325 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f772a45-1a32-48e5-ab95-6c9c2a555a4d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:34.440596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f772a45-1a32-48e5-ab95-6c9c2a555a4d None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:34.441244 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f772a45-1a32-48e5-ab95-6c9c2a555a4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:34.441546 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f772a45-1a32-48e5-ab95-6c9c2a555a4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:34.443588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f772a45-1a32-48e5-ab95-6c9c2a555a4d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:34.455650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 381/759] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:34.462210 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f772a45-1a32-48e5-ab95-6c9c2a555a4d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:34.475260 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165b68a-ff25-42f6-a32f-679654398676 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:34.476817 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c165b68a-ff25-42f6-a32f-679654398676 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:34.573515 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f772a45-1a32-48e5-ab95-6c9c2a555a4d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:34.582304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 379/760] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:44:34.587318 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165b68a-ff25-42f6-a32f-679654398676 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:34.622254 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:34.631626 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef3845-0193-47e8-ae3d-e68051434a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:34.636015 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef3845-0193-47e8-ae3d-e68051434a5f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:34.636015 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef3845-0193-47e8-ae3d-e68051434a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:34.636015 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ef3845-0193-47e8-ae3d-e68051434a5f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:34.640737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef3845-0193-47e8-ae3d-e68051434a5f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:34.642496 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ef3845-0193-47e8-ae3d-e68051434a5f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:34.655060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-42ef3845-0193-47e8-ae3d-e68051434a5f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:34.655060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:34.655060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:34.655060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:34.655060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:34.655060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:34.655060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:34.655060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:34.655060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:34.655060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:34.655060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:34.655060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:34.655060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:34.655060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:34.655060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:34.655947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:34.655947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:34.655947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:34.655947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:34.655947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:34.655947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:34.655947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:34.655947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:34.655947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:34.655947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:34.655947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:34.655947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:34.655947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:34.655947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:34.655947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:34.655947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:34.655947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:34.657265 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:34.657265 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:34.657265 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:34.657265 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:34.657265 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:34.657265 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:34.657265 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:34.657265 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:34.659390 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 382/761] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:34.668132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef3845-0193-47e8-ae3d-e68051434a5f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:34.718303 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:34.730849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c165b68a-ff25-42f6-a32f-679654398676 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:34.767071 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54223d-9a18-4e72-98e7-5f05952e8246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:34.767782 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54223d-9a18-4e72-98e7-5f05952e8246 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:34.768127 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54223d-9a18-4e72-98e7-5f05952e8246 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:34.768539 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc54223d-9a18-4e72-98e7-5f05952e8246 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:34.779274 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54223d-9a18-4e72-98e7-5f05952e8246 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:34.780894 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc54223d-9a18-4e72-98e7-5f05952e8246 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:34.796826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-dc54223d-9a18-4e72-98e7-5f05952e8246 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:34.796826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:34.796826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:34.796826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:34.796826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:34.796826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:34.796826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:34.796826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:34.796826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:34.796826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:34.796826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:34.796826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:34.796826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:34.796826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:34.796826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:34.796826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:34.797872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:34.797872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:34.797872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:34.797872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:34.797872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:34.797872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:34.797872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:34.797872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:34.797872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:34.797872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:34.797872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:34.797872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:34.797872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:34.797872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:34.797872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:34.797872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:34.797872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:34.799014 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:34.799014 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:34.799014 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:34.803864 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 380/762] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:34.804766 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54223d-9a18-4e72-98e7-5f05952e8246 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:34.818109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ef3845-0193-47e8-ae3d-e68051434a5f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:34.862332 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843f21d-1165-42bd-a709-0f042cb4359d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:34.863320 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843f21d-1165-42bd-a709-0f042cb4359d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:34.863463 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843f21d-1165-42bd-a709-0f042cb4359d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:34.869712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a843f21d-1165-42bd-a709-0f042cb4359d None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:34.869712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843f21d-1165-42bd-a709-0f042cb4359d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:34.869712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843f21d-1165-42bd-a709-0f042cb4359d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:34.869712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a843f21d-1165-42bd-a709-0f042cb4359d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:34.888030 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 383/763] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:34.888030 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843f21d-1165-42bd-a709-0f042cb4359d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:34.901888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:34.923506 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc54223d-9a18-4e72-98e7-5f05952e8246 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:34.968164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11693c06-c474-4369-9ed6-0461ae047699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:34.969143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11693c06-c474-4369-9ed6-0461ae047699 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:34.969626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11693c06-c474-4369-9ed6-0461ae047699 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:34.970152 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11693c06-c474-4369-9ed6-0461ae047699 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:34.971352 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11693c06-c474-4369-9ed6-0461ae047699 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:34.973874 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11693c06-c474-4369-9ed6-0461ae047699 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:34.977295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:34.985724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-11693c06-c474-4369-9ed6-0461ae047699 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:44:34.985724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:34.985724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:44:34.985724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:44:34.985724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:44:34.985724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:44:34.985724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:44:34.985724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:34.985724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:44:34.985724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:34.985724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:44:34.985724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:34.985724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:34.985724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:34.985724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:34.985724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:34.985724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:34.993626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:34.993626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:34.993626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:34.993626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:34.993626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:34.993626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:34.993626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:44:34.993626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:44:34.993626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:44:34.993626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:44:34.993626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:34.993626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:34.993626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:34.993626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:34.993626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:34.993626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:34.994507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:34.994507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:34.994507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:34.994507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:34.994507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:34.994507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:34.994507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:34.994507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:34.994507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:34.994507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:34.994507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:44:34.994507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:34.994507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:44:34.994507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:34.994507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 381/764] 10.222.0.59 () {56 vars in 1129 bytes} [Tue Sep 13 19:44:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:34.995317 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11693c06-c474-4369-9ed6-0461ae047699 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:35.007867 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a843f21d-1165-42bd-a709-0f042cb4359d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:35.045020 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8139014-b6b1-4dff-b618-cfe06a6949d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:35.046084 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8139014-b6b1-4dff-b618-cfe06a6949d2 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:35.046866 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8139014-b6b1-4dff-b618-cfe06a6949d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:35.047336 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8139014-b6b1-4dff-b618-cfe06a6949d2 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:35.048190 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8139014-b6b1-4dff-b618-cfe06a6949d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:35.048781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8139014-b6b1-4dff-b618-cfe06a6949d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:35.050468 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8139014-b6b1-4dff-b618-cfe06a6949d2 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:35.068119 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 384/765] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:35.069458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8139014-b6b1-4dff-b618-cfe06a6949d2 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:35.102581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11693c06-c474-4369-9ed6-0461ae047699 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:35.137668 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c012fd8-bd44-4710-8067-88a7abe3472e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:35.138413 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c012fd8-bd44-4710-8067-88a7abe3472e None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:35.138698 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c012fd8-bd44-4710-8067-88a7abe3472e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:35.138967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c012fd8-bd44-4710-8067-88a7abe3472e None admin] PATH_INFO: `/v3/projects/ad67761fec0a430181877e216e90e7d4/users/3919b24291f54df99a9da0f5d3164ccf/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:35.140912 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c012fd8-bd44-4710-8067-88a7abe3472e None admin] RBAC: Authorizing `identity:create_grant(project_id=ad67761fec0a430181877e216e90e7d4, user_id=3919b24291f54df99a9da0f5d3164ccf, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:35.142369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c012fd8-bd44-4710-8067-88a7abe3472e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:35.179858 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8139014-b6b1-4dff-b618-cfe06a6949d2 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:35.215148 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4b7d6-d85e-400b-b08f-c29d1fa2f52a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:35.215848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4b7d6-d85e-400b-b08f-c29d1fa2f52a None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:35.216188 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4b7d6-d85e-400b-b08f-c29d1fa2f52a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:35.216528 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4b7d6-d85e-400b-b08f-c29d1fa2f52a None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:35.221776 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4b7d6-d85e-400b-b08f-c29d1fa2f52a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:35.221776 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4b7d6-d85e-400b-b08f-c29d1fa2f52a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:35.221776 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4b7d6-d85e-400b-b08f-c29d1fa2f52a None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:35.222175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 382/766] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Sep 13 19:44:34 2022] PUT /identity/v3/projects/ad67761fec0a430181877e216e90e7d4/users/3919b24291f54df99a9da0f5d3164ccf/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:44:35.224549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c012fd8-bd44-4710-8067-88a7abe3472e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:35.230292 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 385/767] 10.222.0.59 () {56 vars in 1124 bytes} [Tue Sep 13 19:44:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:35.235469 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4b7d6-d85e-400b-b08f-c29d1fa2f52a None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:35.244027 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:35.251013 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:35.405579 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c012fd8-bd44-4710-8067-88a7abe3472e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:35.417205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4b7d6-d85e-400b-b08f-c29d1fa2f52a None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:35.467647 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b5f4e-d59b-4b33-9623-5cced66aaec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:35.468630 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b5f4e-d59b-4b33-9623-5cced66aaec0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:35.469116 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b5f4e-d59b-4b33-9623-5cced66aaec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:35.470565 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b5f4e-d59b-4b33-9623-5cced66aaec0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:35.474786 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9770c7-e401-4685-8c61-0d2e59f99b28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:35.475100 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9770c7-e401-4685-8c61-0d2e59f99b28 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:35.475382 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9770c7-e401-4685-8c61-0d2e59f99b28 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:35.475650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9770c7-e401-4685-8c61-0d2e59f99b28 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:35.476277 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9770c7-e401-4685-8c61-0d2e59f99b28 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:35.476574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9770c7-e401-4685-8c61-0d2e59f99b28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:35.478018 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9770c7-e401-4685-8c61-0d2e59f99b28 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:35.480675 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b5f4e-d59b-4b33-9623-5cced66aaec0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:35.482402 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b5f4e-d59b-4b33-9623-5cced66aaec0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:35.486284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 386/768] 10.222.0.59 () {56 vars in 1124 bytes} [Tue Sep 13 19:44:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:35.497884 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9770c7-e401-4685-8c61-0d2e59f99b28 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:35.500425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-cc3b5f4e-d59b-4b33-9623-5cced66aaec0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:35.500425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:35.500425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:35.500425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:35.500425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:35.500425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:35.500425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:35.500425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:35.500425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:35.500425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:35.500425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:35.500425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:35.500425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:35.500425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:35.500425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:35.501332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:35.501332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:35.501332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:35.501332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:35.501332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:35.501332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:35.501332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:35.501332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:35.501332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:35.501332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:35.501332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:35.501332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:35.501332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:35.501332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:35.501332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:35.501332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:35.501332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:35.502314 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:35.502314 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:35.502314 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:35.502314 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:35.502314 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:35.502314 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:35.502314 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:35.502314 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:35.506725 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 383/769] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:35.513958 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b5f4e-d59b-4b33-9623-5cced66aaec0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:35.582087 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:35.616397 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:35.626530 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9770c7-e401-4685-8c61-0d2e59f99b28 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:35.656866 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b5f4e-d59b-4b33-9623-5cced66aaec0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:35.664862 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca751cd-fe20-4b87-88e3-93a29c1d4914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:35.665481 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca751cd-fe20-4b87-88e3-93a29c1d4914 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:35.665781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca751cd-fe20-4b87-88e3-93a29c1d4914 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:35.666054 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca751cd-fe20-4b87-88e3-93a29c1d4914 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:35.666747 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca751cd-fe20-4b87-88e3-93a29c1d4914 None admin] RBAC: Adding query filter params (interface=public, service_id=3d9589a504da401ba9d12947ab856b86, region_id=RegionOne) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:35.667049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca751cd-fe20-4b87-88e3-93a29c1d4914 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:35.668518 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca751cd-fe20-4b87-88e3-93a29c1d4914 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:35.677955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 387/770] 10.222.0.59 () {56 vars in 1251 bytes} [Tue Sep 13 19:44:35 2022] GET /identity/v3/endpoints?service_id=3d9589a504da401ba9d12947ab856b86&interface=public®ion_id=RegionOne => generated 194 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:35.679222 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d75f6d-0e74-4f73-988a-4bea6bf3f26f None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:35.679503 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d75f6d-0e74-4f73-988a-4bea6bf3f26f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:35.679773 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d75f6d-0e74-4f73-988a-4bea6bf3f26f None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:35.685345 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 388/771] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:35.685345 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d75f6d-0e74-4f73-988a-4bea6bf3f26f None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:35.703426 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeda9fc-b648-4a49-83c5-658e33d72b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:35.704035 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeda9fc-b648-4a49-83c5-658e33d72b04 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:35.704319 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeda9fc-b648-4a49-83c5-658e33d72b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:35.704596 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeda9fc-b648-4a49-83c5-658e33d72b04 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:35.705289 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeda9fc-b648-4a49-83c5-658e33d72b04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:35.705742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeda9fc-b648-4a49-83c5-658e33d72b04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:35.707323 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeda9fc-b648-4a49-83c5-658e33d72b04 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:35.725257 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 384/772] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:35.725257 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2362587-9145-48a4-ae37-035ad1600a1b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:35.725257 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2362587-9145-48a4-ae37-035ad1600a1b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:35.725257 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2362587-9145-48a4-ae37-035ad1600a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:35.740265 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d2362587-9145-48a4-ae37-035ad1600a1b None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:35.742035 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d2362587-9145-48a4-ae37-035ad1600a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:35.801814 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d75f6d-0e74-4f73-988a-4bea6bf3f26f None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:35.819815 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 385/773] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:44:35.819815 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00407416-67f5-4bfd-8eff-fb51dd438dd9 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:35.819815 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00407416-67f5-4bfd-8eff-fb51dd438dd9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:35.819815 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00407416-67f5-4bfd-8eff-fb51dd438dd9 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:35.819815 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 386/774] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:35.819815 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00407416-67f5-4bfd-8eff-fb51dd438dd9 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:35.850164 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:35.856749 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636ca7fb-8b02-4418-9d9e-d6f616c77952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:35.857617 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ca7fb-8b02-4418-9d9e-d6f616c77952 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:35.858163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ca7fb-8b02-4418-9d9e-d6f616c77952 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:35.858501 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636ca7fb-8b02-4418-9d9e-d6f616c77952 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:35.862577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ca7fb-8b02-4418-9d9e-d6f616c77952 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:35.862577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636ca7fb-8b02-4418-9d9e-d6f616c77952 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:35.873867 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 389/775] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Sep 13 19:44:35 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:35.875324 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d73f49-5675-4bc5-9d1c-2fb34db77ea5 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:35.875614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d73f49-5675-4bc5-9d1c-2fb34db77ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:35.875889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d73f49-5675-4bc5-9d1c-2fb34db77ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:35.915378 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-86d73f49-5675-4bc5-9d1c-2fb34db77ea5 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:35.916761 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-86d73f49-5675-4bc5-9d1c-2fb34db77ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:35.922782 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:36.011517 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00407416-67f5-4bfd-8eff-fb51dd438dd9 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:36.033707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 390/776] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:44:36.070606 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da2eee-7e15-42e5-b058-d6c6a4f6bbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:36.071587 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2eee-7e15-42e5-b058-d6c6a4f6bbae None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:36.072071 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2eee-7e15-42e5-b058-d6c6a4f6bbae None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:36.072561 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da2eee-7e15-42e5-b058-d6c6a4f6bbae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:36.073523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da2eee-7e15-42e5-b058-d6c6a4f6bbae None admin] RBAC: Adding query filter params (role.id=b253c1f3cd6a4197a85ca5f672852073, scope.project.id=ad67761fec0a430181877e216e90e7d4, user.id=9fd7a80714874e73bf64dfa392632391) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:36.074069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da2eee-7e15-42e5-b058-d6c6a4f6bbae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:36.075703 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da2eee-7e15-42e5-b058-d6c6a4f6bbae None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:36.088143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 387/777] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:35 2022] GET /identity/v3/role_assignments?user.id=9fd7a80714874e73bf64dfa392632391&scope.project.id=ad67761fec0a430181877e216e90e7d4&role.id=b253c1f3cd6a4197a85ca5f672852073 => generated 259 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:36.107732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d73f49-5675-4bc5-9d1c-2fb34db77ea5 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:36.236064 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d73f49-5675-4bc5-9d1c-2fb34db77ea5 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:36.270503 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:36.280518 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e9278-c21c-4cae-bb19-c9cbef140549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:36.281179 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e9278-c21c-4cae-bb19-c9cbef140549 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:36.281516 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e9278-c21c-4cae-bb19-c9cbef140549 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:36.289007 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396e9278-c21c-4cae-bb19-c9cbef140549 None admin] PATH_INFO: `/v3/services/network` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:36.289007 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e9278-c21c-4cae-bb19-c9cbef140549 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:36.289007 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396e9278-c21c-4cae-bb19-c9cbef140549 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:36.295056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-396e9278-c21c-4cae-bb19-c9cbef140549 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:44:36.295056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:36.295056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:44:36.295056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:44:36.295056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:44:36.295056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:44:36.295056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:44:36.295056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:36.295056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:44:36.295056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:36.295056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:44:36.295056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:36.295056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:36.295056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:36.295056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:36.295056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:36.295056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:36.296067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:36.296067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:36.296067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:36.296067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:36.296067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:36.296067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:36.296067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:44:36.296067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:44:36.296067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:44:36.296067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:44:36.296067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:36.296067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:36.296067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:36.296067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:36.296067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:36.296067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:36.296923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:36.296923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:36.296923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:36.296923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:36.296923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:36.296923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:36.296923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:36.296923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:36.296923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:36.296923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:36.296923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:44:36.296923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:36.296923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:44:36.296923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:36.297883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 391/778] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:36 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:36.306798 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da2eee-7e15-42e5-b058-d6c6a4f6bbae None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:36.353376 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e9278-c21c-4cae-bb19-c9cbef140549 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:36.461576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396e9278-c21c-4cae-bb19-c9cbef140549 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:36.498562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db8e8e-8471-4ea9-9086-a0c395a7b7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:36.499197 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db8e8e-8471-4ea9-9086-a0c395a7b7f3 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:36.499478 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db8e8e-8471-4ea9-9086-a0c395a7b7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:36.499755 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5db8e8e-8471-4ea9-9086-a0c395a7b7f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:36.511487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5db8e8e-8471-4ea9-9086-a0c395a7b7f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:36.608240 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da2eee-7e15-42e5-b058-d6c6a4f6bbae None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:36.640439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-d5db8e8e-8471-4ea9-9086-a0c395a7b7f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:44:36.640439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:36.640439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:36.640439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:36.640439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:36.640439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:36.640439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:36.640439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:36.640439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:36.640439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:36.640439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:36.640439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:36.640439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:36.640439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:36.640439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:36.640439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:36.641540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:36.641540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:36.641540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:36.641540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:36.641540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:36.641540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:36.641540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:36.641540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:36.641540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:36.641540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:36.641540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:36.641540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:36.641540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:36.641540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:36.641540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:36.641540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:36.642445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:36.642445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:36.642445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:36.642445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:36.642445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:36.642445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:36.642445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:36.642445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:36.642445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:36.642445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:36.642445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:44:36.642445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:36.642445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 392/779] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:44:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:36.648113 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db8e8e-8471-4ea9-9086-a0c395a7b7f3 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:36.660166 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:36.690431 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7b661-f22b-4e26-a4e3-933e1ce96d44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:36.691058 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7b661-f22b-4e26-a4e3-933e1ce96d44 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:36.691340 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7b661-f22b-4e26-a4e3-933e1ce96d44 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:36.691661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb7b661-f22b-4e26-a4e3-933e1ce96d44 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:36.692803 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7b661-f22b-4e26-a4e3-933e1ce96d44 None admin] RBAC: Adding query filter params (name=network) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:36.693105 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7b661-f22b-4e26-a4e3-933e1ce96d44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:36.694515 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb7b661-f22b-4e26-a4e3-933e1ce96d44 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:36.709129 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 388/780] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Sep 13 19:44:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:36.710394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:36.715767 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7b661-f22b-4e26-a4e3-933e1ce96d44 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:36.766423 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5db8e8e-8471-4ea9-9086-a0c395a7b7f3 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:36.802622 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ca148-89f3-42b9-a720-c2861b435ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:36.803538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ca148-89f3-42b9-a720-c2861b435ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:36.803969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ca148-89f3-42b9-a720-c2861b435ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:36.804391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310ca148-89f3-42b9-a720-c2861b435ba6 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:36.805234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ca148-89f3-42b9-a720-c2861b435ba6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:36.805709 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ca148-89f3-42b9-a720-c2861b435ba6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:36.807336 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310ca148-89f3-42b9-a720-c2861b435ba6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:36.816664 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 393/781] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:36.822821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ca148-89f3-42b9-a720-c2861b435ba6 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:36.925290 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310ca148-89f3-42b9-a720-c2861b435ba6 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:36.934419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb7b661-f22b-4e26-a4e3-933e1ce96d44 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:36.942541 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:36.963210 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f061e-7e8a-4704-9c4b-c99b0e878a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:36.963890 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f061e-7e8a-4704-9c4b-c99b0e878a04 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:36.964168 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f061e-7e8a-4704-9c4b-c99b0e878a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:36.964438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f061e-7e8a-4704-9c4b-c99b0e878a04 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:36.975117 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f061e-7e8a-4704-9c4b-c99b0e878a04 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:36.976566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f061e-7e8a-4704-9c4b-c99b0e878a04 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:36.992493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-dd1f061e-7e8a-4704-9c4b-c99b0e878a04 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:36.992493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:36.992493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:36.992493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:36.992493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:36.992493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:36.992493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:36.992493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:36.992493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:36.992493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:36.992493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:36.992493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:36.992493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:36.992493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:36.992493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:36.992493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:36.993502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:36.993502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:36.993502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:36.993502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:36.993502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:36.993502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:36.993502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:36.993502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:36.993502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:36.993502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:36.993502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:36.993502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:36.993502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:36.993502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:36.993502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:36.993502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:36.993502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:36.994514 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:36.994514 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:36.994514 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:36.996952 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 394/782] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:37.002723 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f061e-7e8a-4704-9c4b-c99b0e878a04 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:37.008355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf77075-a874-4646-9f91-cf32d6ce9bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:37.009014 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf77075-a874-4646-9f91-cf32d6ce9bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:37.009298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf77075-a874-4646-9f91-cf32d6ce9bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:37.009572 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf77075-a874-4646-9f91-cf32d6ce9bd8 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:37.010234 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf77075-a874-4646-9f91-cf32d6ce9bd8 None admin] RBAC: Adding query filter params (type=network) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:37.010537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf77075-a874-4646-9f91-cf32d6ce9bd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:37.011904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf77075-a874-4646-9f91-cf32d6ce9bd8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:37.024490 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 389/783] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Sep 13 19:44:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:37.034498 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf77075-a874-4646-9f91-cf32d6ce9bd8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:37.121180 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:37.191489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f061e-7e8a-4704-9c4b-c99b0e878a04 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:37.212978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf77075-a874-4646-9f91-cf32d6ce9bd8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:37.252643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267c9ee-16f9-4665-b4cc-e22e234e930d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:37.253250 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267c9ee-16f9-4665-b4cc-e22e234e930d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:37.253529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267c9ee-16f9-4665-b4cc-e22e234e930d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:37.253829 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f267c9ee-16f9-4665-b4cc-e22e234e930d None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:37.254505 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267c9ee-16f9-4665-b4cc-e22e234e930d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:37.254807 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267c9ee-16f9-4665-b4cc-e22e234e930d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:37.257164 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f267c9ee-16f9-4665-b4cc-e22e234e930d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:37.273819 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea7784-ff25-4f1c-abee-83ade2d17f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:37.274430 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea7784-ff25-4f1c-abee-83ade2d17f70 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:37.274710 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea7784-ff25-4f1c-abee-83ade2d17f70 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:37.274980 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ea7784-ff25-4f1c-abee-83ade2d17f70 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:37.275681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea7784-ff25-4f1c-abee-83ade2d17f70 None admin] RBAC: Adding query filter params (interface=public, service_id=25ec7cd136fa4f6f8d716b8c62af74e9, region_id=RegionOne) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:37.276056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea7784-ff25-4f1c-abee-83ade2d17f70 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:37.277405 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ea7784-ff25-4f1c-abee-83ade2d17f70 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:37.278626 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 395/784] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:37.284632 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267c9ee-16f9-4665-b4cc-e22e234e930d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:37.290840 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 390/785] 10.222.0.59 () {56 vars in 1251 bytes} [Tue Sep 13 19:44:37 2022] GET /identity/v3/endpoints?service_id=25ec7cd136fa4f6f8d716b8c62af74e9&interface=public®ion_id=RegionOne => generated 194 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:37.302805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea7784-ff25-4f1c-abee-83ade2d17f70 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:37.318388 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:37.449133 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f267c9ee-16f9-4665-b4cc-e22e234e930d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:37.467600 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ea7784-ff25-4f1c-abee-83ade2d17f70 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:37.494038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:37.510223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01699594-a81f-4243-8916-12e15437a51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:37.510857 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01699594-a81f-4243-8916-12e15437a51c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:37.511132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01699594-a81f-4243-8916-12e15437a51c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:37.511398 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01699594-a81f-4243-8916-12e15437a51c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:37.522774 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01699594-a81f-4243-8916-12e15437a51c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:37.524207 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01699594-a81f-4243-8916-12e15437a51c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:37.528715 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208f691-7905-4d06-b0a2-e8249226f1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:37.530083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208f691-7905-4d06-b0a2-e8249226f1df None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:37.530365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208f691-7905-4d06-b0a2-e8249226f1df None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:37.530642 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208f691-7905-4d06-b0a2-e8249226f1df None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:37.531245 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208f691-7905-4d06-b0a2-e8249226f1df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:37.532610 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208f691-7905-4d06-b0a2-e8249226f1df None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:37.545070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-01699594-a81f-4243-8916-12e15437a51c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:44:37.545070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:37.545070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:37.545070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:37.545070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:37.545070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:37.545070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:37.545070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:37.545070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:37.545070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:37.545070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:37.545070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:37.545070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:37.545070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:37.545070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:37.545070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:37.546092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:37.546092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:37.546092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:37.546092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:37.546092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:37.546092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:37.546092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:37.546092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:37.546092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:37.546092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:37.546092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:37.546092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:37.546092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:37.546092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:37.546092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:37.546092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:37.546092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:37.546092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:37.547074 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:37.547074 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:37.547074 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:37.547074 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:37.547074 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:37.547074 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:37.547074 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:37.547074 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:37.547074 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:44:37.547074 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:37.548420 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 391/786] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Sep 13 19:44:37 2022] GET /identity/v3/services => generated 772 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:37.549530 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 396/787] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:44:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:37.554478 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208f691-7905-4d06-b0a2-e8249226f1df None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:37.697893 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208f691-7905-4d06-b0a2-e8249226f1df None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:37.737004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fabdc-3c1b-4e80-a672-2e41e5c0b74e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:37.737622 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fabdc-3c1b-4e80-a672-2e41e5c0b74e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:37.737950 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fabdc-3c1b-4e80-a672-2e41e5c0b74e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:37.738224 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fabdc-3c1b-4e80-a672-2e41e5c0b74e None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:37.738999 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fabdc-3c1b-4e80-a672-2e41e5c0b74e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:37.739305 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fabdc-3c1b-4e80-a672-2e41e5c0b74e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:37.740746 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fabdc-3c1b-4e80-a672-2e41e5c0b74e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:37.763137 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 392/788] 10.222.0.59 () {56 vars in 1135 bytes} [Tue Sep 13 19:44:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:37.769053 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01699594-a81f-4243-8916-12e15437a51c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:37.857107 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:37.872671 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01699594-a81f-4243-8916-12e15437a51c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:37.900214 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94527ac5-2514-42b9-af73-87ad43ed5a01 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:37.900765 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94527ac5-2514-42b9-af73-87ad43ed5a01 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:37.901376 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94527ac5-2514-42b9-af73-87ad43ed5a01 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:37.903824 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 393/789] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:37.909297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4156476-1143-4ce2-8e31-48881151ce40 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:37.909591 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4156476-1143-4ce2-8e31-48881151ce40 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:37.909911 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4156476-1143-4ce2-8e31-48881151ce40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:37.919146 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ff039-a68c-4fc1-a4ac-18a96f8962a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:37.919794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ff039-a68c-4fc1-a4ac-18a96f8962a4 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:37.920075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ff039-a68c-4fc1-a4ac-18a96f8962a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:37.920350 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46ff039-a68c-4fc1-a4ac-18a96f8962a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:37.930749 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d4156476-1143-4ce2-8e31-48881151ce40 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:37.932235 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d4156476-1143-4ce2-8e31-48881151ce40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:37.932584 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ff039-a68c-4fc1-a4ac-18a96f8962a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:37.934064 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46ff039-a68c-4fc1-a4ac-18a96f8962a4 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:37.953718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-c46ff039-a68c-4fc1-a4ac-18a96f8962a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:37.953718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:37.953718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:37.953718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:37.953718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:37.953718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:37.953718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:37.953718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:37.953718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:37.953718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:37.953718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:37.953718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:37.953718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:37.953718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:37.953718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:37.953718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:37.954732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:37.954732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:37.954732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:37.954732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:37.954732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:37.954732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:37.954732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:37.954732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:37.954732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:37.954732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:37.954732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:37.954732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:37.954732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:37.954732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:37.954732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:37.954732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:37.954732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:37.955637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:37.955637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:37.955637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:37.958279 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 397/790] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:37.966727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ff039-a68c-4fc1-a4ac-18a96f8962a4 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:37.989831 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:38.055348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 394/791] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:44:38.117657 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46ff039-a68c-4fc1-a4ac-18a96f8962a4 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:38.153611 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e405231-aadb-46a4-8be6-c90c61fafb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:38.154344 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e405231-aadb-46a4-8be6-c90c61fafb8f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:38.154631 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e405231-aadb-46a4-8be6-c90c61fafb8f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:38.154907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e405231-aadb-46a4-8be6-c90c61fafb8f None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:38.155549 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e405231-aadb-46a4-8be6-c90c61fafb8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:38.155854 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e405231-aadb-46a4-8be6-c90c61fafb8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:38.157275 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e405231-aadb-46a4-8be6-c90c61fafb8f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:38.159776 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:38.170254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 398/792] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:38.176335 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4156476-1143-4ce2-8e31-48881151ce40 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:38.304287 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4156476-1143-4ce2-8e31-48881151ce40 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:38.347386 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b410f-20e4-469b-81a4-738e9b08b68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:38.348428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b410f-20e4-469b-81a4-738e9b08b68a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:38.348920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b410f-20e4-469b-81a4-738e9b08b68a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:38.349412 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5b410f-20e4-469b-81a4-738e9b08b68a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:38.362095 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b410f-20e4-469b-81a4-738e9b08b68a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:38.364399 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5b410f-20e4-469b-81a4-738e9b08b68a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:38.380041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-0d5b410f-20e4-469b-81a4-738e9b08b68a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:38.380041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:38.380041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:38.380041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:38.380041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:38.380041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:38.380041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:38.380041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:38.380041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:38.380041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:38.380041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:38.380041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:38.380041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:38.380041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:38.380041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:38.381225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:38.381225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:38.381225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:38.381225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:38.381225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:38.381225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:38.381225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:38.381225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:38.381225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:38.381225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:38.381225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:38.381225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:38.381225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:38.381225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:38.381225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:38.381225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:38.381225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:38.382602 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:38.382602 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:38.382602 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:38.382602 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:38.382602 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:38.382602 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:38.382602 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:38.382602 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:38.384410 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 395/793] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:38.390169 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e405231-aadb-46a4-8be6-c90c61fafb8f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:38.479678 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b410f-20e4-469b-81a4-738e9b08b68a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:38.527770 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e405231-aadb-46a4-8be6-c90c61fafb8f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:38.537769 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:38.568423 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cea61a0-6f9e-42d3-9802-74c5a21bb639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:38.569126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea61a0-6f9e-42d3-9802-74c5a21bb639 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:38.569542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea61a0-6f9e-42d3-9802-74c5a21bb639 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:38.570387 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cea61a0-6f9e-42d3-9802-74c5a21bb639 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:38.571360 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea61a0-6f9e-42d3-9802-74c5a21bb639 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:38.571787 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea61a0-6f9e-42d3-9802-74c5a21bb639 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:38.573455 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cea61a0-6f9e-42d3-9802-74c5a21bb639 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:38.588954 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 399/794] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:38.594262 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcfaac-f1bd-49d0-9444-4757bfcc8be0 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:38.594557 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcfaac-f1bd-49d0-9444-4757bfcc8be0 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:38.594822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dcfaac-f1bd-49d0-9444-4757bfcc8be0 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:38.597329 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 400/795] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:38.599332 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dcfaac-f1bd-49d0-9444-4757bfcc8be0 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:38.662466 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5b410f-20e4-469b-81a4-738e9b08b68a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:38.668950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:38.706152 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c22e0c-e67b-4d3e-b2a3-2da6e6a705b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:38.706814 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c22e0c-e67b-4d3e-b2a3-2da6e6a705b4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:38.707075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c22e0c-e67b-4d3e-b2a3-2da6e6a705b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:38.707349 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c22e0c-e67b-4d3e-b2a3-2da6e6a705b4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:38.718157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c22e0c-e67b-4d3e-b2a3-2da6e6a705b4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:38.724047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-07c22e0c-e67b-4d3e-b2a3-2da6e6a705b4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:44:38.724047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:38.724047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:38.724047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:38.724047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:38.724047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:38.724047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:38.724047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:38.724047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:38.724047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:38.724047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:38.724047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:38.724047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:38.724047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:38.724047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:38.724047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:38.725000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:38.725000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:38.725000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:38.725000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:38.725000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:38.725000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:38.725000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:38.725000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:38.725000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:38.725000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:38.725000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:38.725000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:38.725000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:38.725000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:38.725000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:38.725000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:38.725883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:38.725883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:38.725883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:38.725883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:38.725883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:38.725883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:38.725883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:38.725883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:38.725883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:38.725883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:38.725883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:44:38.725883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:38.725883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 396/796] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:44:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:38.726586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd75171-ad39-48e3-b643-2cdd736b47f1 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:38.726586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd75171-ad39-48e3-b643-2cdd736b47f1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:38.732101 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd75171-ad39-48e3-b643-2cdd736b47f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:38.732690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dcfaac-f1bd-49d0-9444-4757bfcc8be0 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:38.749447 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ddd75171-ad39-48e3-b643-2cdd736b47f1 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:38.750666 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ddd75171-ad39-48e3-b643-2cdd736b47f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:38.770457 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec8ac5e-21a3-471b-b318-7a34e794ae38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:38.771541 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8ac5e-21a3-471b-b318-7a34e794ae38 None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:38.771823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8ac5e-21a3-471b-b318-7a34e794ae38 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:38.772390 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec8ac5e-21a3-471b-b318-7a34e794ae38 None admin] PATH_INFO: `/v3/projects/ad67761fec0a430181877e216e90e7d4/users/c00e78bf5e5c4db29c47dce1e87f3f5a/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:38.774331 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8ac5e-21a3-471b-b318-7a34e794ae38 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad67761fec0a430181877e216e90e7d4, user_id=c00e78bf5e5c4db29c47dce1e87f3f5a, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:38.775754 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec8ac5e-21a3-471b-b318-7a34e794ae38 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:38.818993 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 397/797] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:44:38.820000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cd18b-3a7e-4ae6-a35c-b8c94992b045 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:38.820388 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cd18b-3a7e-4ae6-a35c-b8c94992b045 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:38.820712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7cd18b-3a7e-4ae6-a35c-b8c94992b045 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:38.821924 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 398/798] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:38.825758 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cd18b-3a7e-4ae6-a35c-b8c94992b045 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:38.845565 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:38.868968 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 401/799] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Sep 13 19:44:38 2022] PUT /identity/v3/projects/ad67761fec0a430181877e216e90e7d4/users/c00e78bf5e5c4db29c47dce1e87f3f5a/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:44:38.873974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde5149-aecf-43d2-b78b-0d247125dc64 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:38.874305 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde5149-aecf-43d2-b78b-0d247125dc64 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:38.875455 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfde5149-aecf-43d2-b78b-0d247125dc64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:38.917444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-bfde5149-aecf-43d2-b78b-0d247125dc64 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:38.920284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bfde5149-aecf-43d2-b78b-0d247125dc64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:39.017154 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7cd18b-3a7e-4ae6-a35c-b8c94992b045 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:39.071354 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 402/800] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:44:39.080669 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfb79a-2033-4b98-bc26-d0291d3f3ca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:39.081263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfb79a-2033-4b98-bc26-d0291d3f3ca1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:39.081537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfb79a-2033-4b98-bc26-d0291d3f3ca1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:39.081838 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bfb79a-2033-4b98-bc26-d0291d3f3ca1 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:39.083027 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfb79a-2033-4b98-bc26-d0291d3f3ca1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:39.083318 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfb79a-2033-4b98-bc26-d0291d3f3ca1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:39.084681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bfb79a-2033-4b98-bc26-d0291d3f3ca1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:39.095925 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 399/801] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:39.102336 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde5149-aecf-43d2-b78b-0d247125dc64 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:39.114329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfb79a-2033-4b98-bc26-d0291d3f3ca1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:39.173214 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:39.241214 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfde5149-aecf-43d2-b78b-0d247125dc64 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:39.301964 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50e3b9-6e82-404e-b51e-12fe788310cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:39.302612 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50e3b9-6e82-404e-b51e-12fe788310cc None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:39.302892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50e3b9-6e82-404e-b51e-12fe788310cc None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:39.303168 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50e3b9-6e82-404e-b51e-12fe788310cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:39.328098 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50e3b9-6e82-404e-b51e-12fe788310cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:39.332521 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50e3b9-6e82-404e-b51e-12fe788310cc None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:39.365570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-4e50e3b9-6e82-404e-b51e-12fe788310cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:39.365570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:39.365570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:39.365570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:39.365570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:39.365570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:39.365570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:39.365570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:39.365570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:39.365570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:39.365570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:39.365570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:39.365570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:39.365570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:39.365570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:39.365570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:39.366706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:39.366706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:39.366706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:39.366706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:39.366706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:39.366706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:39.366706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:39.366706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:39.366706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:39.366706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:39.366706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:39.366706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:39.366706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:39.366706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:39.366706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:39.366706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:39.366706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:39.367646 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:39.367646 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:39.367646 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:39.367646 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 403/802] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:39.373105 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50e3b9-6e82-404e-b51e-12fe788310cc None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:39.390776 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:39.423108 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bfb79a-2033-4b98-bc26-d0291d3f3ca1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:39.470257 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542fd96-f842-4d6d-a219-41cfc7d3413d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:39.471287 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542fd96-f842-4d6d-a219-41cfc7d3413d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:39.471568 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542fd96-f842-4d6d-a219-41cfc7d3413d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:39.471841 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7542fd96-f842-4d6d-a219-41cfc7d3413d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:39.472427 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542fd96-f842-4d6d-a219-41cfc7d3413d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:39.475295 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7542fd96-f842-4d6d-a219-41cfc7d3413d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:39.484837 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:39.485641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-7542fd96-f842-4d6d-a219-41cfc7d3413d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:44:39.485641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:39.485641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:44:39.485641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:44:39.485641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:44:39.485641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:44:39.485641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:44:39.485641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:39.485641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:44:39.485641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:39.485641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:44:39.485641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:39.485641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:39.485641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:39.485641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:39.485641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:39.485641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:39.486661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:39.486661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:39.486661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:39.486661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:39.486661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:39.486661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:39.486661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:44:39.486661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:44:39.486661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:44:39.486661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:44:39.486661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:39.486661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:39.486661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:39.486661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:39.486661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:39.486661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:39.488091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:39.488091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:39.488091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:39.488091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:39.488091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:39.488091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:39.488091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:39.488091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:39.488091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:39.488091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:39.488091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:44:39.488091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:39.488091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 13 19:44:39.488091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:39.491489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 400/803] 10.222.0.59 () {56 vars in 1129 bytes} [Tue Sep 13 19:44:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 373 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:39.492842 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542fd96-f842-4d6d-a219-41cfc7d3413d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:39.493593 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50e3b9-6e82-404e-b51e-12fe788310cc None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:39.542331 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2220e-e431-4a88-a288-4a547bc55807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:39.542946 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2220e-e431-4a88-a288-4a547bc55807 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:39.543501 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2220e-e431-4a88-a288-4a547bc55807 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:39.543785 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a2220e-e431-4a88-a288-4a547bc55807 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:39.544922 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2220e-e431-4a88-a288-4a547bc55807 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:39.545232 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2220e-e431-4a88-a288-4a547bc55807 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:39.547172 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a2220e-e431-4a88-a288-4a547bc55807 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:39.563986 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 404/804] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:39.564904 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2220e-e431-4a88-a288-4a547bc55807 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:39.620960 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7542fd96-f842-4d6d-a219-41cfc7d3413d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:39.656950 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a37e80-fb2a-409e-b234-9332c2f833a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:39.657569 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a37e80-fb2a-409e-b234-9332c2f833a5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:39.657888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a37e80-fb2a-409e-b234-9332c2f833a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:39.658156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a37e80-fb2a-409e-b234-9332c2f833a5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:39.669087 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a37e80-fb2a-409e-b234-9332c2f833a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:39.674028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-16a37e80-fb2a-409e-b234-9332c2f833a5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:39.674028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:39.674028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:39.674028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:39.674028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:39.674028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:39.674028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:39.674028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:39.674028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:39.674028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:39.674028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:39.674028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:39.674028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:39.674028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:39.674028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:39.674028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:39.675026 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:39.675026 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:39.675026 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:39.675026 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:39.675026 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:39.675026 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:39.675026 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:39.675026 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:39.675026 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:39.675026 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:39.675026 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:39.675026 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:39.675026 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:39.675026 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:39.675026 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:39.675026 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:39.677032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:39.677032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:39.677032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:39.677032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:39.677032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:39.677032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:39.677032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:39.677032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:39.677032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:39.677032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:39.677032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:39.677032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:39.677032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 401/805] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:39.677032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a37e80-fb2a-409e-b234-9332c2f833a5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:39.680146 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:39.700686 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a2220e-e431-4a88-a288-4a547bc55807 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:39.747854 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef9bf3-c802-45d8-bbb1-cc3a355fb251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:39.749065 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef9bf3-c802-45d8-bbb1-cc3a355fb251 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:39.749547 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef9bf3-c802-45d8-bbb1-cc3a355fb251 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:39.750205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef9bf3-c802-45d8-bbb1-cc3a355fb251 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:39.751837 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef9bf3-c802-45d8-bbb1-cc3a355fb251 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:39.752356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef9bf3-c802-45d8-bbb1-cc3a355fb251 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:39.754530 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef9bf3-c802-45d8-bbb1-cc3a355fb251 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:39.761013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 405/806] 10.222.0.59 () {56 vars in 1124 bytes} [Tue Sep 13 19:44:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:39.762329 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef9bf3-c802-45d8-bbb1-cc3a355fb251 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:39.787239 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a37e80-fb2a-409e-b234-9332c2f833a5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:39.793450 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:39.828337 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f62d7-dd95-42b5-b299-266757da64ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:39.828960 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f62d7-dd95-42b5-b299-266757da64ac None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:39.829250 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f62d7-dd95-42b5-b299-266757da64ac None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:39.829516 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f62d7-dd95-42b5-b299-266757da64ac None admin] PATH_INFO: `/v3/users/nova` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:39.837315 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f62d7-dd95-42b5-b299-266757da64ac None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:39.838719 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f62d7-dd95-42b5-b299-266757da64ac None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:39.850712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-5b0f62d7-dd95-42b5-b299-266757da64ac None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:44:39.850712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:39.850712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:39.850712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:39.850712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:39.850712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:39.850712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:39.850712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:39.850712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:39.850712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:39.850712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:39.850712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:39.850712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:39.850712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:39.850712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:39.850712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:39.851684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:39.851684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:39.851684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:39.851684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:39.851684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:39.851684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:39.851684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:39.851684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:39.851684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:39.851684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:39.851684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:39.851684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:39.851684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:39.851684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:39.851684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:39.851684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:39.851684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:39.851684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:39.852667 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:39.852667 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:39.852667 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:39.852667 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:39.852667 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:39.852667 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:39.852667 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:39.852667 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:39.852667 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:44:39.852667 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:39.856452 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 402/807] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Sep 13 19:44:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:39.857322 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f62d7-dd95-42b5-b299-266757da64ac None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:39.899493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef9bf3-c802-45d8-bbb1-cc3a355fb251 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:39.927572 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:39.952944 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155790fd-5e05-486f-afa8-fcce52d82043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:39.953653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155790fd-5e05-486f-afa8-fcce52d82043 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:39.954026 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155790fd-5e05-486f-afa8-fcce52d82043 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:39.954379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155790fd-5e05-486f-afa8-fcce52d82043 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:39.955211 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155790fd-5e05-486f-afa8-fcce52d82043 None admin] RBAC: Adding query filter params (name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:39.955806 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155790fd-5e05-486f-afa8-fcce52d82043 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:39.957248 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155790fd-5e05-486f-afa8-fcce52d82043 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:39.968465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 406/808] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:39.969683 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155790fd-5e05-486f-afa8-fcce52d82043 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:39.971928 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f62d7-dd95-42b5-b299-266757da64ac None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:40.009786 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965c55d-b002-4f5c-8536-087057706e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:40.010788 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965c55d-b002-4f5c-8536-087057706e6f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:40.011138 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965c55d-b002-4f5c-8536-087057706e6f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:40.011434 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2965c55d-b002-4f5c-8536-087057706e6f None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:40.012342 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965c55d-b002-4f5c-8536-087057706e6f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:40.012657 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965c55d-b002-4f5c-8536-087057706e6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:40.014058 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2965c55d-b002-4f5c-8536-087057706e6f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:40.024979 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 403/809] 10.222.0.59 () {56 vars in 1124 bytes} [Tue Sep 13 19:44:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:40.024979 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965c55d-b002-4f5c-8536-087057706e6f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:40.079198 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:40.096912 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155790fd-5e05-486f-afa8-fcce52d82043 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:40.140436 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a540372-e690-433f-9ef2-84db47c1f7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:40.141050 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a540372-e690-433f-9ef2-84db47c1f7af None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:40.141327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a540372-e690-433f-9ef2-84db47c1f7af None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:40.141598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a540372-e690-433f-9ef2-84db47c1f7af None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:40.142533 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a540372-e690-433f-9ef2-84db47c1f7af None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:40.142842 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a540372-e690-433f-9ef2-84db47c1f7af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:40.144964 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a540372-e690-433f-9ef2-84db47c1f7af None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:40.153323 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2965c55d-b002-4f5c-8536-087057706e6f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:40.170644 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 407/810] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Sep 13 19:44:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:40.171769 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a540372-e690-433f-9ef2-84db47c1f7af None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:40.189983 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:40.199275 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040ac542-d47e-44f1-bf27-f4a726589710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:40.207742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ac542-d47e-44f1-bf27-f4a726589710 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:40.207742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ac542-d47e-44f1-bf27-f4a726589710 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:40.207742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040ac542-d47e-44f1-bf27-f4a726589710 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:40.211446 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ac542-d47e-44f1-bf27-f4a726589710 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:40.212883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040ac542-d47e-44f1-bf27-f4a726589710 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:40.228346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-040ac542-d47e-44f1-bf27-f4a726589710 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:40.228346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:40.228346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:40.228346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:40.228346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:40.228346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:40.228346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:40.228346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:40.228346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:40.228346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:40.228346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:40.228346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:40.228346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:40.228346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:40.228346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:40.228346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:40.229338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:40.229338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:40.229338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:40.229338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:40.229338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:40.229338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:40.229338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:40.229338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:40.229338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:40.229338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:40.229338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:40.229338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:40.229338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:40.229338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:40.229338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:40.229338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:40.229338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:40.230338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:40.230338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:40.230338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:40.234323 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 404/811] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:40.235584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b43cb-5d9a-49dc-9bf0-73497d9939b9 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:40.235864 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b43cb-5d9a-49dc-9bf0-73497d9939b9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:40.236143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6b43cb-5d9a-49dc-9bf0-73497d9939b9 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:40.241737 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 405/812] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:40.241737 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b43cb-5d9a-49dc-9bf0-73497d9939b9 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:40.284848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a540372-e690-433f-9ef2-84db47c1f7af None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:40.319904 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fb62d-d06c-4f7e-9f7c-f81c7856143a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:40.320510 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fb62d-d06c-4f7e-9f7c-f81c7856143a None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:40.320786 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fb62d-d06c-4f7e-9f7c-f81c7856143a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:40.321056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fb62d-d06c-4f7e-9f7c-f81c7856143a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:40.321738 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9fb62d-d06c-4f7e-9f7c-f81c7856143a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:40.323110 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9fb62d-d06c-4f7e-9f7c-f81c7856143a None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:40.345639 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6b43cb-5d9a-49dc-9bf0-73497d9939b9 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:40.378302 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41117fab-762a-491a-b1a3-63927695f40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:40.378914 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41117fab-762a-491a-b1a3-63927695f40e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:40.379186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41117fab-762a-491a-b1a3-63927695f40e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:40.379449 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41117fab-762a-491a-b1a3-63927695f40e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:40.422420 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:40.424708 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:40.428748 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 408/813] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 19:44:40 2022] POST /identity/v3/endpoints => generated 346 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:44:40.436792 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fb62d-d06c-4f7e-9f7c-f81c7856143a None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:40.447497 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41117fab-762a-491a-b1a3-63927695f40e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:40.449029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41117fab-762a-491a-b1a3-63927695f40e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:40.574373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 406/814] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:40 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:44:40.576187 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a14242-bf3f-4560-9cfb-f43d9a7eb10a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:40.576694 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a14242-bf3f-4560-9cfb-f43d9a7eb10a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:40.577172 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a14242-bf3f-4560-9cfb-f43d9a7eb10a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:40.601495 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-94a14242-bf3f-4560-9cfb-f43d9a7eb10a None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:40.603124 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-94a14242-bf3f-4560-9cfb-f43d9a7eb10a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:40.622576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fb62d-d06c-4f7e-9f7c-f81c7856143a None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:40.662838 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12637b7-32ea-4716-ab50-d0821dd615dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:40.663599 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12637b7-32ea-4716-ab50-d0821dd615dd None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:40.663981 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12637b7-32ea-4716-ab50-d0821dd615dd None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:40.664354 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12637b7-32ea-4716-ab50-d0821dd615dd None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:40.665210 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12637b7-32ea-4716-ab50-d0821dd615dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:40.665632 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12637b7-32ea-4716-ab50-d0821dd615dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:40.667122 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12637b7-32ea-4716-ab50-d0821dd615dd None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:40.683226 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 409/815] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:40.684494 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12637b7-32ea-4716-ab50-d0821dd615dd None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:40.686700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 407/816] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:44:40.691840 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a14242-bf3f-4560-9cfb-f43d9a7eb10a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:40.702793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:40.774815 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:40.824820 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a14242-bf3f-4560-9cfb-f43d9a7eb10a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:40.863709 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12637b7-32ea-4716-ab50-d0821dd615dd None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:40.864840 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070a0c2-31ef-47ab-ba6f-a2545875acf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:40.865592 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070a0c2-31ef-47ab-ba6f-a2545875acf4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:40.865904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070a0c2-31ef-47ab-ba6f-a2545875acf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:40.866280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f070a0c2-31ef-47ab-ba6f-a2545875acf4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:40.873728 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070a0c2-31ef-47ab-ba6f-a2545875acf4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:40.881513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f070a0c2-31ef-47ab-ba6f-a2545875acf4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:40.906503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-f070a0c2-31ef-47ab-ba6f-a2545875acf4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:44:40.906503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:40.906503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:40.906503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:40.906503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:40.906503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:40.906503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:40.906503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:40.906503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:40.906503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:40.906503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:40.906503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:40.906503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:40.906503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:40.906503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:40.906503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:40.907511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:40.907511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:40.907511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:40.907511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:40.907511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:40.907511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:40.907511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:40.907511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:40.907511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:40.907511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:40.907511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:40.907511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:40.907511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:40.907511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:40.907511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:40.907511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:40.907511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:40.907511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:40.908495 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:40.908495 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:40.908495 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:40.908495 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:40.908495 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:40.908495 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:40.908495 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:40.908495 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:40.908495 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:44:40.908495 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:40.911916 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 408/817] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Sep 13 19:44:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:40.918664 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070a0c2-31ef-47ab-ba6f-a2545875acf4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:40.974501 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e572456-3037-406b-80f5-95a7cbe102e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:40.975073 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e572456-3037-406b-80f5-95a7cbe102e8 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:40.975354 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e572456-3037-406b-80f5-95a7cbe102e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:40.975631 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e572456-3037-406b-80f5-95a7cbe102e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:40.994821 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:41.002717 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e572456-3037-406b-80f5-95a7cbe102e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:41.004711 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e572456-3037-406b-80f5-95a7cbe102e8 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:41.030152 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f070a0c2-31ef-47ab-ba6f-a2545875acf4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:41.031914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-5e572456-3037-406b-80f5-95a7cbe102e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:41.031914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:41.031914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:41.031914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:41.031914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:41.031914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:41.031914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:41.031914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:41.031914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:41.031914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:41.031914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:41.031914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:41.031914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:41.031914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:41.031914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:41.031914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:41.033049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:41.033049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:41.033049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:41.033049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:41.033049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:41.033049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:41.033049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:41.033049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:41.033049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:41.033049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:41.033049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:41.033049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:41.033049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:41.033049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:41.033049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:41.033049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:41.033049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:41.034238 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:41.034238 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:41.034238 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:41.040985 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 410/818] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 353 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:41.042080 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e572456-3037-406b-80f5-95a7cbe102e8 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:41.077061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a5b7a-d478-4925-9150-12ec0645d507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:41.078097 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a5b7a-d478-4925-9150-12ec0645d507 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:41.078500 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a5b7a-d478-4925-9150-12ec0645d507 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:41.079346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909a5b7a-d478-4925-9150-12ec0645d507 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:41.080452 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a5b7a-d478-4925-9150-12ec0645d507 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:41.081109 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a5b7a-d478-4925-9150-12ec0645d507 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:41.083947 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909a5b7a-d478-4925-9150-12ec0645d507 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:41.114967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 409/819] 10.222.0.59 () {56 vars in 1149 bytes} [Tue Sep 13 19:44:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:41.116403 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a5b7a-d478-4925-9150-12ec0645d507 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:41.171373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e572456-3037-406b-80f5-95a7cbe102e8 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:41.179234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:41.216593 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900a968-48e9-4bfe-92e0-bb0aa1a28842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:41.217250 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900a968-48e9-4bfe-92e0-bb0aa1a28842 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:41.218022 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900a968-48e9-4bfe-92e0-bb0aa1a28842 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:41.218311 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4900a968-48e9-4bfe-92e0-bb0aa1a28842 None admin] PATH_INFO: `/v3/services/network` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:41.218908 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4900a968-48e9-4bfe-92e0-bb0aa1a28842 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:41.220986 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4900a968-48e9-4bfe-92e0-bb0aa1a28842 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:41.233192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-4900a968-48e9-4bfe-92e0-bb0aa1a28842 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:44:41.233192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:41.233192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:44:41.233192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:44:41.233192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:44:41.233192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:44:41.233192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:44:41.233192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:41.233192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:44:41.233192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:41.233192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:44:41.233192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:41.233192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:41.233192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:41.233192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:41.233192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:41.233192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:41.234440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:41.234440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:41.234440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:41.234440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:41.234440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:41.234440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:41.234440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:44:41.234440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:44:41.234440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:44:41.234440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:44:41.234440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:41.234440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:41.234440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:41.234440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:41.234440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:41.234440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:41.235287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:41.235287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:41.235287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:41.235287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:41.235287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:41.235287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:41.235287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:41.235287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:41.235287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:41.235287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:41.235287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:44:41.235287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:41.235287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 13 19:44:41.235287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:41.235287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 411/820] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:41 2022] GET /identity/v3/services/network => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:41.236100 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900a968-48e9-4bfe-92e0-bb0aa1a28842 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:41.247134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909a5b7a-d478-4925-9150-12ec0645d507 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:41.275247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:41.284716 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3d4fe-e3dd-4058-9201-2027625b16e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:41.285792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3d4fe-e3dd-4058-9201-2027625b16e6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:41.286088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3d4fe-e3dd-4058-9201-2027625b16e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:41.286365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc3d4fe-e3dd-4058-9201-2027625b16e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:41.287013 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3d4fe-e3dd-4058-9201-2027625b16e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:41.287333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3d4fe-e3dd-4058-9201-2027625b16e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:41.289412 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc3d4fe-e3dd-4058-9201-2027625b16e6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:41.301525 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 410/821] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:41.302386 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3d4fe-e3dd-4058-9201-2027625b16e6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:41.353496 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4900a968-48e9-4bfe-92e0-bb0aa1a28842 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:41.390748 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a3c50-cfc1-40fc-86b1-6491b2d088f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:41.391471 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a3c50-cfc1-40fc-86b1-6491b2d088f0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:41.391753 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a3c50-cfc1-40fc-86b1-6491b2d088f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:41.392022 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a3c50-cfc1-40fc-86b1-6491b2d088f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:41.403059 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a3c50-cfc1-40fc-86b1-6491b2d088f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:41.404487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a3c50-cfc1-40fc-86b1-6491b2d088f0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:41.406278 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc3d4fe-e3dd-4058-9201-2027625b16e6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:41.418899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-039a3c50-cfc1-40fc-86b1-6491b2d088f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:41.418899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:41.418899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:41.418899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:41.418899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:41.418899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:41.418899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:41.418899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:41.418899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:41.418899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:41.418899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:41.418899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:41.418899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:41.418899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:41.418899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:41.418899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:41.419887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:41.419887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:41.419887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:41.419887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:41.419887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:41.419887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:41.419887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:41.419887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:41.419887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:41.419887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:41.419887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:41.419887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:41.419887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:41.419887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:41.419887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:41.419887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:41.419887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:41.420801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:41.420801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:41.420801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:41.420801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 412/822] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:41.421330 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33136ff-9b59-41fd-b16d-2743e8400702 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:41.421472 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33136ff-9b59-41fd-b16d-2743e8400702 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:41.421777 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33136ff-9b59-41fd-b16d-2743e8400702 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:41.425976 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 413/823] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:41 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:41.425976 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33136ff-9b59-41fd-b16d-2743e8400702 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:41.448437 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e666e6c-73d1-4942-a0ba-a6969cf838f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:41.449039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e666e6c-73d1-4942-a0ba-a6969cf838f4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:41.449320 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e666e6c-73d1-4942-a0ba-a6969cf838f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:41.449595 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e666e6c-73d1-4942-a0ba-a6969cf838f4 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:41.450257 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e666e6c-73d1-4942-a0ba-a6969cf838f4 None admin] RBAC: Adding query filter params (name=network) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:41.450562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e666e6c-73d1-4942-a0ba-a6969cf838f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:41.451525 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:41.451932 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e666e6c-73d1-4942-a0ba-a6969cf838f4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:41.461323 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 411/824] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Sep 13 19:44:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:41.461323 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e666e6c-73d1-4942-a0ba-a6969cf838f4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:41.515666 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:41.541167 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33136ff-9b59-41fd-b16d-2743e8400702 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:41.566391 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e666e6c-73d1-4942-a0ba-a6969cf838f4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:41.581721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d4c8e8-0be0-480b-9943-afb3adbd1708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:41.582351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4c8e8-0be0-480b-9943-afb3adbd1708 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:41.582633 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4c8e8-0be0-480b-9943-afb3adbd1708 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:41.582904 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d4c8e8-0be0-480b-9943-afb3adbd1708 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:41.589527 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4c8e8-0be0-480b-9943-afb3adbd1708 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:41.591024 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d4c8e8-0be0-480b-9943-afb3adbd1708 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:41.600915 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595bfd1-7e38-4db9-bc34-cffb3720c49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:41.601513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595bfd1-7e38-4db9-bc34-cffb3720c49f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:41.601824 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595bfd1-7e38-4db9-bc34-cffb3720c49f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:41.602100 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3595bfd1-7e38-4db9-bc34-cffb3720c49f None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:41.602650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-b0d4c8e8-0be0-480b-9943-afb3adbd1708 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:41.602650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:41.602650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:41.602650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:41.602650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:41.602650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:41.602650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:41.602650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:41.602650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:41.602650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:41.602650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:41.602650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:41.602650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:41.602650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:41.602650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:41.603529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:41.603529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:41.603529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:41.603529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:41.603529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:41.603529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:41.603529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:41.603529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:41.603529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:41.603529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:41.603529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:41.603529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:41.603529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:41.603529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:41.603529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:41.603529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:41.603529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:41.609465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:41.609465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:41.609465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:41.609465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:41.609465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:41.609465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:41.609465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:41.609465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:41.610060 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595bfd1-7e38-4db9-bc34-cffb3720c49f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:41.610060 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595bfd1-7e38-4db9-bc34-cffb3720c49f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:41.610224 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 414/825] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:41.610315 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3595bfd1-7e38-4db9-bc34-cffb3720c49f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:41.610404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb252dc-2238-4ed9-8385-770be7fe579a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:41.610404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb252dc-2238-4ed9-8385-770be7fe579a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:41.610404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb252dc-2238-4ed9-8385-770be7fe579a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:41.626742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 412/826] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:41.626742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595bfd1-7e38-4db9-bc34-cffb3720c49f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:41.627021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-2eb252dc-2238-4ed9-8385-770be7fe579a None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:41.627433 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2eb252dc-2238-4ed9-8385-770be7fe579a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:41.705725 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 415/827] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:44:41.705725 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb252dc-2238-4ed9-8385-770be7fe579a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:41.721260 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:41.737796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3595bfd1-7e38-4db9-bc34-cffb3720c49f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:41.751654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:41.775730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3057d-65f5-42c4-9051-49c9d2bf95c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:41.776345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3057d-65f5-42c4-9051-49c9d2bf95c6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:41.776697 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3057d-65f5-42c4-9051-49c9d2bf95c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:41.777043 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e3057d-65f5-42c4-9051-49c9d2bf95c6 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:41.777916 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3057d-65f5-42c4-9051-49c9d2bf95c6 None admin] RBAC: Adding query filter params (type=network) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:41.778296 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3057d-65f5-42c4-9051-49c9d2bf95c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:41.779797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e3057d-65f5-42c4-9051-49c9d2bf95c6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:41.785835 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 413/828] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Sep 13 19:44:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:41.786760 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3057d-65f5-42c4-9051-49c9d2bf95c6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:41.823572 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb252dc-2238-4ed9-8385-770be7fe579a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:41.865668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e0aec-80e2-4931-974f-317ac3ff30b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:41.866309 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e0aec-80e2-4931-974f-317ac3ff30b7 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:41.866594 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e0aec-80e2-4931-974f-317ac3ff30b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:41.866873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e0aec-80e2-4931-974f-317ac3ff30b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:41.867577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e0aec-80e2-4931-974f-317ac3ff30b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:41.867884 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e0aec-80e2-4931-974f-317ac3ff30b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:41.869576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e0aec-80e2-4931-974f-317ac3ff30b7 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:41.883536 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 416/829] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:41.884427 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e0aec-80e2-4931-974f-317ac3ff30b7 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:41.914841 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e3057d-65f5-42c4-9051-49c9d2bf95c6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:41.960510 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5560d58-5c44-41d6-adcc-679233ec816f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:41.961356 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5560d58-5c44-41d6-adcc-679233ec816f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:41.962069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5560d58-5c44-41d6-adcc-679233ec816f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:41.962487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5560d58-5c44-41d6-adcc-679233ec816f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:41.968023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:41.972390 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5560d58-5c44-41d6-adcc-679233ec816f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:41.975000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5560d58-5c44-41d6-adcc-679233ec816f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:41.988904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-f5560d58-5c44-41d6-adcc-679233ec816f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:41.988904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:41.988904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:41.988904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:41.988904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:41.988904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:41.988904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:41.988904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:41.988904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:41.988904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:41.988904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:41.988904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:41.988904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:41.988904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:41.988904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:41.995577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:41.995577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:41.995577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:41.995577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:41.995577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:41.995577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:41.995577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:41.995577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:41.995577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:41.995577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:41.995577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:41.995577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:41.995577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:41.995577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:41.995577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:41.995577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:41.995577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:41.996780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:41.996780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:41.996780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:41.996780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:41.996780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:41.996780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:41.996780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:41.996780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:41.996780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 414/830] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:41.996780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5560d58-5c44-41d6-adcc-679233ec816f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:42.011125 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e0aec-80e2-4931-974f-317ac3ff30b7 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:42.029930 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:42.051511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d04ab-98c8-4f9f-bde0-1475b9745c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:42.052118 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d04ab-98c8-4f9f-bde0-1475b9745c80 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:42.059639 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d04ab-98c8-4f9f-bde0-1475b9745c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:42.059639 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d04ab-98c8-4f9f-bde0-1475b9745c80 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:42.059639 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d04ab-98c8-4f9f-bde0-1475b9745c80 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:42.059639 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96d04ab-98c8-4f9f-bde0-1475b9745c80 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:42.094158 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5560d58-5c44-41d6-adcc-679233ec816f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:42.126406 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790b986-c6fd-4dd5-9ca3-0c08815422b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:42.127000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790b986-c6fd-4dd5-9ca3-0c08815422b1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:42.127277 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790b986-c6fd-4dd5-9ca3-0c08815422b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:42.127547 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e790b986-c6fd-4dd5-9ca3-0c08815422b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:42.128304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790b986-c6fd-4dd5-9ca3-0c08815422b1 None admin] RBAC: Adding query filter params (role.id=cd02ef2043de492a8bff6c165485f255, scope.project.id=ad67761fec0a430181877e216e90e7d4, user.id=3919b24291f54df99a9da0f5d3164ccf) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:42.128626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790b986-c6fd-4dd5-9ca3-0c08815422b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:42.130314 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e790b986-c6fd-4dd5-9ca3-0c08815422b1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:42.136342 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 415/831] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:41 2022] GET /identity/v3/role_assignments?user.id=3919b24291f54df99a9da0f5d3164ccf&scope.project.id=ad67761fec0a430181877e216e90e7d4&role.id=cd02ef2043de492a8bff6c165485f255 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:42.137112 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790b986-c6fd-4dd5-9ca3-0c08815422b1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:42.158245 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 417/832] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 19:44:41 2022] POST /identity/v3/endpoints => generated 337 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:44:42.159268 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d04ab-98c8-4f9f-bde0-1475b9745c80 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:42.271734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:42.277227 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e790b986-c6fd-4dd5-9ca3-0c08815422b1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:42.328945 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b56e88-2efc-4667-95dc-791405569fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:42.329901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b56e88-2efc-4667-95dc-791405569fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:42.330178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b56e88-2efc-4667-95dc-791405569fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:42.330498 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b56e88-2efc-4667-95dc-791405569fd4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:42.344587 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b56e88-2efc-4667-95dc-791405569fd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:42.348837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-01b56e88-2efc-4667-95dc-791405569fd4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:44:42.348837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:42.348837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:42.348837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:42.348837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:42.348837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:42.348837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:42.348837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:42.348837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:42.348837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:42.348837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:42.348837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:42.348837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:42.348837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:42.348837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:42.348837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:42.350444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:42.350444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:42.350444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:42.350444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:42.350444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:42.350444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:42.350444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:42.350444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:42.350444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:42.350444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:42.350444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:42.350444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:42.350444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:42.350444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:42.350444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:42.350444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:42.351558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:42.351558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:42.351558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:42.351558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:42.351558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:42.351558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:42.351558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:42.351558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:42.351558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:42.351558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:42.351558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:44:42.351558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:42.351558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 416/833] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:44:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:42.357582 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b56e88-2efc-4667-95dc-791405569fd4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:42.407309 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96d04ab-98c8-4f9f-bde0-1475b9745c80 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:42.440223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:42.450456 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98858438-bc09-4759-b48c-caee88660ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:42.455353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98858438-bc09-4759-b48c-caee88660ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:42.455353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98858438-bc09-4759-b48c-caee88660ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:42.455353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98858438-bc09-4759-b48c-caee88660ab3 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:42.455353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98858438-bc09-4759-b48c-caee88660ab3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:42.455353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98858438-bc09-4759-b48c-caee88660ab3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:42.455353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98858438-bc09-4759-b48c-caee88660ab3 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:42.469217 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 418/834] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:42.475963 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98858438-bc09-4759-b48c-caee88660ab3 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:42.499533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b56e88-2efc-4667-95dc-791405569fd4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:42.546383 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b709f0b-5dac-4395-99bf-c7c82702197c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:42.547332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b709f0b-5dac-4395-99bf-c7c82702197c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:42.547618 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b709f0b-5dac-4395-99bf-c7c82702197c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:42.547891 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b709f0b-5dac-4395-99bf-c7c82702197c None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:42.549059 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b709f0b-5dac-4395-99bf-c7c82702197c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:42.549373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b709f0b-5dac-4395-99bf-c7c82702197c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:42.551451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b709f0b-5dac-4395-99bf-c7c82702197c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:42.569431 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 417/835] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:42.571062 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b709f0b-5dac-4395-99bf-c7c82702197c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:42.595832 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:42.596900 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98858438-bc09-4759-b48c-caee88660ab3 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:42.636727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db094d-fee7-44e7-b27d-0429b740acf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:42.637420 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db094d-fee7-44e7-b27d-0429b740acf8 None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:42.637782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db094d-fee7-44e7-b27d-0429b740acf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:42.638059 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15db094d-fee7-44e7-b27d-0429b740acf8 None admin] PATH_INFO: `/v3/projects/ad67761fec0a430181877e216e90e7d4/users/9fd7a80714874e73bf64dfa392632391/roles/b253c1f3cd6a4197a85ca5f672852073` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:42.654852 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db094d-fee7-44e7-b27d-0429b740acf8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad67761fec0a430181877e216e90e7d4, user_id=9fd7a80714874e73bf64dfa392632391, role_id=b253c1f3cd6a4197a85ca5f672852073)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:42.656075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15db094d-fee7-44e7-b27d-0429b740acf8 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:42.692485 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b709f0b-5dac-4395-99bf-c7c82702197c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:42.724918 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 419/836] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Sep 13 19:44:42 2022] PUT /identity/v3/projects/ad67761fec0a430181877e216e90e7d4/users/9fd7a80714874e73bf64dfa392632391/roles/b253c1f3cd6a4197a85ca5f672852073 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:44:42.740362 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1a2a7-fcf5-40b1-b26b-c2b344f7a2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:42.741027 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1a2a7-fcf5-40b1-b26b-c2b344f7a2be None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:42.741308 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1a2a7-fcf5-40b1-b26b-c2b344f7a2be None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:42.741589 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1a2a7-fcf5-40b1-b26b-c2b344f7a2be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:42.755320 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1a2a7-fcf5-40b1-b26b-c2b344f7a2be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:42.756796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1a2a7-fcf5-40b1-b26b-c2b344f7a2be None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:42.774373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-c9e1a2a7-fcf5-40b1-b26b-c2b344f7a2be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:42.774373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:42.774373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:42.774373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:42.774373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:42.774373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:42.774373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:42.774373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:42.774373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:42.774373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:42.774373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:42.774373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:42.774373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:42.774373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:42.774373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:42.774373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:42.775414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:42.775414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:42.775414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:42.775414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:42.775414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:42.775414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:42.775414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:42.775414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:42.775414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:42.775414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:42.775414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:42.775414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:42.775414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:42.775414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:42.775414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:42.775414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:42.775414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:42.776768 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:42.776768 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:42.776768 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:42.776768 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 418/837] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:42.783789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db094d-fee7-44e7-b27d-0429b740acf8 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:42.815361 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e537d8-a194-4c25-9efc-9081a19f2248 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:42.815734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e537d8-a194-4c25-9efc-9081a19f2248 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:42.815981 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e537d8-a194-4c25-9efc-9081a19f2248 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:42.818198 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 419/838] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:42.825145 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf3c41-7e66-453d-a782-28e3d0fb8959 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:42.825468 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf3c41-7e66-453d-a782-28e3d0fb8959 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:42.825715 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf3c41-7e66-453d-a782-28e3d0fb8959 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:42.845057 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:42.847102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-cadf3c41-7e66-453d-a782-28e3d0fb8959 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:42.848308 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cadf3c41-7e66-453d-a782-28e3d0fb8959 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:42.931360 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15db094d-fee7-44e7-b27d-0429b740acf8 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:42.938754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:42.947334 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 420/839] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:42 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:44:42.976435 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e603e-9075-4b2c-bbc1-560bc47e068e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:42.977099 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e603e-9075-4b2c-bbc1-560bc47e068e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:42.977385 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e603e-9075-4b2c-bbc1-560bc47e068e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:42.977661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335e603e-9075-4b2c-bbc1-560bc47e068e None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:42.978382 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e603e-9075-4b2c-bbc1-560bc47e068e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:42.978692 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e603e-9075-4b2c-bbc1-560bc47e068e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:42.980124 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335e603e-9075-4b2c-bbc1-560bc47e068e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:42.992256 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 420/840] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:42.997481 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf3c41-7e66-453d-a782-28e3d0fb8959 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:43.104126 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf3c41-7e66-453d-a782-28e3d0fb8959 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:43.143588 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41525f13-0695-43e6-a095-eeeac608c50e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:43.145133 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41525f13-0695-43e6-a095-eeeac608c50e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:43.145635 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41525f13-0695-43e6-a095-eeeac608c50e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:43.146146 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41525f13-0695-43e6-a095-eeeac608c50e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:43.153996 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41525f13-0695-43e6-a095-eeeac608c50e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:43.155709 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41525f13-0695-43e6-a095-eeeac608c50e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:43.167714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-41525f13-0695-43e6-a095-eeeac608c50e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:44:43.167714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:43.167714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:43.167714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:43.167714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:43.167714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:43.167714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:43.167714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:43.167714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:43.167714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:43.167714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:43.167714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:43.167714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:43.167714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:43.167714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:43.167714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:43.168679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:43.168679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:43.168679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:43.168679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:43.168679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:43.168679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:43.168679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:43.168679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:43.168679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:43.168679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:43.168679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:43.168679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:43.168679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:43.168679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:43.168679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:43.168679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:43.168679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:43.168679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:43.169748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:43.169748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:43.169748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:43.169748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:43.169748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:43.169748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:43.169748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:43.169748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:43.169748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 13 19:44:43.169748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:43.172234 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 421/841] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:44:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:43.177870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e603e-9075-4b2c-bbc1-560bc47e068e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:43.242123 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41525f13-0695-43e6-a095-eeeac608c50e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:43.292690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:43.299032 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335e603e-9075-4b2c-bbc1-560bc47e068e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:43.312219 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:43.343612 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdaf053-95c8-4813-a41e-4a76a7cf5ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:43.344229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdaf053-95c8-4813-a41e-4a76a7cf5ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:43.344509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdaf053-95c8-4813-a41e-4a76a7cf5ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:43.344830 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdaf053-95c8-4813-a41e-4a76a7cf5ae3 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:43.345545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdaf053-95c8-4813-a41e-4a76a7cf5ae3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:43.345881 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdaf053-95c8-4813-a41e-4a76a7cf5ae3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:43.347429 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdaf053-95c8-4813-a41e-4a76a7cf5ae3 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:43.366694 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41525f13-0695-43e6-a095-eeeac608c50e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:43.375402 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 421/842] 10.222.0.59 () {56 vars in 1135 bytes} [Tue Sep 13 19:44:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:43.376888 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdaf053-95c8-4813-a41e-4a76a7cf5ae3 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:43.407642 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e2977-3200-40e1-9c9b-ce1394a4ec1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:43.408269 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e2977-3200-40e1-9c9b-ce1394a4ec1a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:43.408546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e2977-3200-40e1-9c9b-ce1394a4ec1a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:43.408818 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e2977-3200-40e1-9c9b-ce1394a4ec1a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:43.409508 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e2977-3200-40e1-9c9b-ce1394a4ec1a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:43.410959 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e2977-3200-40e1-9c9b-ce1394a4ec1a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:43.420735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-1d6e2977-3200-40e1-9c9b-ce1394a4ec1a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:44:43.420735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:43.420735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:44:43.420735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:44:43.420735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:44:43.420735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:44:43.420735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:44:43.420735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:43.420735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:44:43.420735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:43.420735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:44:43.420735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:43.420735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:43.420735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:43.420735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:43.420735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:43.420735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:43.427665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:43.427665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:43.427665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:43.427665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:43.427665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:43.427665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:43.427665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:44:43.427665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:44:43.427665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:44:43.427665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:44:43.427665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:43.427665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:43.427665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:43.427665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:43.427665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:43.427665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:43.428533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:43.428533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:43.428533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:43.428533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:43.428533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:43.428533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:43.428533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:43.428533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:43.428533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:43.428533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:43.428533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:44:43.428533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:43.428533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:44:43.428533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:43.428533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 422/843] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Sep 13 19:44:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:43.429357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e2977-3200-40e1-9c9b-ce1394a4ec1a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:43.504209 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdaf053-95c8-4813-a41e-4a76a7cf5ae3 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:43.541444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adca2c1-5c28-4d25-949a-9b1db50019fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:43.542083 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adca2c1-5c28-4d25-949a-9b1db50019fd None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:43.542361 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adca2c1-5c28-4d25-949a-9b1db50019fd None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:43.542634 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adca2c1-5c28-4d25-949a-9b1db50019fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:43.550623 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e2977-3200-40e1-9c9b-ce1394a4ec1a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:43.569576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:43.574760 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:43.587377 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c9487-4950-4a9e-84e4-adc36391aa95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:43.588315 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c9487-4950-4a9e-84e4-adc36391aa95 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:43.588808 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c9487-4950-4a9e-84e4-adc36391aa95 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:43.589352 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0c9487-4950-4a9e-84e4-adc36391aa95 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:43.590220 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c9487-4950-4a9e-84e4-adc36391aa95 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:43.590724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c9487-4950-4a9e-84e4-adc36391aa95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:43.592306 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0c9487-4950-4a9e-84e4-adc36391aa95 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:43.602659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 423/844] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Sep 13 19:44:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:43.603797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c9487-4950-4a9e-84e4-adc36391aa95 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:43.617670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adca2c1-5c28-4d25-949a-9b1db50019fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:43.619068 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adca2c1-5c28-4d25-949a-9b1db50019fd None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:43.711759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0c9487-4950-4a9e-84e4-adc36391aa95 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:43.732959 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 422/845] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:43 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:44:43.734321 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adca2c1-5c28-4d25-949a-9b1db50019fd None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:43.747616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b2e63-70d0-474b-a368-82bb802f027c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:43.748448 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b2e63-70d0-474b-a368-82bb802f027c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:43.748957 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b2e63-70d0-474b-a368-82bb802f027c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:43.749432 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5b2e63-70d0-474b-a368-82bb802f027c None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:43.750286 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b2e63-70d0-474b-a368-82bb802f027c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:43.750800 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b2e63-70d0-474b-a368-82bb802f027c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:43.752372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5b2e63-70d0-474b-a368-82bb802f027c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:43.765791 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 424/846] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Sep 13 19:44:43 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:43.798462 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:43.850657 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adca2c1-5c28-4d25-949a-9b1db50019fd None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:43.892020 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1a6c5-eb07-4533-a786-f4ed42d43fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:43.892607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1a6c5-eb07-4533-a786-f4ed42d43fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:43.892890 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1a6c5-eb07-4533-a786-f4ed42d43fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:43.893729 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1a6c5-eb07-4533-a786-f4ed42d43fc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:43.912375 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1a6c5-eb07-4533-a786-f4ed42d43fc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:43.913887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1a6c5-eb07-4533-a786-f4ed42d43fc8 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:43.930895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-47d1a6c5-eb07-4533-a786-f4ed42d43fc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:43.930895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:43.930895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:43.930895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:43.930895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:43.930895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:43.930895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:43.930895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:43.930895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:43.930895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:43.930895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:43.930895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:43.930895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:43.930895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:43.930895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:43.930895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:43.931924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:43.931924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:43.931924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:43.931924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:43.931924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:43.931924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:43.931924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:43.931924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:43.931924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:43.931924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:43.931924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:43.931924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:43.931924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:43.931924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:43.931924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:43.931924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:43.931924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:43.933203 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:43.933203 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:43.933203 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:43.933203 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 423/847] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:43.939551 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b2e63-70d0-474b-a368-82bb802f027c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:43.995980 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:44.048185 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5b2e63-70d0-474b-a368-82bb802f027c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:44.084036 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe4e6a-965c-4501-96dc-26cadf7ee517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:44.084646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe4e6a-965c-4501-96dc-26cadf7ee517 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:44.084925 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe4e6a-965c-4501-96dc-26cadf7ee517 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:44.085198 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe4e6a-965c-4501-96dc-26cadf7ee517 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:44.085865 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe4e6a-965c-4501-96dc-26cadf7ee517 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:44.086168 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe4e6a-965c-4501-96dc-26cadf7ee517 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:44.087536 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe4e6a-965c-4501-96dc-26cadf7ee517 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:44.100655 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 425/848] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:44.106499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1a6c5-eb07-4533-a786-f4ed42d43fc8 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:44.217216 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1a6c5-eb07-4533-a786-f4ed42d43fc8 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:44.226624 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:44.252719 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846de43a-03b9-4df6-9ea2-bb43e3f39395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:44.253974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846de43a-03b9-4df6-9ea2-bb43e3f39395 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:44.254264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846de43a-03b9-4df6-9ea2-bb43e3f39395 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:44.254537 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846de43a-03b9-4df6-9ea2-bb43e3f39395 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:44.261828 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846de43a-03b9-4df6-9ea2-bb43e3f39395 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:44.263280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846de43a-03b9-4df6-9ea2-bb43e3f39395 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:44.275154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-846de43a-03b9-4df6-9ea2-bb43e3f39395 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:44.275154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:44.275154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:44.275154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:44.275154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:44.275154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:44.275154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:44.275154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:44.275154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:44.275154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:44.275154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:44.275154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:44.275154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:44.275154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:44.275154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:44.281353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:44.281353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:44.281353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:44.281353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:44.281353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:44.281353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:44.281353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:44.281353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:44.281353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:44.281353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:44.281353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:44.281353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:44.281353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:44.281353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:44.281353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:44.281353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:44.281353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:44.282295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:44.282295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:44.282295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:44.282295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:44.282295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:44.282295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:44.282295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:44.282295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:44.282295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 424/849] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:44.285984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe4e6a-965c-4501-96dc-26cadf7ee517 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:44.392849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe4e6a-965c-4501-96dc-26cadf7ee517 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:44.403688 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:44.427782 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0657a10-d0bd-49b4-8165-7dfda42fac23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:44.428398 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0657a10-d0bd-49b4-8165-7dfda42fac23 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:44.428677 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0657a10-d0bd-49b4-8165-7dfda42fac23 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:44.428949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0657a10-d0bd-49b4-8165-7dfda42fac23 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:44.429643 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0657a10-d0bd-49b4-8165-7dfda42fac23 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:44.429970 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0657a10-d0bd-49b4-8165-7dfda42fac23 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:44.431487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0657a10-d0bd-49b4-8165-7dfda42fac23 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:44.444218 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 426/850] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:44.450313 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846de43a-03b9-4df6-9ea2-bb43e3f39395 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:44.563861 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846de43a-03b9-4df6-9ea2-bb43e3f39395 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:44.599123 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2c69f-4741-4d60-a539-4cd57c0a60d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:44.599730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2c69f-4741-4d60-a539-4cd57c0a60d7 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:44.600012 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2c69f-4741-4d60-a539-4cd57c0a60d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:44.600287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2c69f-4741-4d60-a539-4cd57c0a60d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:44.601015 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2c69f-4741-4d60-a539-4cd57c0a60d7 None admin] RBAC: Adding query filter params (role.id=cd02ef2043de492a8bff6c165485f255, scope.project.id=ad67761fec0a430181877e216e90e7d4, user.id=c00e78bf5e5c4db29c47dce1e87f3f5a) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:44.601321 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2c69f-4741-4d60-a539-4cd57c0a60d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:44.602781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2c69f-4741-4d60-a539-4cd57c0a60d7 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:44.609075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 425/851] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:44 2022] GET /identity/v3/role_assignments?user.id=c00e78bf5e5c4db29c47dce1e87f3f5a&scope.project.id=ad67761fec0a430181877e216e90e7d4&role.id=cd02ef2043de492a8bff6c165485f255 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:44.611621 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637fb63-3173-4720-9da6-64036a5a4dc1 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:44.611909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637fb63-3173-4720-9da6-64036a5a4dc1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:44.612181 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8637fb63-3173-4720-9da6-64036a5a4dc1 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:44.614356 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 427/852] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:44.619974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89861090-20b9-4105-947b-7a10dd90505e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:44.620266 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89861090-20b9-4105-947b-7a10dd90505e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:44.620541 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89861090-20b9-4105-947b-7a10dd90505e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:44.640825 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-89861090-20b9-4105-947b-7a10dd90505e None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:44.642116 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-89861090-20b9-4105-947b-7a10dd90505e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:44.678103 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:44.719842 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 426/853] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:44:44.941292 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363ad01-fdee-4ed0-b0bb-ebdfdf04a6f5 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:44.941620 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363ad01-fdee-4ed0-b0bb-ebdfdf04a6f5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:44.941882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c363ad01-fdee-4ed0-b0bb-ebdfdf04a6f5 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:44.943470 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 428/854] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:44.949891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107bbc8-bc28-4c0a-ad10-88217c5ab8bc None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:44.950176 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107bbc8-bc28-4c0a-ad10-88217c5ab8bc None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:44.950445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a107bbc8-bc28-4c0a-ad10-88217c5ab8bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:44.968723 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-a107bbc8-bc28-4c0a-ad10-88217c5ab8bc None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:44.969924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a107bbc8-bc28-4c0a-ad10-88217c5ab8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:45.003752 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363ad01-fdee-4ed0-b0bb-ebdfdf04a6f5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:45.048768 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 427/855] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:44:45.114902 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c363ad01-fdee-4ed0-b0bb-ebdfdf04a6f5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:45.154215 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe4fb4-b52d-46ee-b21f-fe8dda7969fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:45.155208 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe4fb4-b52d-46ee-b21f-fe8dda7969fc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:45.155696 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe4fb4-b52d-46ee-b21f-fe8dda7969fc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:45.156183 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbe4fb4-b52d-46ee-b21f-fe8dda7969fc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:45.156965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe4fb4-b52d-46ee-b21f-fe8dda7969fc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:45.158629 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbe4fb4-b52d-46ee-b21f-fe8dda7969fc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:45.168859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-3cbe4fb4-b52d-46ee-b21f-fe8dda7969fc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:44:45.168859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:45.168859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:44:45.168859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:44:45.168859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:44:45.168859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:44:45.168859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:44:45.168859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:45.168859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:44:45.168859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:45.168859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:44:45.168859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:45.168859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:45.168859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:45.168859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:45.168859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:45.169873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:45.169873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:45.169873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:45.169873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:45.169873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:45.169873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:45.169873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:45.169873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:44:45.169873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:44:45.169873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:44:45.169873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:44:45.169873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:45.169873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:45.169873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:45.169873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:45.169873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:45.169873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:45.170794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:45.170794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:45.170794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:45.170794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:45.170794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:45.170794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:45.170794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:45.170794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:45.170794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:45.170794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:45.170794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:44:45.170794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:45.170794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:44:45.170794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:45.177795 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 429/856] 10.222.0.59 () {56 vars in 1132 bytes} [Tue Sep 13 19:44:45 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:45.179591 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107bbc8-bc28-4c0a-ad10-88217c5ab8bc None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:45.271730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:45.279960 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a107bbc8-bc28-4c0a-ad10-88217c5ab8bc None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:45.313051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b75813-530e-4999-b059-cdfe81c02d2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:45.313662 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b75813-530e-4999-b059-cdfe81c02d2c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:45.313972 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b75813-530e-4999-b059-cdfe81c02d2c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:45.314245 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b75813-530e-4999-b059-cdfe81c02d2c None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:45.314881 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b75813-530e-4999-b059-cdfe81c02d2c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:45.315273 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b75813-530e-4999-b059-cdfe81c02d2c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:45.317223 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe4fb4-b52d-46ee-b21f-fe8dda7969fc None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:45.317667 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b75813-530e-4999-b059-cdfe81c02d2c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:45.327603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 428/857] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Sep 13 19:44:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:45.335180 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b75813-530e-4999-b059-cdfe81c02d2c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:45.357636 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:45.440134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbe4fb4-b52d-46ee-b21f-fe8dda7969fc None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:45.463516 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b75813-530e-4999-b059-cdfe81c02d2c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:45.482333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9dd60-9a25-4127-ae79-68230668afbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:45.483112 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9dd60-9a25-4127-ae79-68230668afbc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:45.483389 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9dd60-9a25-4127-ae79-68230668afbc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:45.483933 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda9dd60-9a25-4127-ae79-68230668afbc None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:45.497528 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda9dd60-9a25-4127-ae79-68230668afbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:45.501707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cecb25-eb62-4507-bd9d-e5a7dbf1474f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:45.502384 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cecb25-eb62-4507-bd9d-e5a7dbf1474f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:45.502562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-bda9dd60-9a25-4127-ae79-68230668afbc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:45.502562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:45.502562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:45.502562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:45.502562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:45.502562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:45.502562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:45.502562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:45.502562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:45.502562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:45.502562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:45.502562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:45.502562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:45.502562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:45.502562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:45.502562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:45.504244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:45.504244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:45.504244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:45.504244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:45.504244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:45.504244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:45.504244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:45.504244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:45.504244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:45.504244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:45.504244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:45.504244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:45.504244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:45.504244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:45.504244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:45.504244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:45.505584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:45.505584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:45.505584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:45.505584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:45.505584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:45.505584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:45.505584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:45.505584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:45.505584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:45.505584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:45.505584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:44:45.505584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:45.506427 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cecb25-eb62-4507-bd9d-e5a7dbf1474f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:45.506427 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cecb25-eb62-4507-bd9d-e5a7dbf1474f None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:45.506593 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 430/858] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Sep 13 19:44:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:45.506690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cecb25-eb62-4507-bd9d-e5a7dbf1474f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:45.506690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cecb25-eb62-4507-bd9d-e5a7dbf1474f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:45.506894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cecb25-eb62-4507-bd9d-e5a7dbf1474f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:45.516361 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9dd60-9a25-4127-ae79-68230668afbc None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:45.525740 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 429/859] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Sep 13 19:44:45 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:45.625852 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:45.633551 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda9dd60-9a25-4127-ae79-68230668afbc None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:45.671109 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c860759-f605-4e1b-8d9b-a67e5a635103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:45.671728 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c860759-f605-4e1b-8d9b-a67e5a635103 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:45.672007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c860759-f605-4e1b-8d9b-a67e5a635103 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:45.672280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c860759-f605-4e1b-8d9b-a67e5a635103 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:45.672953 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c860759-f605-4e1b-8d9b-a67e5a635103 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:45.673254 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c860759-f605-4e1b-8d9b-a67e5a635103 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:45.674666 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c860759-f605-4e1b-8d9b-a67e5a635103 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:45.684843 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 431/860] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Sep 13 19:44:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:45.691273 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cecb25-eb62-4507-bd9d-e5a7dbf1474f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:45.716300 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:45.799020 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cecb25-eb62-4507-bd9d-e5a7dbf1474f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:45.835445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327490b-71dc-4895-8df3-dc4d5f6e75c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:45.836082 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327490b-71dc-4895-8df3-dc4d5f6e75c4 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:45.836360 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327490b-71dc-4895-8df3-dc4d5f6e75c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:45.836634 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b327490b-71dc-4895-8df3-dc4d5f6e75c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:45.847412 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327490b-71dc-4895-8df3-dc4d5f6e75c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:45.848856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b327490b-71dc-4895-8df3-dc4d5f6e75c4 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:45.865383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-b327490b-71dc-4895-8df3-dc4d5f6e75c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:45.865383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:45.865383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:45.865383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:45.865383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:45.865383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:45.865383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:45.865383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:45.865383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:45.865383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:45.865383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:45.865383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:45.865383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:45.865383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:45.865383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:45.865383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:45.866406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:45.866406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:45.866406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:45.866406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:45.866406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:45.866406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:45.866406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:45.866406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:45.866406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:45.866406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:45.866406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:45.866406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:45.866406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:45.866406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:45.866406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:45.866406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:45.866406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:45.867934 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:45.867934 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:45.867934 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:45.867934 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 430/861] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:45.872481 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c860759-f605-4e1b-8d9b-a67e5a635103 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:45.984839 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c860759-f605-4e1b-8d9b-a67e5a635103 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:46.025504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993e52f4-c0ea-4195-9f02-0361452fc8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:46.026532 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e52f4-c0ea-4195-9f02-0361452fc8e3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:46.027013 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e52f4-c0ea-4195-9f02-0361452fc8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:46.027505 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993e52f4-c0ea-4195-9f02-0361452fc8e3 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:46.028362 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e52f4-c0ea-4195-9f02-0361452fc8e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:46.028983 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e52f4-c0ea-4195-9f02-0361452fc8e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:46.030572 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993e52f4-c0ea-4195-9f02-0361452fc8e3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:46.047629 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 432/862] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:46.053438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327490b-71dc-4895-8df3-dc4d5f6e75c4 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:46.104280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701b70f-ab09-4538-83f0-ce5288423683 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:46.104575 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701b70f-ab09-4538-83f0-ce5288423683 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:46.104824 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8701b70f-ab09-4538-83f0-ce5288423683 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:46.106447 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 433/863] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:46.111216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50230b9b-3c82-4d65-9cc7-e4429e24c77c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:46.111500 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50230b9b-3c82-4d65-9cc7-e4429e24c77c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:46.111781 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50230b9b-3c82-4d65-9cc7-e4429e24c77c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:46.130892 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-50230b9b-3c82-4d65-9cc7-e4429e24c77c None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:46.132198 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-50230b9b-3c82-4d65-9cc7-e4429e24c77c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:46.136916 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:46.144931 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:46.169866 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b327490b-71dc-4895-8df3-dc4d5f6e75c4 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:46.210061 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93645fa-8255-4221-a534-62986ab22ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:46.210983 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93645fa-8255-4221-a534-62986ab22ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:46.213744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 434/864] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:44:46.218030 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93645fa-8255-4221-a534-62986ab22ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:46.218321 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93645fa-8255-4221-a534-62986ab22ac6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:46.228559 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93645fa-8255-4221-a534-62986ab22ac6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:46.230023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93645fa-8255-4221-a534-62986ab22ac6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:46.243794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-c93645fa-8255-4221-a534-62986ab22ac6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:44:46.243794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:46.243794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:46.243794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:46.243794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:46.243794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:46.243794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:46.243794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:46.243794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:46.243794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:46.243794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:46.243794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:46.243794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:46.243794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:46.243794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:46.243794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:46.244754 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:46.244754 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:46.244754 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:46.244754 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:46.244754 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:46.244754 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:46.244754 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:46.244754 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:46.244754 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:46.244754 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:46.244754 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:46.244754 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:46.244754 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:46.244754 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:46.244754 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:46.244754 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:46.244754 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:46.244754 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:46.245742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:46.245742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:46.245742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:46.245742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:46.245742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:46.245742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:46.245742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:46.245742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:46.245742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:44:46.245742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:46.245742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 431/865] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Sep 13 19:44:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:46.250762 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50230b9b-3c82-4d65-9cc7-e4429e24c77c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:46.355771 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50230b9b-3c82-4d65-9cc7-e4429e24c77c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:46.393180 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245b42c-1d65-49dc-a094-557a4ea77366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:46.394586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245b42c-1d65-49dc-a094-557a4ea77366 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:46.395006 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245b42c-1d65-49dc-a094-557a4ea77366 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:46.395480 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6245b42c-1d65-49dc-a094-557a4ea77366 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:46.396338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245b42c-1d65-49dc-a094-557a4ea77366 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:46.396799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245b42c-1d65-49dc-a094-557a4ea77366 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:46.398377 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6245b42c-1d65-49dc-a094-557a4ea77366 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:46.417101 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 435/866] 10.222.0.59 () {56 vars in 1149 bytes} [Tue Sep 13 19:44:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:46.425729 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93645fa-8255-4221-a534-62986ab22ac6 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:46.503938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245b42c-1d65-49dc-a094-557a4ea77366 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:46.508322 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:46.531072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93645fa-8255-4221-a534-62986ab22ac6 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:46.562462 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:46.568088 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070cfa9e-f245-498d-ae59-017390e03552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:46.568711 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cfa9e-f245-498d-ae59-017390e03552 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:46.568993 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cfa9e-f245-498d-ae59-017390e03552 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:46.569268 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070cfa9e-f245-498d-ae59-017390e03552 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:46.622176 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6245b42c-1d65-49dc-a094-557a4ea77366 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:46.647148 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cfa9e-f245-498d-ae59-017390e03552 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:46.648784 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070cfa9e-f245-498d-ae59-017390e03552 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:46.658385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b258b-9f36-4332-b659-7f2402c0c4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:46.658994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b258b-9f36-4332-b659-7f2402c0c4a0 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:46.659345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b258b-9f36-4332-b659-7f2402c0c4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:46.660111 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b258b-9f36-4332-b659-7f2402c0c4a0 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:46.660776 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b258b-9f36-4332-b659-7f2402c0c4a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:46.662192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b258b-9f36-4332-b659-7f2402c0c4a0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:46.733279 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 436/867] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Sep 13 19:44:46 2022] POST /identity/v3/services => generated 251 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:44:46.773133 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 432/868] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:46 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:44:46.781555 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b258b-9f36-4332-b659-7f2402c0c4a0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:46.859828 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:46.911576 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b258b-9f36-4332-b659-7f2402c0c4a0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:46.948667 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9577978-ccc4-4e27-a910-1ae91d4230c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:46.949415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9577978-ccc4-4e27-a910-1ae91d4230c0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:46.949758 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9577978-ccc4-4e27-a910-1ae91d4230c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:46.949999 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9577978-ccc4-4e27-a910-1ae91d4230c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:46.955687 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e41138-5441-4857-98d7-45a4f57258d2 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:46.955976 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e41138-5441-4857-98d7-45a4f57258d2 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:46.956818 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e41138-5441-4857-98d7-45a4f57258d2 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:46.958197 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 433/869] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:44:46.963927 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6065bd-c87f-4e4d-8500-309d16f773fd None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:46.964170 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9577978-ccc4-4e27-a910-1ae91d4230c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:46.964640 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6065bd-c87f-4e4d-8500-309d16f773fd None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:46.965106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6065bd-c87f-4e4d-8500-309d16f773fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:46.965641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9577978-ccc4-4e27-a910-1ae91d4230c0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:46.981355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-a9577978-ccc4-4e27-a910-1ae91d4230c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:46.981355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:46.981355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:46.981355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:46.981355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:46.981355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:46.981355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:46.981355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:46.981355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:46.981355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:46.981355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:46.981355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:46.981355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:46.981355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:46.981355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:46.981355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:46.982571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:46.982571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:46.982571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:46.982571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:46.982571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:46.982571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:46.982571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:46.982571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:46.982571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:46.982571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:46.982571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:46.982571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:46.982571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:46.982571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:46.982571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:46.982571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:46.982571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:46.983474 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:46.983474 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:46.983474 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:46.983474 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 437/870] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:46.988135 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9577978-ccc4-4e27-a910-1ae91d4230c0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:46.990276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-ab6065bd-c87f-4e4d-8500-309d16f773fd None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:46.992757 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ab6065bd-c87f-4e4d-8500-309d16f773fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:47.058191 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:47.069595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 434/871] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:46 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:44:47.102064 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9577978-ccc4-4e27-a910-1ae91d4230c0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:47.118760 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:47.136904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c8b6a-bd34-42f7-a5fe-55b8b3ed6967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:47.141310 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c8b6a-bd34-42f7-a5fe-55b8b3ed6967 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:47.141310 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c8b6a-bd34-42f7-a5fe-55b8b3ed6967 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:47.141310 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c8b6a-bd34-42f7-a5fe-55b8b3ed6967 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:47.141310 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c8b6a-bd34-42f7-a5fe-55b8b3ed6967 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:47.141310 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c8b6a-bd34-42f7-a5fe-55b8b3ed6967 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:47.141310 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c8b6a-bd34-42f7-a5fe-55b8b3ed6967 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:47.152450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 438/872] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:47.158036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6065bd-c87f-4e4d-8500-309d16f773fd None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:47.261483 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6065bd-c87f-4e4d-8500-309d16f773fd None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:47.297447 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab611c1-e413-42e9-8dd9-a8a71b1fc5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:47.298463 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab611c1-e413-42e9-8dd9-a8a71b1fc5d7 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:47.298944 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab611c1-e413-42e9-8dd9-a8a71b1fc5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:47.299416 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab611c1-e413-42e9-8dd9-a8a71b1fc5d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:47.307177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab611c1-e413-42e9-8dd9-a8a71b1fc5d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:47.308944 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab611c1-e413-42e9-8dd9-a8a71b1fc5d7 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:47.321668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-dab611c1-e413-42e9-8dd9-a8a71b1fc5d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:47.321668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:47.321668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:47.321668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:47.321668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:47.321668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:47.321668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:47.321668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:47.321668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:47.321668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:47.321668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:47.321668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:47.321668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:47.321668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:47.321668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:47.328476 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:47.328476 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:47.328476 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:47.328476 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:47.328476 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:47.328476 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:47.328476 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:47.328476 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:47.328476 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:47.328476 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:47.328476 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:47.328476 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:47.328476 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:47.328476 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:47.328476 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:47.328476 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:47.328476 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:47.329395 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:47.329395 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:47.329395 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:47.329395 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:47.329395 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:47.329395 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:47.329395 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:47.329395 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:47.330285 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 435/873] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:47.332166 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c8b6a-bd34-42f7-a5fe-55b8b3ed6967 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:47.344387 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab611c1-e413-42e9-8dd9-a8a71b1fc5d7 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:47.377472 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:47.447950 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c8b6a-bd34-42f7-a5fe-55b8b3ed6967 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:47.473530 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab611c1-e413-42e9-8dd9-a8a71b1fc5d7 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:47.485128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21a078-9e39-49ec-be80-b1c5849f6fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:47.486196 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21a078-9e39-49ec-be80-b1c5849f6fdb None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:47.486683 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21a078-9e39-49ec-be80-b1c5849f6fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:47.487878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c21a078-9e39-49ec-be80-b1c5849f6fdb None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:47.488784 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21a078-9e39-49ec-be80-b1c5849f6fdb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:47.489289 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21a078-9e39-49ec-be80-b1c5849f6fdb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:47.491070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c21a078-9e39-49ec-be80-b1c5849f6fdb None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:47.510049 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 439/874] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:47.511774 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21a078-9e39-49ec-be80-b1c5849f6fdb None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:47.514750 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef044b47-31c4-4aad-bac4-5c53619d893e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:47.515399 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef044b47-31c4-4aad-bac4-5c53619d893e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:47.515678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef044b47-31c4-4aad-bac4-5c53619d893e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:47.515957 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef044b47-31c4-4aad-bac4-5c53619d893e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:47.517384 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef044b47-31c4-4aad-bac4-5c53619d893e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:47.518852 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef044b47-31c4-4aad-bac4-5c53619d893e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:47.530086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-ef044b47-31c4-4aad-bac4-5c53619d893e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:44:47.530086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:47.530086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:44:47.530086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:44:47.530086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:44:47.530086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:44:47.530086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:44:47.530086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:47.530086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:44:47.530086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:47.530086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:44:47.530086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:47.530086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:47.530086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:47.530086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:47.530086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:47.530086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:47.531143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:47.531143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:47.531143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:47.531143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:47.531143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:47.531143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:47.531143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:44:47.531143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:44:47.531143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:44:47.531143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:44:47.531143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:47.531143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:47.531143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:47.531143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:47.531143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:47.531143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:47.532661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:47.532661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:47.532661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:47.532661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:47.532661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:47.532661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:47.532661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:47.532661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:47.532661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:47.532661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:47.532661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:44:47.532661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:47.532661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:44:47.532661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:47.536819 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 436/875] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Sep 13 19:44:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:47.537834 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef044b47-31c4-4aad-bac4-5c53619d893e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:47.553968 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:47.630280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c21a078-9e39-49ec-be80-b1c5849f6fdb None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:47.647742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:47.666033 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef044b47-31c4-4aad-bac4-5c53619d893e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:47.672221 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac6528-b233-4032-b532-e56ebd5ad348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:47.672837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac6528-b233-4032-b532-e56ebd5ad348 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:47.673119 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac6528-b233-4032-b532-e56ebd5ad348 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:47.673394 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ac6528-b233-4032-b532-e56ebd5ad348 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:47.674154 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac6528-b233-4032-b532-e56ebd5ad348 None admin] RBAC: Adding query filter params (role.id=b253c1f3cd6a4197a85ca5f672852073, scope.project.id=ad67761fec0a430181877e216e90e7d4, user.id=9fd7a80714874e73bf64dfa392632391) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:47.674463 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac6528-b233-4032-b532-e56ebd5ad348 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:47.676904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ac6528-b233-4032-b532-e56ebd5ad348 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:47.685734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 440/876] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:47 2022] GET /identity/v3/role_assignments?user.id=9fd7a80714874e73bf64dfa392632391&scope.project.id=ad67761fec0a430181877e216e90e7d4&role.id=b253c1f3cd6a4197a85ca5f672852073 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:47.720076 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a100b9c3-c625-4d1d-bb0c-baba42576781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:47.720781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100b9c3-c625-4d1d-bb0c-baba42576781 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:47.721067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100b9c3-c625-4d1d-bb0c-baba42576781 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:47.721348 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a100b9c3-c625-4d1d-bb0c-baba42576781 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:47.722612 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100b9c3-c625-4d1d-bb0c-baba42576781 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:47.722923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100b9c3-c625-4d1d-bb0c-baba42576781 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:47.724441 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a100b9c3-c625-4d1d-bb0c-baba42576781 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:47.731145 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 437/877] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Sep 13 19:44:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:47.738061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac6528-b233-4032-b532-e56ebd5ad348 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:47.845669 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:47.849124 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e8d34-e1d1-4315-8935-f0a2d8681205 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:47.849611 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e8d34-e1d1-4315-8935-f0a2d8681205 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:47.849841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e8d34-e1d1-4315-8935-f0a2d8681205 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:47.851159 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 438/878] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:47.856065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ac6528-b233-4032-b532-e56ebd5ad348 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:47.857131 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99b8b8-8e42-4c11-b15e-bd571e88bfd4 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:47.857654 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99b8b8-8e42-4c11-b15e-bd571e88bfd4 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:47.858044 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d99b8b8-8e42-4c11-b15e-bd571e88bfd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:47.886539 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-0d99b8b8-8e42-4c11-b15e-bd571e88bfd4 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:47.888064 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0d99b8b8-8e42-4c11-b15e-bd571e88bfd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:47.903262 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121095f-ef81-49b1-8706-cad66492fdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:47.903262 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121095f-ef81-49b1-8706-cad66492fdd0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:47.903262 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121095f-ef81-49b1-8706-cad66492fdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:47.903262 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c121095f-ef81-49b1-8706-cad66492fdd0 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:47.903634 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121095f-ef81-49b1-8706-cad66492fdd0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:47.903634 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121095f-ef81-49b1-8706-cad66492fdd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:47.905119 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c121095f-ef81-49b1-8706-cad66492fdd0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:47.913612 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 441/879] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Sep 13 19:44:47 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:47.976538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 439/880] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:47 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:44:48.251070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121095f-ef81-49b1-8706-cad66492fdd0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:48.354546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c121095f-ef81-49b1-8706-cad66492fdd0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:48.392928 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffeb1e7-3dea-41fa-8587-548fbb0ead8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:48.393562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffeb1e7-3dea-41fa-8587-548fbb0ead8d None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:48.393943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffeb1e7-3dea-41fa-8587-548fbb0ead8d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:48.394218 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffeb1e7-3dea-41fa-8587-548fbb0ead8d None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:48.394889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffeb1e7-3dea-41fa-8587-548fbb0ead8d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:48.396364 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffeb1e7-3dea-41fa-8587-548fbb0ead8d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:48.496477 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 442/881] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Sep 13 19:44:48 2022] POST /identity/v3/services => generated 269 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:44:49.044430 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf8b60-927b-489d-9d72-3e8d56bb5b54 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:49.044955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf8b60-927b-489d-9d72-3e8d56bb5b54 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:49.044955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edf8b60-927b-489d-9d72-3e8d56bb5b54 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:49.046595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 440/882] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:49.052028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fed6c-3935-426d-beb3-6868e7d4cbec None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:49.052318 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fed6c-3935-426d-beb3-6868e7d4cbec None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:49.052601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020fed6c-3935-426d-beb3-6868e7d4cbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:49.071691 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-020fed6c-3935-426d-beb3-6868e7d4cbec None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:49.072885 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-020fed6c-3935-426d-beb3-6868e7d4cbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:49.088414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:49.152627 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 443/883] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:44:49.423515 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf8b60-927b-489d-9d72-3e8d56bb5b54 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:49.507133 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:49.531844 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edf8b60-927b-489d-9d72-3e8d56bb5b54 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:49.573485 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ed288-4584-4fa8-bd37-d6f2145c2291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:49.574466 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ed288-4584-4fa8-bd37-d6f2145c2291 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:49.574927 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ed288-4584-4fa8-bd37-d6f2145c2291 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:49.575348 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96ed288-4584-4fa8-bd37-d6f2145c2291 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:49.576305 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ed288-4584-4fa8-bd37-d6f2145c2291 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:49.577844 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96ed288-4584-4fa8-bd37-d6f2145c2291 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:49.591307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-e96ed288-4584-4fa8-bd37-d6f2145c2291 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:44:49.591307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:49.591307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:44:49.591307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:44:49.591307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:44:49.591307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:44:49.591307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:44:49.591307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:49.591307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:44:49.591307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:49.591307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:44:49.591307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:49.591307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:49.591307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:49.591307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:49.591307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:49.591307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:49.592893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:49.592893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:49.592893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:49.592893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:49.592893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:49.592893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:49.592893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:44:49.592893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:44:49.592893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:44:49.592893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:44:49.592893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:49.592893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:49.592893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:49.592893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:49.592893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:49.592893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:49.594109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:49.594109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:49.594109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:49.594109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:49.594109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:49.594109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:49.594109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:49.594109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:49.594109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:49.594109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:49.594109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:44:49.594109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:49.594109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:44:49.594109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:49.594109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 441/884] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Sep 13 19:44:49 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:49.598843 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fed6c-3935-426d-beb3-6868e7d4cbec None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:49.704786 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020fed6c-3935-426d-beb3-6868e7d4cbec None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:49.741106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f5871-e5c7-4353-bbc0-ff6742d58b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:49.741740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f5871-e5c7-4353-bbc0-ff6742d58b85 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:49.742027 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f5871-e5c7-4353-bbc0-ff6742d58b85 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:49.742300 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46f5871-e5c7-4353-bbc0-ff6742d58b85 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:49.742934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f5871-e5c7-4353-bbc0-ff6742d58b85 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:49.743235 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f5871-e5c7-4353-bbc0-ff6742d58b85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:49.744608 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46f5871-e5c7-4353-bbc0-ff6742d58b85 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:49.750050 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 444/885] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Sep 13 19:44:49 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:49.756660 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ed288-4584-4fa8-bd37-d6f2145c2291 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:49.860170 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96ed288-4584-4fa8-bd37-d6f2145c2291 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:49.899197 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8a1f5-8530-41c2-b7e2-1239c0786ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:49.899806 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8a1f5-8530-41c2-b7e2-1239c0786ad5 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:49.900084 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8a1f5-8530-41c2-b7e2-1239c0786ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:49.900356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac8a1f5-8530-41c2-b7e2-1239c0786ad5 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:49.901037 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8a1f5-8530-41c2-b7e2-1239c0786ad5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:49.901391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8a1f5-8530-41c2-b7e2-1239c0786ad5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:49.902783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac8a1f5-8530-41c2-b7e2-1239c0786ad5 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:49.908074 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 442/886] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Sep 13 19:44:49 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:49.914075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f5871-e5c7-4353-bbc0-ff6742d58b85 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:49.927619 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:50.025030 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46f5871-e5c7-4353-bbc0-ff6742d58b85 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:50.063368 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3ff1dd-48b8-48b6-9a31-0fe7a347d431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:50.064001 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ff1dd-48b8-48b6-9a31-0fe7a347d431 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:50.064279 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ff1dd-48b8-48b6-9a31-0fe7a347d431 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:50.064554 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3ff1dd-48b8-48b6-9a31-0fe7a347d431 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:50.065316 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ff1dd-48b8-48b6-9a31-0fe7a347d431 None admin] RBAC: Adding query filter params (interface=public, service_id=762c5e0df39b4759b7a95584f5973475, region_id=RegionOne) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:50.065627 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ff1dd-48b8-48b6-9a31-0fe7a347d431 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:50.067095 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3ff1dd-48b8-48b6-9a31-0fe7a347d431 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:50.073563 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 445/887] 10.222.0.59 () {56 vars in 1251 bytes} [Tue Sep 13 19:44:49 2022] GET /identity/v3/endpoints?service_id=762c5e0df39b4759b7a95584f5973475&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:50.079554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8a1f5-8530-41c2-b7e2-1239c0786ad5 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:50.091586 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:50.125453 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd4af2-ae67-4175-9a3f-cd56b682ba03 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:50.126159 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd4af2-ae67-4175-9a3f-cd56b682ba03 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:50.126159 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cd4af2-ae67-4175-9a3f-cd56b682ba03 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:50.127729 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 446/888] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:50.133913 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22982bfe-44f7-4524-bfb3-a69df8ce6266 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:50.134465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22982bfe-44f7-4524-bfb3-a69df8ce6266 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:50.134965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22982bfe-44f7-4524-bfb3-a69df8ce6266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:50.156067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-22982bfe-44f7-4524-bfb3-a69df8ce6266 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:50.157755 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-22982bfe-44f7-4524-bfb3-a69df8ce6266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:50.189769 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac8a1f5-8530-41c2-b7e2-1239c0786ad5 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:50.224150 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bdc71f-d4e4-4fb4-923f-ce5b12c54894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:50.224755 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdc71f-d4e4-4fb4-923f-ce5b12c54894 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:50.225032 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdc71f-d4e4-4fb4-923f-ce5b12c54894 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:50.225307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bdc71f-d4e4-4fb4-923f-ce5b12c54894 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:50.225930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bdc71f-d4e4-4fb4-923f-ce5b12c54894 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:50.227288 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bdc71f-d4e4-4fb4-923f-ce5b12c54894 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:50.232780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 443/889] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Sep 13 19:44:50 2022] GET /identity/v3/services => generated 1268 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:44:50.237749 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6f8d8-9d27-430a-b2ce-ddc20cd8bb32 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:50.237749 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6f8d8-9d27-430a-b2ce-ddc20cd8bb32 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:50.237749 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d6f8d8-9d27-430a-b2ce-ddc20cd8bb32 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:50.237749 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 444/890] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:50.241124 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 447/891] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:44:50.247484 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4029b-7dad-4266-88e4-61ebf73cd3da None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:50.248120 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4029b-7dad-4266-88e4-61ebf73cd3da None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:50.248624 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4029b-7dad-4266-88e4-61ebf73cd3da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:50.286092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-6bf4029b-7dad-4266-88e4-61ebf73cd3da None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:50.286092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6bf4029b-7dad-4266-88e4-61ebf73cd3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:50.361773 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 445/892] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:44:50.510021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22982bfe-44f7-4524-bfb3-a69df8ce6266 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:50.514246 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:50.615611 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22982bfe-44f7-4524-bfb3-a69df8ce6266 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:50.629467 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4029b-7dad-4266-88e4-61ebf73cd3da None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:50.658087 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:50.662832 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da447edb-97b3-4eec-a8ca-96695f3700ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:50.663647 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da447edb-97b3-4eec-a8ca-96695f3700ed None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:50.663927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da447edb-97b3-4eec-a8ca-96695f3700ed None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:50.664200 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da447edb-97b3-4eec-a8ca-96695f3700ed None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:50.678081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da447edb-97b3-4eec-a8ca-96695f3700ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:50.684523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-da447edb-97b3-4eec-a8ca-96695f3700ed None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:44:50.684523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:50.684523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:50.684523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:50.684523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:50.684523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:50.684523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:50.684523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:50.684523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:50.684523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:50.684523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:50.684523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:50.684523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:50.684523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:50.684523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:50.684523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:50.685502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:50.685502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:50.685502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:50.685502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:50.685502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:50.685502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:50.685502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:50.685502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:50.685502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:50.685502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:50.685502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:50.685502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:50.685502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:50.685502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:50.685502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:50.685502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:50.686415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:50.686415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:50.686415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:50.686415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:50.686415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:50.686415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:50.686415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:50.686415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:50.686415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:50.686415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:50.686415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:44:50.686415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:50.686415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 448/893] 10.222.0.59 () {56 vars in 1120 bytes} [Tue Sep 13 19:44:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:50.694793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da447edb-97b3-4eec-a8ca-96695f3700ed None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:50.745528 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4029b-7dad-4266-88e4-61ebf73cd3da None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:50.780472 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:50.787212 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd6af1b-3742-49c9-98a5-34f2e92e8988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:50.793874 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6af1b-3742-49c9-98a5-34f2e92e8988 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:50.793874 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6af1b-3742-49c9-98a5-34f2e92e8988 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:50.793874 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd6af1b-3742-49c9-98a5-34f2e92e8988 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:50.793874 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6af1b-3742-49c9-98a5-34f2e92e8988 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:50.793874 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd6af1b-3742-49c9-98a5-34f2e92e8988 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:50.820228 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da447edb-97b3-4eec-a8ca-96695f3700ed None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:50.853886 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57941095-3fef-4137-b1ce-d1f0fd7ed88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:50.854483 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57941095-3fef-4137-b1ce-d1f0fd7ed88c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:50.854758 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57941095-3fef-4137-b1ce-d1f0fd7ed88c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:50.855025 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57941095-3fef-4137-b1ce-d1f0fd7ed88c None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:50.855678 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57941095-3fef-4137-b1ce-d1f0fd7ed88c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:50.856002 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57941095-3fef-4137-b1ce-d1f0fd7ed88c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:50.857357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57941095-3fef-4137-b1ce-d1f0fd7ed88c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:50.869837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 449/894] 10.222.0.59 () {56 vars in 1115 bytes} [Tue Sep 13 19:44:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:50.869837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298aca3-a923-41c6-9bc2-bb80ae3ec150 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:50.869837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298aca3-a923-41c6-9bc2-bb80ae3ec150 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:50.869837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6298aca3-a923-41c6-9bc2-bb80ae3ec150 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:50.869837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 450/895] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:50.871456 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298aca3-a923-41c6-9bc2-bb80ae3ec150 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:50.882582 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 446/896] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Sep 13 19:44:50 2022] POST /identity/v3/services => generated 241 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:44:50.883913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745b2cf-eff6-4489-99cd-14d25261df1f None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:50.884270 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745b2cf-eff6-4489-99cd-14d25261df1f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:50.884617 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7745b2cf-eff6-4489-99cd-14d25261df1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:50.909385 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-7745b2cf-eff6-4489-99cd-14d25261df1f None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:50.910776 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7745b2cf-eff6-4489-99cd-14d25261df1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:50.978878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:51.005717 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 447/897] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:50 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:44:51.025409 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6298aca3-a923-41c6-9bc2-bb80ae3ec150 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:51.056431 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:51.066816 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96019623-7673-4604-9f62-54581ca6b291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:51.070041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96019623-7673-4604-9f62-54581ca6b291 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:51.070041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96019623-7673-4604-9f62-54581ca6b291 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:51.070041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96019623-7673-4604-9f62-54581ca6b291 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:51.079938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96019623-7673-4604-9f62-54581ca6b291 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:51.081516 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96019623-7673-4604-9f62-54581ca6b291 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:51.096581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-96019623-7673-4604-9f62-54581ca6b291 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:51.096581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:51.096581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:51.096581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:51.096581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:51.096581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:51.096581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:51.096581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:51.096581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:51.096581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:51.096581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:51.096581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:51.096581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:51.096581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:51.096581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:51.096581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:51.097616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:51.097616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:51.097616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:51.097616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:51.097616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:51.097616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:51.097616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:51.097616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:51.097616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:51.097616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:51.097616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:51.097616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:51.097616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:51.097616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:51.097616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:51.097616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:51.097616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:51.098640 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:51.098640 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:51.098640 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:51.098640 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 451/898] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:51.104978 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745b2cf-eff6-4489-99cd-14d25261df1f None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:51.218647 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7745b2cf-eff6-4489-99cd-14d25261df1f None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:51.258730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3308d-ee93-4f9f-87cb-ec0e6a11a566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:51.259338 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3308d-ee93-4f9f-87cb-ec0e6a11a566 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:51.259616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3308d-ee93-4f9f-87cb-ec0e6a11a566 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:51.259889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3308d-ee93-4f9f-87cb-ec0e6a11a566 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:51.260529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3308d-ee93-4f9f-87cb-ec0e6a11a566 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:51.260833 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3308d-ee93-4f9f-87cb-ec0e6a11a566 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:51.262283 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d3308d-ee93-4f9f-87cb-ec0e6a11a566 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:51.274010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 448/899] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:51.279359 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96019623-7673-4604-9f62-54581ca6b291 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:51.308646 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3308d-ee93-4f9f-87cb-ec0e6a11a566 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:51.363453 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:51.389178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96019623-7673-4604-9f62-54581ca6b291 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:51.420831 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3308d-ee93-4f9f-87cb-ec0e6a11a566 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:51.425968 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301dafa-2642-4c12-a42d-dfeb3c30b93a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:51.426890 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301dafa-2642-4c12-a42d-dfeb3c30b93a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:51.427418 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301dafa-2642-4c12-a42d-dfeb3c30b93a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:51.427883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1301dafa-2642-4c12-a42d-dfeb3c30b93a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:51.435913 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301dafa-2642-4c12-a42d-dfeb3c30b93a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:51.437644 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1301dafa-2642-4c12-a42d-dfeb3c30b93a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:51.449805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-1301dafa-2642-4c12-a42d-dfeb3c30b93a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:44:51.449805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:51.449805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:51.449805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:51.449805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:51.449805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:51.449805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:51.449805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:51.449805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:51.449805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:51.449805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:51.449805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:51.449805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:51.449805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:51.449805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:51.449805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:51.450793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:51.450793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:51.450793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:51.450793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:51.450793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:51.450793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:51.450793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:51.450793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:51.450793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:51.450793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:51.450793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:51.450793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:51.450793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:51.450793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:51.450793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:51.450793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:51.450793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:51.450793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:51.451753 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:51.451753 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:51.451753 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:51.451753 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:51.451753 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:51.451753 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:51.451753 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:51.451753 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:51.451753 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:44:51.451753 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:51.458938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 452/900] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Sep 13 19:44:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:51.460101 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301dafa-2642-4c12-a42d-dfeb3c30b93a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:51.461984 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd16068-0627-481e-877e-3d0fe88993b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:51.462629 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd16068-0627-481e-877e-3d0fe88993b5 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:51.462907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd16068-0627-481e-877e-3d0fe88993b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:51.463287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd16068-0627-481e-877e-3d0fe88993b5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:51.463880 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd16068-0627-481e-877e-3d0fe88993b5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:51.465366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd16068-0627-481e-877e-3d0fe88993b5 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:51.475847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-6fd16068-0627-481e-877e-3d0fe88993b5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:44:51.475847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:51.475847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:44:51.475847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:44:51.475847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:44:51.475847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:44:51.475847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:44:51.475847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:51.475847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:44:51.475847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:51.475847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:44:51.475847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:51.475847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:51.475847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:51.475847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:51.475847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:51.476821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:51.476821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:51.476821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:51.476821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:51.476821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:51.476821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:51.476821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:51.476821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:44:51.476821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:44:51.476821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:44:51.476821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:44:51.476821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:51.476821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:51.476821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:51.476821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:51.476821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:51.476821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:51.477765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:51.477765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:51.477765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:51.477765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:51.477765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:51.477765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:51.477765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:51.477765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:51.477765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:51.477765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:51.477765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:44:51.477765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:51.477765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:44:51.477765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:51.481953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 449/901] 10.222.0.59 () {56 vars in 1132 bytes} [Tue Sep 13 19:44:51 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:51.483178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd16068-0627-481e-877e-3d0fe88993b5 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:51.506224 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:51.573099 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1301dafa-2642-4c12-a42d-dfeb3c30b93a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:51.608517 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd1222-9afa-41aa-8104-9bd238020e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:51.609227 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd1222-9afa-41aa-8104-9bd238020e90 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:51.609630 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd1222-9afa-41aa-8104-9bd238020e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:51.609999 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cd1222-9afa-41aa-8104-9bd238020e90 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:51.610884 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd1222-9afa-41aa-8104-9bd238020e90 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:51.611166 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd1222-9afa-41aa-8104-9bd238020e90 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:51.613217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7cd1222-9afa-41aa-8104-9bd238020e90 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:51.614541 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd16068-0627-481e-877e-3d0fe88993b5 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:51.635606 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 453/902] 10.222.0.59 () {56 vars in 1149 bytes} [Tue Sep 13 19:44:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:51.636641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd1222-9afa-41aa-8104-9bd238020e90 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:51.636857 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:51.660802 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e099a-624b-4553-b423-13c046f7e063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:51.661415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e099a-624b-4553-b423-13c046f7e063 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:51.661711 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e099a-624b-4553-b423-13c046f7e063 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:51.661992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0e099a-624b-4553-b423-13c046f7e063 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:51.662794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e099a-624b-4553-b423-13c046f7e063 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:51.663096 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e099a-624b-4553-b423-13c046f7e063 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:51.664577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0e099a-624b-4553-b423-13c046f7e063 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:51.673968 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 450/903] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Sep 13 19:44:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:51.676078 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e099a-624b-4553-b423-13c046f7e063 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:51.758003 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:51.764214 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7cd1222-9afa-41aa-8104-9bd238020e90 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:51.799903 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0e099a-624b-4553-b423-13c046f7e063 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:51.801860 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cddd74-9b3e-4bf4-bfbc-a16e07433af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:51.802498 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cddd74-9b3e-4bf4-bfbc-a16e07433af9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:51.802851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cddd74-9b3e-4bf4-bfbc-a16e07433af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:51.803202 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10cddd74-9b3e-4bf4-bfbc-a16e07433af9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:51.845001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9f9a1-3a5e-4900-acd6-1b7b7d71ecb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:51.845936 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9f9a1-3a5e-4900-acd6-1b7b7d71ecb5 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:51.847384 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9f9a1-3a5e-4900-acd6-1b7b7d71ecb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:51.847834 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b9f9a1-3a5e-4900-acd6-1b7b7d71ecb5 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:51.849035 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9f9a1-3a5e-4900-acd6-1b7b7d71ecb5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:51.849717 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9f9a1-3a5e-4900-acd6-1b7b7d71ecb5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:51.851692 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b9f9a1-3a5e-4900-acd6-1b7b7d71ecb5 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:51.866379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 451/904] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Sep 13 19:44:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:51.867779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9f9a1-3a5e-4900-acd6-1b7b7d71ecb5 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:51.895371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cddd74-9b3e-4bf4-bfbc-a16e07433af9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:51.896990 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10cddd74-9b3e-4bf4-bfbc-a16e07433af9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:51.929579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:51.998249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:52.012777 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 454/905] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:44:51 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 19:44:52.013838 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cddd74-9b3e-4bf4-bfbc-a16e07433af9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:52.017628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b9f9a1-3a5e-4900-acd6-1b7b7d71ecb5 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:52.062881 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8957b16-2cbd-43e6-9303-92ce12b400f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:52.064026 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8957b16-2cbd-43e6-9303-92ce12b400f0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:52.064803 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8957b16-2cbd-43e6-9303-92ce12b400f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:52.065831 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8957b16-2cbd-43e6-9303-92ce12b400f0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:52.066773 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8957b16-2cbd-43e6-9303-92ce12b400f0 None admin] RBAC: Adding query filter params (interface=public, service_id=dfb0b4c73f274598a73a96bd60abf0bc, region_id=RegionOne) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:52.067338 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8957b16-2cbd-43e6-9303-92ce12b400f0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:52.069620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8957b16-2cbd-43e6-9303-92ce12b400f0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:52.082236 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 452/906] 10.222.0.59 () {56 vars in 1251 bytes} [Tue Sep 13 19:44:51 2022] GET /identity/v3/endpoints?service_id=dfb0b4c73f274598a73a96bd60abf0bc&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:52.086198 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8957b16-2cbd-43e6-9303-92ce12b400f0 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:52.122352 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10cddd74-9b3e-4bf4-bfbc-a16e07433af9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:52.157873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd503717-b141-4678-9c7b-39680ebdb9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:52.158503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd503717-b141-4678-9c7b-39680ebdb9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:52.158894 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd503717-b141-4678-9c7b-39680ebdb9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:52.159168 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd503717-b141-4678-9c7b-39680ebdb9b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:52.170165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd503717-b141-4678-9c7b-39680ebdb9b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:52.171740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd503717-b141-4678-9c7b-39680ebdb9b6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:52.186365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-dd503717-b141-4678-9c7b-39680ebdb9b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:52.186365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:52.186365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:52.186365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:52.186365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:52.186365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:52.186365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:52.186365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:52.186365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:52.186365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:52.186365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:52.186365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:52.186365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:52.186365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:52.186365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:52.186365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:52.187395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:52.187395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:52.187395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:52.187395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:52.187395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:52.187395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:52.187395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:52.187395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:52.187395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:52.187395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:52.187395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:52.187395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:52.187395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:52.187395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:52.187395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:52.187395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:52.187395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:52.188308 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:52.188308 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:52.188308 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:52.192700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 455/907] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:52.193822 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd503717-b141-4678-9c7b-39680ebdb9b6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:52.217481 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8957b16-2cbd-43e6-9303-92ce12b400f0 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:52.221990 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:52.245155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:52.262175 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab55324-6265-4961-83a1-a0ecb52b04a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:52.263126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab55324-6265-4961-83a1-a0ecb52b04a4 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:52.263464 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab55324-6265-4961-83a1-a0ecb52b04a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:52.264302 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab55324-6265-4961-83a1-a0ecb52b04a4 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:52.265244 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab55324-6265-4961-83a1-a0ecb52b04a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:52.267028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab55324-6265-4961-83a1-a0ecb52b04a4 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:52.275159 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 453/908] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Sep 13 19:44:52 2022] GET /identity/v3/services => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:44:52.307557 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd503717-b141-4678-9c7b-39680ebdb9b6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:52.349500 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d519e4c-37b1-4b0e-82bc-3eb9e5cdb3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:52.350177 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d519e4c-37b1-4b0e-82bc-3eb9e5cdb3e1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:52.350457 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d519e4c-37b1-4b0e-82bc-3eb9e5cdb3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:52.350729 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d519e4c-37b1-4b0e-82bc-3eb9e5cdb3e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:52.351406 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d519e4c-37b1-4b0e-82bc-3eb9e5cdb3e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:52.351713 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d519e4c-37b1-4b0e-82bc-3eb9e5cdb3e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:52.353164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d519e4c-37b1-4b0e-82bc-3eb9e5cdb3e1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:52.367904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 456/909] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:52.373662 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab55324-6265-4961-83a1-a0ecb52b04a4 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:52.454942 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160d03c-5750-4705-bc32-4510606aa6ca None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:52.455300 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160d03c-5750-4705-bc32-4510606aa6ca None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:52.455537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9160d03c-5750-4705-bc32-4510606aa6ca None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:52.457107 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 457/910] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:44:52.462928 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58c12e-00df-4927-8ab2-4bc27b27c733 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:52.463346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58c12e-00df-4927-8ab2-4bc27b27c733 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:52.463725 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc58c12e-00df-4927-8ab2-4bc27b27c733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:52.485363 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab55324-6265-4961-83a1-a0ecb52b04a4 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:52.487293 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-dc58c12e-00df-4927-8ab2-4bc27b27c733 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:52.489832 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dc58c12e-00df-4927-8ab2-4bc27b27c733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:52.526826 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d518f-ff5d-4c5e-8893-958524e281dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:52.527798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d518f-ff5d-4c5e-8893-958524e281dd None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:52.528263 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d518f-ff5d-4c5e-8893-958524e281dd None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:52.528738 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98d518f-ff5d-4c5e-8893-958524e281dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:52.536034 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d518f-ff5d-4c5e-8893-958524e281dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:52.537749 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98d518f-ff5d-4c5e-8893-958524e281dd None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:52.550229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-e98d518f-ff5d-4c5e-8893-958524e281dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:52.550229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:52.550229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:52.550229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:52.550229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:52.550229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:52.550229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:52.550229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:52.550229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:52.550229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:52.550229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:52.550229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:52.550229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:52.550229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:52.550229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:52.551280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:52.551280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:52.551280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:52.551280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:52.551280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:52.551280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:52.551280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:52.551280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:52.551280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:52.551280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:52.551280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:52.551280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:52.551280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:52.551280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:52.551280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:52.551280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:52.551280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:52.552206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:52.552206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:52.552206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:52.552206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:52.552206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:52.552206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:52.552206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:52.552206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:52.552206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 454/911] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:52.557230 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d518f-ff5d-4c5e-8893-958524e281dd None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:52.571280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 458/912] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:52 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:44:52.596325 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:52.672070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98d518f-ff5d-4c5e-8893-958524e281dd None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:52.710108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0218692-8575-4753-8884-f80f2fafee95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:52.711105 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0218692-8575-4753-8884-f80f2fafee95 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:52.711611 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0218692-8575-4753-8884-f80f2fafee95 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:52.712158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0218692-8575-4753-8884-f80f2fafee95 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:52.713529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0218692-8575-4753-8884-f80f2fafee95 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:52.714121 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0218692-8575-4753-8884-f80f2fafee95 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:52.715749 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0218692-8575-4753-8884-f80f2fafee95 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:52.729614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 455/913] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:52.735986 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58c12e-00df-4927-8ab2-4bc27b27c733 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:52.782492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:52.838185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0218692-8575-4753-8884-f80f2fafee95 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:52.845561 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc58c12e-00df-4927-8ab2-4bc27b27c733 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:52.888126 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea48608-6beb-4abe-93d3-ed1dbd73d87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:52.888774 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea48608-6beb-4abe-93d3-ed1dbd73d87f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:52.889010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea48608-6beb-4abe-93d3-ed1dbd73d87f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:52.889281 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea48608-6beb-4abe-93d3-ed1dbd73d87f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:52.890391 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea48608-6beb-4abe-93d3-ed1dbd73d87f None admin] RBAC: Adding query filter params (role.id=6a6942f029514d3ca77a5a30059bab3d, scope.project.id=ad67761fec0a430181877e216e90e7d4, user.id=9fd7a80714874e73bf64dfa392632391) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:52.890707 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea48608-6beb-4abe-93d3-ed1dbd73d87f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:52.892309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea48608-6beb-4abe-93d3-ed1dbd73d87f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:52.905725 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 459/914] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:44:52 2022] GET /identity/v3/role_assignments?user.id=9fd7a80714874e73bf64dfa392632391&scope.project.id=ad67761fec0a430181877e216e90e7d4&role.id=6a6942f029514d3ca77a5a30059bab3d => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:52.954330 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:52.966156 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0218692-8575-4753-8884-f80f2fafee95 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:53.005791 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5344af-59b9-4bfc-9d3a-5f40f7668957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:53.006441 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5344af-59b9-4bfc-9d3a-5f40f7668957 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:53.006768 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5344af-59b9-4bfc-9d3a-5f40f7668957 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:53.007047 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5344af-59b9-4bfc-9d3a-5f40f7668957 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:53.007638 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5344af-59b9-4bfc-9d3a-5f40f7668957 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:53.009022 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5344af-59b9-4bfc-9d3a-5f40f7668957 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:53.018780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-ec5344af-59b9-4bfc-9d3a-5f40f7668957 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:44:53.018780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:53.018780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:44:53.018780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:44:53.018780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:44:53.018780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:44:53.018780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:44:53.018780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:53.018780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:44:53.018780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:53.018780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:44:53.018780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:53.018780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:53.018780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:53.018780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:53.018780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:53.018780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:53.019870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:53.019870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:53.019870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:53.019870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:53.019870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:53.019870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:53.019870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:44:53.019870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:44:53.019870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:44:53.019870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:44:53.019870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:53.019870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:53.019870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:53.019870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:53.019870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:53.019870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:53.020741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:53.020741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:53.020741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:53.020741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:53.020741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:53.020741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:53.020741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:53.020741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:53.020741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:53.020741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:53.020741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:44:53.020741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:53.020741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 13 19:44:53.020741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:53.020741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 456/915] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Sep 13 19:44:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:53.026885 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea48608-6beb-4abe-93d3-ed1dbd73d87f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:53.143749 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea48608-6beb-4abe-93d3-ed1dbd73d87f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:53.145395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:53.180144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffde439-aeb2-4f0d-8c20-16281db5c8a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:53.181449 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffde439-aeb2-4f0d-8c20-16281db5c8a0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:53.181751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffde439-aeb2-4f0d-8c20-16281db5c8a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:53.182028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffde439-aeb2-4f0d-8c20-16281db5c8a0 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:53.182660 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffde439-aeb2-4f0d-8c20-16281db5c8a0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:53.182963 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffde439-aeb2-4f0d-8c20-16281db5c8a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:53.184323 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffde439-aeb2-4f0d-8c20-16281db5c8a0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:53.189785 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 460/916] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Sep 13 19:44:53 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:53.198779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5344af-59b9-4bfc-9d3a-5f40f7668957 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:53.214098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25591910-2f98-475f-a14c-61d72aa53304 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:53.214374 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25591910-2f98-475f-a14c-61d72aa53304 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:53.214645 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25591910-2f98-475f-a14c-61d72aa53304 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:53.216280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 461/917] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:44:53.222513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ae23e-c398-46ce-a35e-5b67b36015ec None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:53.222787 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ae23e-c398-46ce-a35e-5b67b36015ec None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:53.223054 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197ae23e-c398-46ce-a35e-5b67b36015ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:53.241547 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-197ae23e-c398-46ce-a35e-5b67b36015ec None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:53.242755 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-197ae23e-c398-46ce-a35e-5b67b36015ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:53.306997 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5344af-59b9-4bfc-9d3a-5f40f7668957 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:53.337476 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 462/918] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:44:53.353680 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a41b55-d6eb-4ffe-a51e-49669a6a9fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:53.354383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a41b55-d6eb-4ffe-a51e-49669a6a9fff None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:53.354656 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a41b55-d6eb-4ffe-a51e-49669a6a9fff None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:53.354941 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a41b55-d6eb-4ffe-a51e-49669a6a9fff None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:53.355540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a41b55-d6eb-4ffe-a51e-49669a6a9fff None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:53.355837 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a41b55-d6eb-4ffe-a51e-49669a6a9fff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:53.357252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a41b55-d6eb-4ffe-a51e-49669a6a9fff None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:53.362758 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 457/919] 10.222.0.59 () {56 vars in 1114 bytes} [Tue Sep 13 19:44:53 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:53.368371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ae23e-c398-46ce-a35e-5b67b36015ec None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:53.463951 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:53.470349 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197ae23e-c398-46ce-a35e-5b67b36015ec None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:53.509712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4cace-6560-4e54-993b-122e20a73c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:53.510686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4cace-6560-4e54-993b-122e20a73c91 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:53.511179 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4cace-6560-4e54-993b-122e20a73c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:53.511674 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d4cace-6560-4e54-993b-122e20a73c91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:53.512551 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4cace-6560-4e54-993b-122e20a73c91 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:53.514159 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d4cace-6560-4e54-993b-122e20a73c91 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:53.599549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 463/920] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 19:44:53 2022] POST /identity/v3/endpoints => generated 346 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:44:53.603474 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a41b55-d6eb-4ffe-a51e-49669a6a9fff None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:53.624430 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:53.719421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a41b55-d6eb-4ffe-a51e-49669a6a9fff None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:53.763793 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da852c86-6285-4c4a-b22c-d81a731e037c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:53.764832 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da852c86-6285-4c4a-b22c-d81a731e037c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:53.765312 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da852c86-6285-4c4a-b22c-d81a731e037c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:53.765842 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da852c86-6285-4c4a-b22c-d81a731e037c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:53.766642 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da852c86-6285-4c4a-b22c-d81a731e037c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:53.769034 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da852c86-6285-4c4a-b22c-d81a731e037c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:53.779055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-da852c86-6285-4c4a-b22c-d81a731e037c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:44:53.779055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:53.779055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:44:53.779055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:44:53.779055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:44:53.779055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:44:53.779055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:44:53.779055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:53.779055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:44:53.779055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:53.779055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:44:53.779055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:53.779055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:53.779055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:53.779055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:53.779055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:53.779055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:53.780177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:53.780177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:53.780177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:53.780177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:53.780177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:53.780177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:53.780177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:44:53.780177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:44:53.780177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:44:53.780177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:44:53.780177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:53.780177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:53.780177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:53.780177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:53.780177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:53.780177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:53.781051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:53.781051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:53.781051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:53.781051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:53.781051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:53.781051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:53.781051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:53.781051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:53.781051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:53.781051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:53.781051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:44:53.781051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:53.781051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:44:53.781051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:53.784095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 458/921] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Sep 13 19:44:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:53.791035 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4cace-6560-4e54-993b-122e20a73c91 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:53.906897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d4cace-6560-4e54-993b-122e20a73c91 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:53.942425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22a6a4-53f5-4706-8354-c87b773d0623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:53.943039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22a6a4-53f5-4706-8354-c87b773d0623 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:53.943318 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22a6a4-53f5-4706-8354-c87b773d0623 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:53.943592 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd22a6a4-53f5-4706-8354-c87b773d0623 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:53.944267 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22a6a4-53f5-4706-8354-c87b773d0623 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:53.944575 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22a6a4-53f5-4706-8354-c87b773d0623 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:53.945972 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd22a6a4-53f5-4706-8354-c87b773d0623 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:53.951158 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 464/922] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Sep 13 19:44:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:53.957245 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da852c86-6285-4c4a-b22c-d81a731e037c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:54.037265 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:54.059827 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da852c86-6285-4c4a-b22c-d81a731e037c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:54.095180 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217b5bb-e716-4bd1-b0db-47fe144884de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:54.095797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217b5bb-e716-4bd1-b0db-47fe144884de None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:54.096623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217b5bb-e716-4bd1-b0db-47fe144884de None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:54.096899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2217b5bb-e716-4bd1-b0db-47fe144884de None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:54.097527 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217b5bb-e716-4bd1-b0db-47fe144884de None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:54.097860 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217b5bb-e716-4bd1-b0db-47fe144884de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:54.099226 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2217b5bb-e716-4bd1-b0db-47fe144884de None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:54.104333 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 459/923] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Sep 13 19:44:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:54.110164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22a6a4-53f5-4706-8354-c87b773d0623 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:54.131163 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:54.224826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd22a6a4-53f5-4706-8354-c87b773d0623 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:54.260542 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b59b8c-31a6-47e9-bec6-09076aae5cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:54.261147 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b59b8c-31a6-47e9-bec6-09076aae5cae None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:54.261427 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b59b8c-31a6-47e9-bec6-09076aae5cae None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:54.261717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b59b8c-31a6-47e9-bec6-09076aae5cae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:54.262431 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b59b8c-31a6-47e9-bec6-09076aae5cae None admin] RBAC: Adding query filter params (interface=public, service_id=b763f13989154888a50d2bb6c0189eb4, region_id=RegionOne) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:54.262737 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b59b8c-31a6-47e9-bec6-09076aae5cae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:54.264103 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b59b8c-31a6-47e9-bec6-09076aae5cae None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:54.270407 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 465/924] 10.222.0.59 () {56 vars in 1251 bytes} [Tue Sep 13 19:44:54 2022] GET /identity/v3/endpoints?service_id=b763f13989154888a50d2bb6c0189eb4&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:54.275840 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217b5bb-e716-4bd1-b0db-47fe144884de None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:54.380392 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2217b5bb-e716-4bd1-b0db-47fe144884de None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:54.415680 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcaa5fd-c182-45be-9889-dbc9e64b7c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:54.416621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcaa5fd-c182-45be-9889-dbc9e64b7c05 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:54.417126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcaa5fd-c182-45be-9889-dbc9e64b7c05 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:54.417616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcaa5fd-c182-45be-9889-dbc9e64b7c05 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:54.418449 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcaa5fd-c182-45be-9889-dbc9e64b7c05 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:54.420014 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcaa5fd-c182-45be-9889-dbc9e64b7c05 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:54.426608 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 460/925] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Sep 13 19:44:54 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:44:54.627935 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0474a8-cd4f-481e-8596-85cfe998393a None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:54.628277 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0474a8-cd4f-481e-8596-85cfe998393a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:54.628515 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0474a8-cd4f-481e-8596-85cfe998393a None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:54.630496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 466/926] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:54.635901 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0371719-6646-4d6b-bd37-4631acf88e2c None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:54.636188 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0371719-6646-4d6b-bd37-4631acf88e2c None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:54.636466 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0371719-6646-4d6b-bd37-4631acf88e2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:54.644702 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:54.654933 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e0371719-6646-4d6b-bd37-4631acf88e2c None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:54.656127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e0371719-6646-4d6b-bd37-4631acf88e2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:54.729300 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 461/927] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:44:54.995431 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0474a8-cd4f-481e-8596-85cfe998393a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:55.087141 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:55.107919 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0474a8-cd4f-481e-8596-85cfe998393a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:55.148049 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c5c8f-ba7c-4f82-89ed-9383f271177c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:55.148614 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c5c8f-ba7c-4f82-89ed-9383f271177c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:55.148986 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c5c8f-ba7c-4f82-89ed-9383f271177c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:55.149241 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c5c8f-ba7c-4f82-89ed-9383f271177c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:55.149862 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c5c8f-ba7c-4f82-89ed-9383f271177c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:55.151311 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c5c8f-ba7c-4f82-89ed-9383f271177c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:55.161574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-c25c5c8f-ba7c-4f82-89ed-9383f271177c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:44:55.161574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:55.161574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:44:55.161574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:44:55.161574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:44:55.161574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:44:55.161574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:44:55.161574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:55.161574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:44:55.161574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:55.161574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:44:55.161574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:55.161574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:55.161574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:55.161574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:55.161574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:55.162580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:55.162580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:55.162580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:55.162580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:55.162580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:55.162580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:55.162580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:55.162580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:44:55.162580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:44:55.162580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:44:55.162580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:44:55.162580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:55.162580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:55.162580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:55.162580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:55.162580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:55.162580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:55.163507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:55.163507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:55.163507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:55.163507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:55.163507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:55.163507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:55.163507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:55.163507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:55.163507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:55.163507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:55.163507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:44:55.163507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:55.163507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 13 19:44:55.163507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:55.163507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 467/928] 10.222.0.59 () {56 vars in 1132 bytes} [Tue Sep 13 19:44:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:55.168760 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0371719-6646-4d6b-bd37-4631acf88e2c None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:55.255495 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a33e52-23a1-44f1-8905-c5252cf81ae5 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:55.256138 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a33e52-23a1-44f1-8905-c5252cf81ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:55.256637 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a33e52-23a1-44f1-8905-c5252cf81ae5 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:55.261765 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 468/929] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:44:55.263609 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c9fde-7e04-4b84-bf06-63786f627d34 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:55.264100 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c9fde-7e04-4b84-bf06-63786f627d34 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:55.264575 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c9fde-7e04-4b84-bf06-63786f627d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:55.274971 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0371719-6646-4d6b-bd37-4631acf88e2c None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:55.284293 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1a3c9fde-7e04-4b84-bf06-63786f627d34 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:55.285854 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1a3c9fde-7e04-4b84-bf06-63786f627d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:55.317577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95e5a3-f602-4266-a38e-7f7c524ea02c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:55.318358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95e5a3-f602-4266-a38e-7f7c524ea02c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:55.318652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95e5a3-f602-4266-a38e-7f7c524ea02c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:55.318924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a95e5a3-f602-4266-a38e-7f7c524ea02c None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:55.319567 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95e5a3-f602-4266-a38e-7f7c524ea02c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:55.320248 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95e5a3-f602-4266-a38e-7f7c524ea02c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:55.322092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a95e5a3-f602-4266-a38e-7f7c524ea02c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:55.333564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 462/930] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Sep 13 19:44:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:55.333564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:55.335502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95e5a3-f602-4266-a38e-7f7c524ea02c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:55.373715 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 469/931] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:44:55.439269 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a95e5a3-f602-4266-a38e-7f7c524ea02c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:55.473275 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c089e-f809-48a2-ade8-be4c206ae445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:55.473905 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c089e-f809-48a2-ade8-be4c206ae445 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:55.474180 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c089e-f809-48a2-ade8-be4c206ae445 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:55.474506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775c089e-f809-48a2-ade8-be4c206ae445 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:55.475066 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c089e-f809-48a2-ade8-be4c206ae445 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:55.475415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c089e-f809-48a2-ade8-be4c206ae445 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:55.476707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775c089e-f809-48a2-ade8-be4c206ae445 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:55.482012 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 463/932] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Sep 13 19:44:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:55.487960 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c9fde-7e04-4b84-bf06-63786f627d34 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:55.565228 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:55.595404 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3c9fde-7e04-4b84-bf06-63786f627d34 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:55.629883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720764b-bc33-4866-aeb2-04c022b2dd7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:55.630485 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720764b-bc33-4866-aeb2-04c022b2dd7b None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:55.630765 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720764b-bc33-4866-aeb2-04c022b2dd7b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:55.631033 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720764b-bc33-4866-aeb2-04c022b2dd7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:55.631705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720764b-bc33-4866-aeb2-04c022b2dd7b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:55.633057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720764b-bc33-4866-aeb2-04c022b2dd7b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:55.672525 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c089e-f809-48a2-ade8-be4c206ae445 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:55.741140 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 470/933] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 19:44:55 2022] POST /identity/v3/endpoints => generated 347 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:44:55.745140 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:55.791640 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775c089e-f809-48a2-ade8-be4c206ae445 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:55.841636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1c853-8d3e-4b3c-89b6-8a41ea2ecfc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:55.842308 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1c853-8d3e-4b3c-89b6-8a41ea2ecfc8 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:55.842699 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1c853-8d3e-4b3c-89b6-8a41ea2ecfc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:55.842885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1c853-8d3e-4b3c-89b6-8a41ea2ecfc8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:55.854790 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1c853-8d3e-4b3c-89b6-8a41ea2ecfc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:44:55.860670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-57f1c853-8d3e-4b3c-89b6-8a41ea2ecfc8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:44:55.860670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:55.860670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:55.860670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:55.860670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:55.860670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:55.860670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:55.860670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:55.860670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:55.860670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:55.860670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:55.860670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:55.860670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:44:55.860670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:44:55.860670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:44:55.860670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:44:55.861735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:44:55.861735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:44:55.861735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:44:55.861735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:44:55.861735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:55.861735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:55.861735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:55.861735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:55.861735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:55.861735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:55.861735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:55.861735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:55.861735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:55.861735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:55.861735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:55.861735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:55.862602 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:55.862602 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:55.862602 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:55.862602 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:55.862602 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:44:55.862602 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:44:55.862602 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:44:55.862602 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:44:55.862602 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:44:55.862602 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:44:55.862602 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:44:55.862602 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:55.867430 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 464/934] 10.222.0.59 () {56 vars in 1120 bytes} [Tue Sep 13 19:44:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:55.873894 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720764b-bc33-4866-aeb2-04c022b2dd7b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:55.930236 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2d522-86e5-46e6-acb6-a59ec9c94945 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:55.930572 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2d522-86e5-46e6-acb6-a59ec9c94945 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:55.930787 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db2d522-86e5-46e6-acb6-a59ec9c94945 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:55.932127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 465/935] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:55.937619 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5df2f7-b627-45c5-b421-e6b09f062acc None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:55.937929 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5df2f7-b627-45c5-b421-e6b09f062acc None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:55.938205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5df2f7-b627-45c5-b421-e6b09f062acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:55.957943 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-5d5df2f7-b627-45c5-b421-e6b09f062acc None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:55.959134 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5d5df2f7-b627-45c5-b421-e6b09f062acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:56.000989 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720764b-bc33-4866-aeb2-04c022b2dd7b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:56.044004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:56.051361 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08752483-e3d3-45c2-90dd-431c86bf7f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:56.051967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08752483-e3d3-45c2-90dd-431c86bf7f1e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:56.052249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08752483-e3d3-45c2-90dd-431c86bf7f1e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:56.052519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08752483-e3d3-45c2-90dd-431c86bf7f1e None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:56.053316 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08752483-e3d3-45c2-90dd-431c86bf7f1e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:56.053601 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 466/936] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:44:56.053773 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08752483-e3d3-45c2-90dd-431c86bf7f1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:56.059928 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08752483-e3d3-45c2-90dd-431c86bf7f1e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:56.066511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 471/937] 10.222.0.59 () {56 vars in 1115 bytes} [Tue Sep 13 19:44:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:56.074969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5df2f7-b627-45c5-b421-e6b09f062acc None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:56.129434 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:56.183115 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5df2f7-b627-45c5-b421-e6b09f062acc None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:56.219979 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251cd56-c019-44e1-9f2d-98ebf1190986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:56.221045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251cd56-c019-44e1-9f2d-98ebf1190986 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:56.221527 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251cd56-c019-44e1-9f2d-98ebf1190986 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:56.222045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2251cd56-c019-44e1-9f2d-98ebf1190986 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:56.232713 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251cd56-c019-44e1-9f2d-98ebf1190986 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:56.234434 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2251cd56-c019-44e1-9f2d-98ebf1190986 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:56.250444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-2251cd56-c019-44e1-9f2d-98ebf1190986 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:56.250444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:56.250444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:56.250444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:56.250444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:56.250444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:56.250444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:56.250444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:56.250444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:56.250444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:56.250444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:56.250444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:56.250444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:56.250444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:56.250444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:56.250444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:56.251509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:56.251509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:56.251509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:56.251509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:56.251509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:56.251509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:56.251509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:56.251509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:56.251509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:56.251509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:56.251509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:56.251509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:56.251509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:56.251509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:56.251509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:56.251509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:56.251509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:56.253052 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:56.253052 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:56.253052 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:56.259901 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 467/938] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:56.261495 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08752483-e3d3-45c2-90dd-431c86bf7f1e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:56.351150 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251cd56-c019-44e1-9f2d-98ebf1190986 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:56.366204 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08752483-e3d3-45c2-90dd-431c86bf7f1e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:56.401341 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f3e80-162b-486a-b23a-5012488b7a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:56.401975 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f3e80-162b-486a-b23a-5012488b7a13 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:56.402329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f3e80-162b-486a-b23a-5012488b7a13 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:56.402514 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639f3e80-162b-486a-b23a-5012488b7a13 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:56.403253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f3e80-162b-486a-b23a-5012488b7a13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:56.403578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f3e80-162b-486a-b23a-5012488b7a13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:56.404950 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639f3e80-162b-486a-b23a-5012488b7a13 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:56.420934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 472/939] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:56.422683 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f3e80-162b-486a-b23a-5012488b7a13 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:56.466349 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:56.469622 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2251cd56-c019-44e1-9f2d-98ebf1190986 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:56.495673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:56.510002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1355aff-20a8-4eab-ad6d-fc636a706f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:56.510677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1355aff-20a8-4eab-ad6d-fc636a706f65 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:56.511015 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1355aff-20a8-4eab-ad6d-fc636a706f65 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:56.511344 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1355aff-20a8-4eab-ad6d-fc636a706f65 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:56.512360 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1355aff-20a8-4eab-ad6d-fc636a706f65 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:56.514695 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1355aff-20a8-4eab-ad6d-fc636a706f65 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:56.517604 dv-cinder-828807-6-smb devstack@keystone.service[81555]: WARNING keystone.server.flask.common [None req-e1355aff-20a8-4eab-ad6d-fc636a706f65 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 13 19:44:56.560021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639f3e80-162b-486a-b23a-5012488b7a13 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:56.569014 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.sql.core [None req-e1355aff-20a8-4eab-ad6d-fc636a706f65 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 19:44:56.569014 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 19:44:56.569014 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [parameters: {'id': 'eefd05c4bea44329936c53e09e65085b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 19:44:56.569014 dv-cinder-828807-6-smb devstack@keystone.service[81555]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81555) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 19:44:56.590409 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-e1355aff-20a8-4eab-ad6d-fc636a706f65 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eefd05c4bea44329936c53e09e65085b.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eefd05c4bea44329936c53e09e65085b. Sep 13 19:44:56.590409 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:56.590409 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 19:44:56.590409 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 19:44:56.590409 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 19:44:56.590409 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 19:44:56.590409 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 19:44:56.590409 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 19:44:56.590409 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 19:44:56.590409 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application conn.query(q) Sep 13 19:44:56.590409 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 19:44:56.590409 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 19:44:56.590409 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 19:44:56.591487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application result.read() Sep 13 19:44:56.591487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 19:44:56.591487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 19:44:56.591487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 19:44:56.591487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 19:44:56.591487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 19:44:56.591487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 19:44:56.591487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 19:44:56.591487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 19:44:56.591487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 19:44:56.591487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:56.591487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 19:44:56.591487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:56.591487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:56.591487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 19:44:56.591487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 19:44:56.591487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 13 19:44:56.591487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 13 19:44:56.592721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 19:44:56.592721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application next(self.gen) Sep 13 19:44:56.592721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 19:44:56.592721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application yield resource Sep 13 19:44:56.592721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 19:44:56.592721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application next(self.gen) Sep 13 19:44:56.592721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 19:44:56.592721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 19:44:56.592721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 19:44:56.592721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 19:44:56.592721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 19:44:56.592721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise self.value Sep 13 19:44:56.592721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 19:44:56.592721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 19:44:56.592721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 19:44:56.592721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application session.commit() Sep 13 19:44:56.592721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 19:44:56.593907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 19:44:56.593907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 19:44:56.593907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 19:44:56.593907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 19:44:56.593907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self.session.flush() Sep 13 19:44:56.593907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 19:44:56.593907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 19:44:56.593907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 19:44:56.593907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 19:44:56.593907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 19:44:56.593907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application compat.raise_( Sep 13 19:44:56.593907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 19:44:56.593907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception Sep 13 19:44:56.593907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 19:44:56.593907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 19:44:56.593907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 19:44:56.593907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 19:44:56.595200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 19:44:56.595200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 19:44:56.595200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 19:44:56.595200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 19:44:56.595200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 13 19:44:56.595200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 13 19:44:56.595200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 19:44:56.595200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 19:44:56.595200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 19:44:56.595200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 19:44:56.595200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 19:44:56.595200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 19:44:56.595200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 19:44:56.595200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 19:44:56.595200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 19:44:56.596823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 19:44:56.596823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 19:44:56.596823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception Sep 13 19:44:56.596823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 19:44:56.596823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 19:44:56.596823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 19:44:56.596823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 19:44:56.596823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 19:44:56.596823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 19:44:56.596823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 19:44:56.596823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application conn.query(q) Sep 13 19:44:56.596823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 19:44:56.596823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 19:44:56.596823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 19:44:56.596823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application result.read() Sep 13 19:44:56.596823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 19:44:56.596823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 19:44:56.598021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 19:44:56.598021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 19:44:56.598021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 19:44:56.598021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 19:44:56.598021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 19:44:56.598021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 19:44:56.598021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 13 19:44:56.598021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 13 19:44:56.598021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [parameters: {'id': 'eefd05c4bea44329936c53e09e65085b', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 13 19:44:56.598021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 19:44:56.598021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:56.598021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:44:56.598021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:56.598021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:56.598021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 13 19:44:56.599143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 13 19:44:56.599143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 19:44:56.599143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 19:44:56.599143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 13 19:44:56.599143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:56.599143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:44:56.599143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:56.599143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:56.599143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:56.599143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:56.599143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:56.599143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:56.599143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:56.599143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:56.599143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:56.599143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:56.599143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:56.601108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:56.601108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 13 19:44:56.601108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 13 19:44:56.601108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:56.601108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:56.601108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 13 19:44:56.601108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 13 19:44:56.601108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id eefd05c4bea44329936c53e09e65085b. Sep 13 19:44:56.601108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:56.605646 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 468/940] 10.222.0.59 () {60 vars in 1140 bytes} [Tue Sep 13 19:44:56 2022] POST /identity/v3/projects => generated 262 bytes in 254 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:56.606652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1355aff-20a8-4eab-ad6d-fc636a706f65 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:56.619225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de125f6-0486-49cc-a51a-549349c48341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:56.620347 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de125f6-0486-49cc-a51a-549349c48341 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:56.620898 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de125f6-0486-49cc-a51a-549349c48341 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:56.621386 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de125f6-0486-49cc-a51a-549349c48341 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:56.631410 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de125f6-0486-49cc-a51a-549349c48341 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:56.632862 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de125f6-0486-49cc-a51a-549349c48341 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:56.644475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-5de125f6-0486-49cc-a51a-549349c48341 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:44:56.644475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:56.644475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:56.644475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:56.644475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:56.644475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:56.644475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:56.644475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:56.644475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:56.644475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:56.644475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:56.644475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:56.644475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:44:56.644475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:44:56.644475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:44:56.644475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:44:56.645465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:56.645465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:56.645465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:56.645465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:56.645465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:56.645465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:56.645465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:56.645465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:56.645465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:56.645465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:56.645465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:56.645465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:56.645465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:56.645465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:56.645465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:56.645465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:56.645465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:56.645465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:56.646489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:56.646489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:56.646489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:44:56.646489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:44:56.646489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:44:56.646489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:44:56.646489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:44:56.646489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:44:56.646489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:44:56.646489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:56.646489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 473/941] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Sep 13 19:44:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:56.647113 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2536dda-1d30-4ed0-a570-3eafca8ccaa7 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:56.647113 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2536dda-1d30-4ed0-a570-3eafca8ccaa7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:56.647765 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2536dda-1d30-4ed0-a570-3eafca8ccaa7 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:56.649394 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 474/942] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:56.654006 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2536dda-1d30-4ed0-a570-3eafca8ccaa7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:56.725223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1355aff-20a8-4eab-ad6d-fc636a706f65 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:56.761504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2536dda-1d30-4ed0-a570-3eafca8ccaa7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:56.764157 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9a5a5-9500-4399-904f-8ad845e3121f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:56.764798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9a5a5-9500-4399-904f-8ad845e3121f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:56.765075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9a5a5-9500-4399-904f-8ad845e3121f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:56.765344 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9a5a5-9500-4399-904f-8ad845e3121f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:56.772474 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9a5a5-9500-4399-904f-8ad845e3121f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:56.774145 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9a5a5-9500-4399-904f-8ad845e3121f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:56.774445 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:56.787198 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-7ed9a5a5-9500-4399-904f-8ad845e3121f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:56.787198 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:56.787198 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:56.787198 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:56.787198 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:56.787198 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:56.787198 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:56.787198 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:56.787198 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:56.787198 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:56.787198 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:56.787198 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:56.787198 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:56.787198 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:56.787198 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:56.790535 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:56.790535 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:56.790535 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:56.790535 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:56.790535 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:56.790535 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:56.790535 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:56.790535 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:56.790535 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:56.790535 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:56.790535 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:56.790535 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:56.790535 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:56.790535 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:56.790535 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:56.790535 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:56.790535 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:56.791455 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:56.791455 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:56.791455 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:56.791455 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:56.791455 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:56.791455 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:56.791455 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:56.791455 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:56.791455 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 469/943] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:56.791455 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca83e0-fce9-4686-9449-3c19d68f596d None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:56.791455 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca83e0-fce9-4686-9449-3c19d68f596d None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:56.792082 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ca83e0-fce9-4686-9449-3c19d68f596d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:56.802965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e9bcd-e665-4308-a811-975b4b7b8a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:56.803572 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e9bcd-e665-4308-a811-975b4b7b8a9b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:56.803845 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e9bcd-e665-4308-a811-975b4b7b8a9b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:56.804118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56e9bcd-e665-4308-a811-975b4b7b8a9b None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:56.804932 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e9bcd-e665-4308-a811-975b4b7b8a9b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:56.805235 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e9bcd-e665-4308-a811-975b4b7b8a9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:56.806748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56e9bcd-e665-4308-a811-975b4b7b8a9b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:56.809603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-19ca83e0-fce9-4686-9449-3c19d68f596d None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:56.811143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-19ca83e0-fce9-4686-9449-3c19d68f596d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:56.823299 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:56.829093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 475/944] 10.222.0.59 () {56 vars in 1149 bytes} [Tue Sep 13 19:44:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:56.829093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e9bcd-e665-4308-a811-975b4b7b8a9b None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:56.893054 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 470/945] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:44:56.894086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca83e0-fce9-4686-9449-3c19d68f596d None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:56.951793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56e9bcd-e665-4308-a811-975b4b7b8a9b None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:56.997629 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504728f3-a823-4280-be92-4d14583ee5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:56.998578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504728f3-a823-4280-be92-4d14583ee5c9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:56.999552 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504728f3-a823-4280-be92-4d14583ee5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:56.999979 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504728f3-a823-4280-be92-4d14583ee5c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:57.000792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504728f3-a823-4280-be92-4d14583ee5c9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:57.001788 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504728f3-a823-4280-be92-4d14583ee5c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:57.004824 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504728f3-a823-4280-be92-4d14583ee5c9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:57.026106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ca83e0-fce9-4686-9449-3c19d68f596d None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:57.035155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 476/946] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Sep 13 19:44:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:57.064715 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de9327-9264-4a2d-bcc4-57bad6386e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:57.065379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de9327-9264-4a2d-bcc4-57bad6386e5e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:57.065657 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de9327-9264-4a2d-bcc4-57bad6386e5e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:57.065967 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36de9327-9264-4a2d-bcc4-57bad6386e5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:57.077880 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de9327-9264-4a2d-bcc4-57bad6386e5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:57.079368 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36de9327-9264-4a2d-bcc4-57bad6386e5e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:57.088416 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:57.097452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-36de9327-9264-4a2d-bcc4-57bad6386e5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:57.097452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:57.097452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:57.097452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:57.097452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:57.097452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:57.097452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:57.097452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:57.097452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:57.097452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:57.097452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:57.097452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:57.097452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:44:57.097452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:44:57.097452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:44:57.097452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:44:57.098778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:57.098778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:57.098778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:57.098778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:57.098778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:57.098778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:57.098778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:57.098778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:57.098778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:57.098778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:57.098778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:57.098778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:57.098778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:57.098778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:57.098778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:57.098778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:57.098778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:44:57.099899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:44:57.099899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:44:57.099899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:57.099899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 471/947] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:44:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:57.106065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504728f3-a823-4280-be92-4d14583ee5c9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:57.143923 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:57.159489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de9327-9264-4a2d-bcc4-57bad6386e5e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:57.224675 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504728f3-a823-4280-be92-4d14583ee5c9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:57.271717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97880bc3-b204-4c49-8a94-7475854d718a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:57.272324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97880bc3-b204-4c49-8a94-7475854d718a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:57.272601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97880bc3-b204-4c49-8a94-7475854d718a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:57.272866 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97880bc3-b204-4c49-8a94-7475854d718a None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:57.273505 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97880bc3-b204-4c49-8a94-7475854d718a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:57.279444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97880bc3-b204-4c49-8a94-7475854d718a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:57.279444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97880bc3-b204-4c49-8a94-7475854d718a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:57.290503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 477/948] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:44:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:57.296971 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97880bc3-b204-4c49-8a94-7475854d718a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:57.310715 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36de9327-9264-4a2d-bcc4-57bad6386e5e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:57.353651 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0090b98-8fff-4695-bc9f-14efe3bd9f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:57.354492 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0090b98-8fff-4695-bc9f-14efe3bd9f53 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:57.355615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0090b98-8fff-4695-bc9f-14efe3bd9f53 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:57.355615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0090b98-8fff-4695-bc9f-14efe3bd9f53 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:57.356560 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0090b98-8fff-4695-bc9f-14efe3bd9f53 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:57.358478 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0090b98-8fff-4695-bc9f-14efe3bd9f53 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:57.369913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-e0090b98-8fff-4695-bc9f-14efe3bd9f53 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:44:57.369913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:57.369913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:44:57.369913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:44:57.369913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:44:57.369913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:44:57.369913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:44:57.369913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:57.369913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:44:57.369913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:57.369913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:44:57.369913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:57.369913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:57.369913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:57.369913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:57.369913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:57.369913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:57.370955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:57.370955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:57.370955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:57.370955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:57.370955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:57.370955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:57.370955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:44:57.370955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:44:57.370955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:44:57.370955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:44:57.370955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:57.370955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:57.370955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:57.370955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:57.370955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:57.370955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:57.371822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:57.371822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:57.371822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:57.371822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:57.371822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:57.371822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:57.371822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:57.371822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:57.371822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:57.371822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:57.371822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:44:57.371822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:57.371822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:44:57.371822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:57.372579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 472/949] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Sep 13 19:44:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:44:57.380123 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0090b98-8fff-4695-bc9f-14efe3bd9f53 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:57.405039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:57.418298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97880bc3-b204-4c49-8a94-7475854d718a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:57.451780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:57.457672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03587c-9b2f-4d78-8c81-154f5b3827bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:57.458391 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03587c-9b2f-4d78-8c81-154f5b3827bf None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:57.458670 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03587c-9b2f-4d78-8c81-154f5b3827bf None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:57.459045 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03587c-9b2f-4d78-8c81-154f5b3827bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:57.466145 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03587c-9b2f-4d78-8c81-154f5b3827bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:57.467580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03587c-9b2f-4d78-8c81-154f5b3827bf None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:57.481355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-dd03587c-9b2f-4d78-8c81-154f5b3827bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:57.481355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:57.481355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:57.481355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:57.481355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:57.481355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:57.481355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:57.481355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:57.481355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:57.481355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:57.481355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:57.481355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:57.481355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:44:57.481355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:44:57.481355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:44:57.482598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:44:57.482598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:57.482598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:57.482598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:57.482598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:57.482598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:57.482598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:57.482598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:57.482598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:57.482598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:57.482598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:57.482598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:57.482598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:57.482598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:57.482598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:57.482598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:57.482598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:57.484038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:44:57.484038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:44:57.484038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:44:57.484038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:44:57.484038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:44:57.484038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:44:57.484038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:44:57.484038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:57.484038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 478/950] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:57.488359 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03587c-9b2f-4d78-8c81-154f5b3827bf None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:57.506011 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0090b98-8fff-4695-bc9f-14efe3bd9f53 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:57.543764 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab924bd-63b5-45f4-a68c-771cb768a293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:57.544522 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab924bd-63b5-45f4-a68c-771cb768a293 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:57.544907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab924bd-63b5-45f4-a68c-771cb768a293 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:57.545282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab924bd-63b5-45f4-a68c-771cb768a293 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:57.546050 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab924bd-63b5-45f4-a68c-771cb768a293 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:57.546545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab924bd-63b5-45f4-a68c-771cb768a293 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:57.548141 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab924bd-63b5-45f4-a68c-771cb768a293 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:57.561483 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 473/951] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Sep 13 19:44:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:57.562524 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab924bd-63b5-45f4-a68c-771cb768a293 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:57.600448 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03587c-9b2f-4d78-8c81-154f5b3827bf None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:57.638432 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34445ae4-5e78-437e-9b14-ebd7dfbb438e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:57.639035 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34445ae4-5e78-437e-9b14-ebd7dfbb438e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:57.639417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34445ae4-5e78-437e-9b14-ebd7dfbb438e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:57.639722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34445ae4-5e78-437e-9b14-ebd7dfbb438e None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:57.640503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34445ae4-5e78-437e-9b14-ebd7dfbb438e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:57.640811 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34445ae4-5e78-437e-9b14-ebd7dfbb438e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:57.642265 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34445ae4-5e78-437e-9b14-ebd7dfbb438e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:57.659764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 479/952] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:44:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:44:57.660696 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34445ae4-5e78-437e-9b14-ebd7dfbb438e None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:57.672174 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab924bd-63b5-45f4-a68c-771cb768a293 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:57.674780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:57.703365 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:57.718278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254d988-3175-4c84-ab0e-3741bd45388e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:57.719022 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254d988-3175-4c84-ab0e-3741bd45388e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:57.719294 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254d988-3175-4c84-ab0e-3741bd45388e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:57.719566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254d988-3175-4c84-ab0e-3741bd45388e None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:57.720197 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254d988-3175-4c84-ab0e-3741bd45388e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:57.720527 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254d988-3175-4c84-ab0e-3741bd45388e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:57.722638 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254d988-3175-4c84-ab0e-3741bd45388e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:57.729733 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 474/953] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Sep 13 19:44:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:57.734929 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254d988-3175-4c84-ab0e-3741bd45388e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:57.781500 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34445ae4-5e78-437e-9b14-ebd7dfbb438e None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:57.818405 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413f25b-69ad-40a9-98c8-3d0ae1ae96c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:57.819104 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413f25b-69ad-40a9-98c8-3d0ae1ae96c9 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:57.819391 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413f25b-69ad-40a9-98c8-3d0ae1ae96c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:57.819663 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413f25b-69ad-40a9-98c8-3d0ae1ae96c9 None admin] PATH_INFO: `/v3/projects/ad67761fec0a430181877e216e90e7d4/users/9fd7a80714874e73bf64dfa392632391/roles/6a6942f029514d3ca77a5a30059bab3d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:57.822105 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413f25b-69ad-40a9-98c8-3d0ae1ae96c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad67761fec0a430181877e216e90e7d4, user_id=9fd7a80714874e73bf64dfa392632391, role_id=6a6942f029514d3ca77a5a30059bab3d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:57.823549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413f25b-69ad-40a9-98c8-3d0ae1ae96c9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:57.860779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254d988-3175-4c84-ab0e-3741bd45388e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:57.903370 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 480/954] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Sep 13 19:44:57 2022] PUT /identity/v3/projects/ad67761fec0a430181877e216e90e7d4/users/9fd7a80714874e73bf64dfa392632391/roles/6a6942f029514d3ca77a5a30059bab3d => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:44:57.910127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a1abaf-7f74-468a-8293-a3b967b82835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:57.910876 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1abaf-7f74-468a-8293-a3b967b82835 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:57.911161 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1abaf-7f74-468a-8293-a3b967b82835 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:57.911434 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a1abaf-7f74-468a-8293-a3b967b82835 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:57.912132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1abaf-7f74-468a-8293-a3b967b82835 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:57.913543 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a1abaf-7f74-468a-8293-a3b967b82835 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:58.005562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 475/955] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 19:44:57 2022] POST /identity/v3/endpoints => generated 349 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:44:58.047515 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68cfc1-daff-40f4-b3b8-c7a5801f0ea4 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:58.048105 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68cfc1-daff-40f4-b3b8-c7a5801f0ea4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:58.048105 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb68cfc1-daff-40f4-b3b8-c7a5801f0ea4 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:58.050365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 481/956] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:58.056305 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ef62b-cf44-4dd0-a49c-f6b8eeff3e0e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:58.056689 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ef62b-cf44-4dd0-a49c-f6b8eeff3e0e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:58.056884 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022ef62b-cf44-4dd0-a49c-f6b8eeff3e0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:58.077570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-022ef62b-cf44-4dd0-a49c-f6b8eeff3e0e None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:58.078764 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-022ef62b-cf44-4dd0-a49c-f6b8eeff3e0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:58.133574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:58.166250 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 476/957] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:44:58.435110 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68cfc1-daff-40f4-b3b8-c7a5801f0ea4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:58.510657 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:58.545203 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb68cfc1-daff-40f4-b3b8-c7a5801f0ea4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:58.581296 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c7036-b3a6-4550-bb35-1e7338e7cd1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:58.582356 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c7036-b3a6-4550-bb35-1e7338e7cd1f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:58.582881 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c7036-b3a6-4550-bb35-1e7338e7cd1f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:58.583822 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08c7036-b3a6-4550-bb35-1e7338e7cd1f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:58.584611 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c7036-b3a6-4550-bb35-1e7338e7cd1f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:58.586226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08c7036-b3a6-4550-bb35-1e7338e7cd1f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:58.595253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-e08c7036-b3a6-4550-bb35-1e7338e7cd1f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:44:58.595253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:58.595253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:44:58.595253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:44:58.595253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:44:58.595253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:44:58.595253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:44:58.595253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:58.595253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:44:58.595253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:58.595253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:44:58.595253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:58.595253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:58.595253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:58.595253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:58.595253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:58.595253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:58.596920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:58.596920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:58.596920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:58.596920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:58.596920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:58.596920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:58.596920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:44:58.596920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:44:58.596920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:44:58.596920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:44:58.596920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:58.596920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:58.596920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:44:58.596920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:44:58.596920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:44:58.596920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:44:58.597847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:44:58.597847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:44:58.597847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:44:58.597847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:44:58.597847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:44:58.597847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:44:58.597847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:44:58.597847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:44:58.597847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:44:58.597847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:44:58.597847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:44:58.597847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:44:58.597847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:44:58.597847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:44:58.600737 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 482/958] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:44:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:58.606831 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ef62b-cf44-4dd0-a49c-f6b8eeff3e0e None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:58.706940 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022ef62b-cf44-4dd0-a49c-f6b8eeff3e0e None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:58.746902 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e088b987-8c12-4c73-8760-cfccf4f1fe47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:58.747513 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088b987-8c12-4c73-8760-cfccf4f1fe47 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:58.747797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088b987-8c12-4c73-8760-cfccf4f1fe47 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:58.748064 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e088b987-8c12-4c73-8760-cfccf4f1fe47 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:58.748693 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088b987-8c12-4c73-8760-cfccf4f1fe47 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:58.748984 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088b987-8c12-4c73-8760-cfccf4f1fe47 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:58.750379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e088b987-8c12-4c73-8760-cfccf4f1fe47 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:58.756459 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 477/959] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Sep 13 19:44:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:58.762030 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c7036-b3a6-4550-bb35-1e7338e7cd1f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:58.866470 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08c7036-b3a6-4550-bb35-1e7338e7cd1f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:58.903230 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2774e1-a35f-47b5-83f2-8aadb364c157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:58.903838 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2774e1-a35f-47b5-83f2-8aadb364c157 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:58.904117 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2774e1-a35f-47b5-83f2-8aadb364c157 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:58.904392 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2774e1-a35f-47b5-83f2-8aadb364c157 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:58.905022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2774e1-a35f-47b5-83f2-8aadb364c157 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:44:58.905323 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2774e1-a35f-47b5-83f2-8aadb364c157 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:58.906783 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2774e1-a35f-47b5-83f2-8aadb364c157 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:58.908154 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:58.916351 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 483/960] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Sep 13 19:44:58 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:44:59.412610 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5faab-8588-4795-837a-805e83a3f878 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:59.412949 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5faab-8588-4795-837a-805e83a3f878 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:59.413274 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf5faab-8588-4795-837a-805e83a3f878 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:59.414948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 478/961] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:44:59.420219 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79652a-c90b-42be-a166-edc1875c54da None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:59.420659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79652a-c90b-42be-a166-edc1875c54da None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:59.420847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a79652a-c90b-42be-a166-edc1875c54da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:59.440055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1a79652a-c90b-42be-a166-edc1875c54da None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:44:59.441237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1a79652a-c90b-42be-a166-edc1875c54da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:44:59.513262 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 484/962] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:44:59 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:44:59.780930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5faab-8588-4795-837a-805e83a3f878 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:44:59.820868 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:44:59.889780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf5faab-8588-4795-837a-805e83a3f878 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:44:59.925847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de736755-3b15-4bb1-8475-6113a889e224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:44:59.926457 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de736755-3b15-4bb1-8475-6113a889e224 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:44:59.926736 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de736755-3b15-4bb1-8475-6113a889e224 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:44:59.927064 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de736755-3b15-4bb1-8475-6113a889e224 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:44:59.927715 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de736755-3b15-4bb1-8475-6113a889e224 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:44:59.929131 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de736755-3b15-4bb1-8475-6113a889e224 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:44:59.973680 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.sql.core [None req-de736755-3b15-4bb1-8475-6113a889e224 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 19:44:59.973680 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 19:44:59.973680 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [parameters: {'user_id': 'c572bd87ea9c4fbe8d0a13e088c8a08e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 19:44:59.973680 dv-cinder-828807-6-smb devstack@keystone.service[81555]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81555) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 13 19:44:59.980841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-de736755-3b15-4bb1-8475-6113a889e224 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 19:44:59.980841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:59.980841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 19:44:59.980841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 19:44:59.980841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 19:44:59.980841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 19:44:59.980841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 19:44:59.980841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 19:44:59.980841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 19:44:59.980841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application conn.query(q) Sep 13 19:44:59.980841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 19:44:59.980841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 19:44:59.980841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 19:44:59.980841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application result.read() Sep 13 19:44:59.980841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 19:44:59.983652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 19:44:59.983652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 19:44:59.983652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 19:44:59.983652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 19:44:59.983652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 19:44:59.983652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 19:44:59.983652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 19:44:59.983652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 19:44:59.983652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:59.983652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 13 19:44:59.983652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:59.983652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:59.983652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 13 19:44:59.983652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 13 19:44:59.983652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 13 19:44:59.983652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 13 19:44:59.983652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 19:44:59.983652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application next(self.gen) Sep 13 19:44:59.984679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 13 19:44:59.984679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application yield resource Sep 13 19:44:59.984679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 13 19:44:59.984679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application next(self.gen) Sep 13 19:44:59.984679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 13 19:44:59.984679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self.session.rollback() Sep 13 19:44:59.984679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 13 19:44:59.984679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self.force_reraise() Sep 13 19:44:59.984679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 13 19:44:59.984679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise self.value Sep 13 19:44:59.984679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 13 19:44:59.984679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 13 19:44:59.984679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 13 19:44:59.984679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application session.commit() Sep 13 19:44:59.984679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 13 19:44:59.984679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 13 19:44:59.984679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 13 19:44:59.985587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._prepare_impl() Sep 13 19:44:59.985587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 13 19:44:59.985587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self.session.flush() Sep 13 19:44:59.985587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 13 19:44:59.985587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._flush(objects) Sep 13 19:44:59.985587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 13 19:44:59.985587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 13 19:44:59.985587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 13 19:44:59.985587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application compat.raise_( Sep 13 19:44:59.985587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 19:44:59.985587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception Sep 13 19:44:59.985587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 13 19:44:59.985587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application flush_context.execute() Sep 13 19:44:59.985587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 13 19:44:59.985587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rec.execute(self) Sep 13 19:44:59.985587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 13 19:44:59.985587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 13 19:44:59.986571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 13 19:44:59.986571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 13 19:44:59.986571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 13 19:44:59.986571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 13 19:44:59.986571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 13 19:44:59.986571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 13 19:44:59.986571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 13 19:44:59.986571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 13 19:44:59.986571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 13 19:44:59.986571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 13 19:44:59.986571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 13 19:44:59.986571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 13 19:44:59.986571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 13 19:44:59.986571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 13 19:44:59.986571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 13 19:44:59.986571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception Sep 13 19:44:59.987477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 13 19:44:59.987477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 13 19:44:59.987477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 13 19:44:59.987477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 13 19:44:59.987477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 13 19:44:59.987477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application result = self._query(query) Sep 13 19:44:59.987477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 13 19:44:59.987477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application conn.query(q) Sep 13 19:44:59.987477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 13 19:44:59.987477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 13 19:44:59.987477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 13 19:44:59.987477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application result.read() Sep 13 19:44:59.987477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 13 19:44:59.987477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 13 19:44:59.987477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 13 19:44:59.987477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 13 19:44:59.990145 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 13 19:44:59.990145 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 13 19:44:59.990145 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 13 19:44:59.990145 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 13 19:44:59.990145 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 13 19:44:59.990145 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 13 19:44:59.990145 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c572bd87ea9c4fbe8d0a13e088c8a08e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 13 19:44:59.990145 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 13 19:44:59.990145 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:59.990145 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:44:59.990145 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:59.990145 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:44:59.990145 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:44:59.990145 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:44:59.990145 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:44:59.991255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:44:59.991255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:44:59.991255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:44:59.991255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:44:59.991255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:44:59.991255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:44:59.991255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:44:59.991255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 13 19:44:59.991255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 13 19:44:59.991255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:44:59.991255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:44:59.991255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:44:59.991255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:59.991255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:44:59.991255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:44:59.991255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 13 19:44:59.991255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 13 19:44:59.992439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 13 19:44:59.992439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 13 19:44:59.992439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 13 19:44:59.992439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 13 19:44:59.992439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 13 19:44:59.992439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:44:59.992439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 479/963] 10.222.0.59 () {60 vars in 1131 bytes} [Tue Sep 13 19:44:59 2022] POST /identity/v3/users => generated 160 bytes in 202 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:44:59.992940 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79652a-c90b-42be-a166-edc1875c54da None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:00.125805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a79652a-c90b-42be-a166-edc1875c54da None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:00.160713 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:00.177398 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d69dd8-8b0c-4e2d-b264-93a4a3aefd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:00.178082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d69dd8-8b0c-4e2d-b264-93a4a3aefd4f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:00.178371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d69dd8-8b0c-4e2d-b264-93a4a3aefd4f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:00.178645 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d69dd8-8b0c-4e2d-b264-93a4a3aefd4f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:00.192534 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d69dd8-8b0c-4e2d-b264-93a4a3aefd4f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:00.194040 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d69dd8-8b0c-4e2d-b264-93a4a3aefd4f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:00.208057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-77d69dd8-8b0c-4e2d-b264-93a4a3aefd4f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:45:00.208057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:00.208057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:00.208057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:00.208057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:00.208057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:00.208057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:00.208057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:00.208057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:00.208057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:00.208057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:00.208057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:00.208057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:45:00.208057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:45:00.208057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:45:00.208057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:45:00.209178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:00.209178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:00.209178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:00.209178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:00.209178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:00.209178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:00.209178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:00.209178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:00.209178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:00.209178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:00.209178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:00.209178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:00.209178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:00.209178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:00.209178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:00.209178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:00.209178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:00.209178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:00.210173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:00.210173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:00.210173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:45:00.210173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:45:00.210173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:45:00.210173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:45:00.210173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:45:00.210173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:45:00.210173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 13 19:45:00.210173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:45:00.210173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 485/964] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:44:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:00.216432 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de736755-3b15-4bb1-8475-6113a889e224 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:00.273718 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919e897-d424-419f-bde1-94e091a1f8b8 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:00.273718 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919e897-d424-419f-bde1-94e091a1f8b8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:00.273718 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919e897-d424-419f-bde1-94e091a1f8b8 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:00.273718 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 486/965] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:00.283024 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986b119-c972-42b6-a21e-79eba125d6ff None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:00.289795 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986b119-c972-42b6-a21e-79eba125d6ff None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:00.289795 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986b119-c972-42b6-a21e-79eba125d6ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:00.318943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6986b119-c972-42b6-a21e-79eba125d6ff None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:00.320430 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6986b119-c972-42b6-a21e-79eba125d6ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:00.334050 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:00.339945 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de736755-3b15-4bb1-8475-6113a889e224 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:00.384987 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56596560-3b71-4463-bb5a-bfb3f9c65086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:00.386194 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56596560-3b71-4463-bb5a-bfb3f9c65086 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:00.386672 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56596560-3b71-4463-bb5a-bfb3f9c65086 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:00.387523 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56596560-3b71-4463-bb5a-bfb3f9c65086 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:00.388669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56596560-3b71-4463-bb5a-bfb3f9c65086 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:00.389160 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56596560-3b71-4463-bb5a-bfb3f9c65086 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:00.391072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56596560-3b71-4463-bb5a-bfb3f9c65086 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:00.398445 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 487/966] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:00.399947 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03647091-57fb-4ed8-aa39-75aa3e9f11cd None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:00.400409 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03647091-57fb-4ed8-aa39-75aa3e9f11cd None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:00.400862 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03647091-57fb-4ed8-aa39-75aa3e9f11cd None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:00.406675 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 488/967] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:00.408066 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b736e1-e6d7-4649-8dcb-22e89d374e8c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:00.408523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b736e1-e6d7-4649-8dcb-22e89d374e8c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:00.408802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b736e1-e6d7-4649-8dcb-22e89d374e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:00.435340 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c2b736e1-e6d7-4649-8dcb-22e89d374e8c None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:00.436531 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c2b736e1-e6d7-4649-8dcb-22e89d374e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:00.445720 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 480/968] 10.222.0.59 () {56 vars in 1101 bytes} [Tue Sep 13 19:45:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:00.533029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 489/969] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:00.672456 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56596560-3b71-4463-bb5a-bfb3f9c65086 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:00.788083 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56596560-3b71-4463-bb5a-bfb3f9c65086 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:00.823942 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfdabb-c86d-4eab-b155-52028b21b7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:00.824577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfdabb-c86d-4eab-b155-52028b21b7bc None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:00.824858 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfdabb-c86d-4eab-b155-52028b21b7bc None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:00.825131 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfdabb-c86d-4eab-b155-52028b21b7bc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:00.835830 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23bfdabb-c86d-4eab-b155-52028b21b7bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:00.840958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-23bfdabb-c86d-4eab-b155-52028b21b7bc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:45:00.840958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:00.840958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:00.840958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:00.840958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:00.840958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:00.840958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:00.840958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:00.840958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:00.840958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:00.840958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:00.840958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:00.840958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:00.840958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:00.840958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:00.840958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:00.841921 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:00.841921 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:00.841921 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:00.841921 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:00.841921 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:00.841921 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:00.841921 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:00.841921 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:00.841921 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:00.841921 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:00.841921 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:00.841921 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:00.841921 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:00.841921 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:00.841921 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:00.841921 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:00.842790 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:00.842790 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:00.842790 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:00.842790 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:00.842790 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:00.842790 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:00.842790 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:00.842790 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:00.842790 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:00.842790 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:00.842790 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:45:00.842790 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:00.842790 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 481/970] 10.222.0.59 () {56 vars in 1120 bytes} [Tue Sep 13 19:45:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:00.847946 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b736e1-e6d7-4649-8dcb-22e89d374e8c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:00.868411 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfdabb-c86d-4eab-b155-52028b21b7bc None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:00.894270 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:00.901751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:00.952452 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b736e1-e6d7-4649-8dcb-22e89d374e8c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:00.981959 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfdabb-c86d-4eab-b155-52028b21b7bc None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:00.987273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251fb1b-1d82-4488-8c58-13fd95fc9564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:00.987878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251fb1b-1d82-4488-8c58-13fd95fc9564 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:00.988156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251fb1b-1d82-4488-8c58-13fd95fc9564 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:00.988427 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251fb1b-1d82-4488-8c58-13fd95fc9564 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:00.989088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251fb1b-1d82-4488-8c58-13fd95fc9564 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:00.989391 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251fb1b-1d82-4488-8c58-13fd95fc9564 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:00.990979 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251fb1b-1d82-4488-8c58-13fd95fc9564 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:01.004717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 490/971] 10.222.0.59 () {56 vars in 1115 bytes} [Tue Sep 13 19:45:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:01.005735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251fb1b-1d82-4488-8c58-13fd95fc9564 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:01.021732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec7539-9833-42a8-b6f6-ca48c2f1ced2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:01.022354 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec7539-9833-42a8-b6f6-ca48c2f1ced2 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:01.022629 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec7539-9833-42a8-b6f6-ca48c2f1ced2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:01.022898 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeec7539-9833-42a8-b6f6-ca48c2f1ced2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:01.023496 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec7539-9833-42a8-b6f6-ca48c2f1ced2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:01.024821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeec7539-9833-42a8-b6f6-ca48c2f1ced2 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:01.034356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-eeec7539-9833-42a8-b6f6-ca48c2f1ced2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:45:01.034356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:01.034356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:01.034356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:01.034356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:01.034356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:01.034356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:01.034356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:01.034356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:45:01.034356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:01.034356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:01.034356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:01.034356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:01.034356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:01.034356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:01.034356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:01.034356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:01.035428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:01.035428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:01.035428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:01.035428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:01.035428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:01.035428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:01.035428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:01.035428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:01.035428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:01.035428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:01.035428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:01.035428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:01.035428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:01.035428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:01.035428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:01.035428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:01.036304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:01.036304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:01.036304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:01.036304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:01.036304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:01.036304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:01.036304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:01.036304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:01.036304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:01.036304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:01.036304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:01.036304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:01.036304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:45:01.036304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:01.036304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 482/972] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Sep 13 19:45:00 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:01.041462 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec7539-9833-42a8-b6f6-ca48c2f1ced2 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:01.114865 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251fb1b-1d82-4488-8c58-13fd95fc9564 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:01.127713 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:01.134774 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:01.151976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122425e4-bda9-4d1d-a5d6-035807514807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:01.152606 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122425e4-bda9-4d1d-a5d6-035807514807 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:01.152922 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122425e4-bda9-4d1d-a5d6-035807514807 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:01.153148 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122425e4-bda9-4d1d-a5d6-035807514807 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:01.155538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeec7539-9833-42a8-b6f6-ca48c2f1ced2 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:01.165525 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122425e4-bda9-4d1d-a5d6-035807514807 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:01.167004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122425e4-bda9-4d1d-a5d6-035807514807 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:01.181617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-122425e4-bda9-4d1d-a5d6-035807514807 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:01.181617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:01.181617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:01.181617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:01.181617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:01.181617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:01.181617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:01.181617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:01.181617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:01.181617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:01.181617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:01.181617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:01.181617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:01.181617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:01.181617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:01.181617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:01.182826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:01.182826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:01.182826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:01.182826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:01.182826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:01.182826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:01.182826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:01.182826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:01.182826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:01.182826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:01.182826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:01.182826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:01.182826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:01.182826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:01.182826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:01.182826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:01.182826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:01.183909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:01.183909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:01.183909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:45:01.183909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 491/973] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:01.183909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2d693-8155-40e8-86a3-2106d4969c29 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:01.184197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2d693-8155-40e8-86a3-2106d4969c29 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:01.184412 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e2d693-8155-40e8-86a3-2106d4969c29 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:01.186294 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 492/974] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:01.188231 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2d693-8155-40e8-86a3-2106d4969c29 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:01.194430 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8dcd92-6ca1-4c00-bf22-5e76d573915e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:01.195057 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dcd92-6ca1-4c00-bf22-5e76d573915e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:01.195334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dcd92-6ca1-4c00-bf22-5e76d573915e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:01.195603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8dcd92-6ca1-4c00-bf22-5e76d573915e None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:01.196225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dcd92-6ca1-4c00-bf22-5e76d573915e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:01.196523 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dcd92-6ca1-4c00-bf22-5e76d573915e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:01.197906 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8dcd92-6ca1-4c00-bf22-5e76d573915e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:01.202636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 483/975] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Sep 13 19:45:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:01.203757 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904efe85-44c7-4f2d-a997-3f15b39a7259 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:01.204036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904efe85-44c7-4f2d-a997-3f15b39a7259 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:01.204313 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904efe85-44c7-4f2d-a997-3f15b39a7259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:01.222204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-904efe85-44c7-4f2d-a997-3f15b39a7259 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:01.223753 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-904efe85-44c7-4f2d-a997-3f15b39a7259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:01.290343 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e2d693-8155-40e8-86a3-2106d4969c29 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:01.290884 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 484/976] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:01.291706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904efe85-44c7-4f2d-a997-3f15b39a7259 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:01.330315 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec2b0f-0431-4e53-a088-d3ada1c3b898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:01.330926 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec2b0f-0431-4e53-a088-d3ada1c3b898 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:01.331206 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec2b0f-0431-4e53-a088-d3ada1c3b898 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:01.331479 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec2b0f-0431-4e53-a088-d3ada1c3b898 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:01.332125 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec2b0f-0431-4e53-a088-d3ada1c3b898 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:01.332432 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec2b0f-0431-4e53-a088-d3ada1c3b898 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:01.333835 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec2b0f-0431-4e53-a088-d3ada1c3b898 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:01.363034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 493/977] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:01.368675 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec2b0f-0431-4e53-a088-d3ada1c3b898 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:01.369324 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:01.394380 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904efe85-44c7-4f2d-a997-3f15b39a7259 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:01.396308 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:01.431634 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e7e3d-a7b8-41a8-94e2-2db9c21fe585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:01.432544 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e7e3d-a7b8-41a8-94e2-2db9c21fe585 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:01.432965 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e7e3d-a7b8-41a8-94e2-2db9c21fe585 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:01.433238 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743e7e3d-a7b8-41a8-94e2-2db9c21fe585 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:01.433894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e7e3d-a7b8-41a8-94e2-2db9c21fe585 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:01.434331 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e7e3d-a7b8-41a8-94e2-2db9c21fe585 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:01.435988 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743e7e3d-a7b8-41a8-94e2-2db9c21fe585 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:01.445952 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 485/978] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Sep 13 19:45:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:01.446911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e7e3d-a7b8-41a8-94e2-2db9c21fe585 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:01.478345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec2b0f-0431-4e53-a088-d3ada1c3b898 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:01.511859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fb32e-c328-422b-a692-0db5862340cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:01.512479 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fb32e-c328-422b-a692-0db5862340cc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:01.512805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fb32e-c328-422b-a692-0db5862340cc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:01.513076 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39fb32e-c328-422b-a692-0db5862340cc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:01.520619 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39fb32e-c328-422b-a692-0db5862340cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:01.522092 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39fb32e-c328-422b-a692-0db5862340cc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:01.534065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-b39fb32e-c328-422b-a692-0db5862340cc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:45:01.534065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:01.534065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:01.534065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:01.534065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:01.534065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:01.534065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:01.534065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:01.534065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:01.534065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:01.534065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:01.534065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:01.534065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:45:01.534065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:45:01.534065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:45:01.534065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:45:01.535029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:01.535029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:01.535029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:01.535029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:01.535029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:01.535029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:01.535029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:01.535029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:01.535029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:01.535029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:01.535029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:01.535029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:01.535029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:01.535029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:01.535029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:01.535029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:01.535029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:01.535029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:01.536131 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:01.536131 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:01.536131 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:45:01.536131 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:45:01.536131 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:45:01.536131 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:45:01.536131 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:45:01.536131 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:45:01.536131 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 13 19:45:01.536131 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:45:01.536131 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 494/979] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Sep 13 19:45:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:01.540618 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fb32e-c328-422b-a692-0db5862340cc None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:01.553373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743e7e3d-a7b8-41a8-94e2-2db9c21fe585 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:01.588707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04f6f2-571f-44d1-a925-37d17d1cb6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:01.589303 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04f6f2-571f-44d1-a925-37d17d1cb6de None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:01.589577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04f6f2-571f-44d1-a925-37d17d1cb6de None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:01.589878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04f6f2-571f-44d1-a925-37d17d1cb6de None admin] PATH_INFO: `/v3/endpoints` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:01.590574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04f6f2-571f-44d1-a925-37d17d1cb6de None admin] RBAC: Adding query filter params (interface=admin, service_id=b763f13989154888a50d2bb6c0189eb4, region_id=RegionOne) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:01.590879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04f6f2-571f-44d1-a925-37d17d1cb6de None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:01.592228 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04f6f2-571f-44d1-a925-37d17d1cb6de None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:01.597713 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 486/980] 10.222.0.59 () {56 vars in 1249 bytes} [Tue Sep 13 19:45:01 2022] GET /identity/v3/endpoints?service_id=b763f13989154888a50d2bb6c0189eb4&interface=admin®ion_id=RegionOne => generated 193 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:01.598500 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04f6f2-571f-44d1-a925-37d17d1cb6de None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:01.601186 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:01.621045 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:01.638515 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39fb32e-c328-422b-a692-0db5862340cc None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:01.672693 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd35b09-ae65-4455-ad36-0136008141dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:01.673345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd35b09-ae65-4455-ad36-0136008141dc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:01.673625 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd35b09-ae65-4455-ad36-0136008141dc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:01.673934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd35b09-ae65-4455-ad36-0136008141dc None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:01.674655 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd35b09-ae65-4455-ad36-0136008141dc None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:01.674965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd35b09-ae65-4455-ad36-0136008141dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:01.676392 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fd35b09-ae65-4455-ad36-0136008141dc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:01.692980 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 495/981] 10.222.0.59 () {56 vars in 1149 bytes} [Tue Sep 13 19:45:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:01.693790 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd35b09-ae65-4455-ad36-0136008141dc None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:01.698151 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04f6f2-571f-44d1-a925-37d17d1cb6de None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:01.731887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d7a7d-b653-4307-8eb1-7fd6f7577e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:01.732490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d7a7d-b653-4307-8eb1-7fd6f7577e49 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:01.732769 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d7a7d-b653-4307-8eb1-7fd6f7577e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:01.733042 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c1d7a7d-b653-4307-8eb1-7fd6f7577e49 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:01.733684 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d7a7d-b653-4307-8eb1-7fd6f7577e49 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:01.735060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c1d7a7d-b653-4307-8eb1-7fd6f7577e49 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:01.791828 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fd35b09-ae65-4455-ad36-0136008141dc None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:01.806183 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 487/982] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Sep 13 19:45:01 2022] POST /identity/v3/services => generated 242 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:01.807058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d7a7d-b653-4307-8eb1-7fd6f7577e49 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:01.836477 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381dfe0-cc01-4746-b916-a7a8832bb4f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:01.837166 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381dfe0-cc01-4746-b916-a7a8832bb4f5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:01.837445 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381dfe0-cc01-4746-b916-a7a8832bb4f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:01.837743 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f381dfe0-cc01-4746-b916-a7a8832bb4f5 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:01.838366 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381dfe0-cc01-4746-b916-a7a8832bb4f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:01.839964 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f381dfe0-cc01-4746-b916-a7a8832bb4f5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:01.842672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:01.857725 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 496/983] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Sep 13 19:45:01 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:45:01.897176 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:01.944347 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c1d7a7d-b653-4307-8eb1-7fd6f7577e49 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:01.985022 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d2fcf-91d0-4409-b475-3c9575357faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:01.985628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d2fcf-91d0-4409-b475-3c9575357faa None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:01.986433 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d2fcf-91d0-4409-b475-3c9575357faa None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:01.986701 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150d2fcf-91d0-4409-b475-3c9575357faa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:02.059539 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d2fcf-91d0-4409-b475-3c9575357faa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:02.060968 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150d2fcf-91d0-4409-b475-3c9575357faa None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:02.120980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:02.165906 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 488/984] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:01 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:45:02.167658 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381dfe0-cc01-4746-b916-a7a8832bb4f5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:02.266426 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f381dfe0-cc01-4746-b916-a7a8832bb4f5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:02.301887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a9f25-6a93-4f3b-baf9-dd0f85ddf662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:02.302512 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a9f25-6a93-4f3b-baf9-dd0f85ddf662 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:02.302788 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a9f25-6a93-4f3b-baf9-dd0f85ddf662 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:02.303055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a9f25-6a93-4f3b-baf9-dd0f85ddf662 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:02.313323 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a9f25-6a93-4f3b-baf9-dd0f85ddf662 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:02.314839 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3a9f25-6a93-4f3b-baf9-dd0f85ddf662 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:02.330065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-4a3a9f25-6a93-4f3b-baf9-dd0f85ddf662 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:02.330065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:02.330065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:02.330065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:02.330065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:02.330065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:02.330065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:02.330065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:02.330065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:02.330065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:02.330065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:02.330065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:02.330065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:02.330065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:02.330065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:02.330065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:02.331052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:02.331052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:02.331052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:02.331052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:02.331052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:02.331052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:02.331052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:02.331052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:02.331052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:02.331052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:02.331052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:02.331052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:02.331052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:02.331052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:02.331052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:02.331052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:02.331052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:02.336956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:02.336956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:02.336956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:45:02.336956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 497/985] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:02.338818 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d2fcf-91d0-4409-b475-3c9575357faa None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:02.441235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150d2fcf-91d0-4409-b475-3c9575357faa None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:02.475532 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521b275-77da-4edf-96e0-46befa39ee3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:02.476139 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521b275-77da-4edf-96e0-46befa39ee3d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:02.476518 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521b275-77da-4edf-96e0-46befa39ee3d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:02.476791 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521b275-77da-4edf-96e0-46befa39ee3d None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:02.477418 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521b275-77da-4edf-96e0-46befa39ee3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:02.477736 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521b275-77da-4edf-96e0-46befa39ee3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:02.479087 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521b275-77da-4edf-96e0-46befa39ee3d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:02.494010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 489/986] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:02.495711 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a9f25-6a93-4f3b-baf9-dd0f85ddf662 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:02.551600 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:02.601417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a9f25-6a93-4f3b-baf9-dd0f85ddf662 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:02.635746 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96464bea-ae63-4fbf-a991-607c4ffd5668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:02.636372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96464bea-ae63-4fbf-a991-607c4ffd5668 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:02.636645 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96464bea-ae63-4fbf-a991-607c4ffd5668 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:02.636909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96464bea-ae63-4fbf-a991-607c4ffd5668 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:02.643961 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96464bea-ae63-4fbf-a991-607c4ffd5668 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:02.645384 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96464bea-ae63-4fbf-a991-607c4ffd5668 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:02.656775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-96464bea-ae63-4fbf-a991-607c4ffd5668 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:02.656775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:02.656775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:02.656775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:02.656775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:02.656775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:02.656775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:02.656775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:02.656775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:02.656775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:02.656775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:02.656775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:02.656775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:45:02.656775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:45:02.656775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:45:02.657744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:45:02.657744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:02.657744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:02.657744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:02.657744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:02.657744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:02.657744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:02.657744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:02.657744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:02.657744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:02.657744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:02.657744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:02.657744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:02.657744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:02.657744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:02.657744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:02.657744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:02.658693 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:45:02.658693 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:45:02.658693 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:02.658693 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:02.658693 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:02.658693 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:02.658693 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:02.658693 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:45:02.662014 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 498/987] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:02.663752 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521b275-77da-4edf-96e0-46befa39ee3d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:02.689666 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:02.770281 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521b275-77da-4edf-96e0-46befa39ee3d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:02.803556 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d095fb98-da15-4978-b2e9-db2d8ac10fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:02.804094 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095fb98-da15-4978-b2e9-db2d8ac10fae None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:02.804371 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095fb98-da15-4978-b2e9-db2d8ac10fae None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:02.804642 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d095fb98-da15-4978-b2e9-db2d8ac10fae None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:02.805321 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095fb98-da15-4978-b2e9-db2d8ac10fae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:02.805623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095fb98-da15-4978-b2e9-db2d8ac10fae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:02.807070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d095fb98-da15-4978-b2e9-db2d8ac10fae None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:02.819442 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 490/988] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:45:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:02.825193 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96464bea-ae63-4fbf-a991-607c4ffd5668 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:02.932947 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96464bea-ae63-4fbf-a991-607c4ffd5668 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:02.946165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:02.966148 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e85ea9-a9ce-4b6e-9aa1-c6d2424b632f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:02.966745 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e85ea9-a9ce-4b6e-9aa1-c6d2424b632f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:02.967024 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e85ea9-a9ce-4b6e-9aa1-c6d2424b632f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:02.967294 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e85ea9-a9ce-4b6e-9aa1-c6d2424b632f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:02.968010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e85ea9-a9ce-4b6e-9aa1-c6d2424b632f None admin] RBAC: Adding query filter params (role.id=6a6942f029514d3ca77a5a30059bab3d, scope.project.id=ad67761fec0a430181877e216e90e7d4, user.id=9fd7a80714874e73bf64dfa392632391) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:02.968315 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e85ea9-a9ce-4b6e-9aa1-c6d2424b632f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:02.969782 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e85ea9-a9ce-4b6e-9aa1-c6d2424b632f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:02.975668 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 499/989] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:45:02 2022] GET /identity/v3/role_assignments?user.id=9fd7a80714874e73bf64dfa392632391&scope.project.id=ad67761fec0a430181877e216e90e7d4&role.id=6a6942f029514d3ca77a5a30059bab3d => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:04.024318 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ea2a1-6121-4530-95cb-a49f13676311 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:04.024834 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ea2a1-6121-4530-95cb-a49f13676311 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:04.024834 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2ea2a1-6121-4530-95cb-a49f13676311 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:04.029893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 491/990] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:04.031476 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f04b90-5be2-4fb5-b2e7-882de4a3fa1e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:04.031868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f04b90-5be2-4fb5-b2e7-882de4a3fa1e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:04.032048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f04b90-5be2-4fb5-b2e7-882de4a3fa1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:04.033494 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376ced7-235e-455b-8f03-4fdb3ed07d17 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:04.033811 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376ced7-235e-455b-8f03-4fdb3ed07d17 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:04.034092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376ced7-235e-455b-8f03-4fdb3ed07d17 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:04.035520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 492/991] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:45:04.040122 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb7e6b-33ed-4285-8a33-73510cf98eb2 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:04.040401 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb7e6b-33ed-4285-8a33-73510cf98eb2 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:04.040675 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcb7e6b-33ed-4285-8a33-73510cf98eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:04.052422 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-64f04b90-5be2-4fb5-b2e7-882de4a3fa1e None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:04.053620 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-64f04b90-5be2-4fb5-b2e7-882de4a3fa1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:04.058538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-fbcb7e6b-33ed-4285-8a33-73510cf98eb2 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:04.059677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-fbcb7e6b-33ed-4285-8a33-73510cf98eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:04.126670 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 500/992] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:04.134175 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 493/993] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:04 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:45:04.392819 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f04b90-5be2-4fb5-b2e7-882de4a3fa1e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:04.402515 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb7e6b-33ed-4285-8a33-73510cf98eb2 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:04.417573 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:04.493544 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f04b90-5be2-4fb5-b2e7-882de4a3fa1e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:04.500980 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:04.511521 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcb7e6b-33ed-4285-8a33-73510cf98eb2 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:04.532012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb544b11-0438-40d1-bf21-b4374f763447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:04.532904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb544b11-0438-40d1-bf21-b4374f763447 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:04.533183 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb544b11-0438-40d1-bf21-b4374f763447 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:04.533452 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb544b11-0438-40d1-bf21-b4374f763447 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:04.534064 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb544b11-0438-40d1-bf21-b4374f763447 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:04.535427 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb544b11-0438-40d1-bf21-b4374f763447 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:04.544268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-cb544b11-0438-40d1-bf21-b4374f763447 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:45:04.544268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:04.544268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:04.544268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:04.544268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:04.544268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:04.544268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:04.544268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:04.544268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:45:04.544268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:45:04.544268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:04.544268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:45:04.544268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:04.544268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:04.544268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:04.544268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:04.544268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:04.545272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:04.545272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:04.545272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:04.545272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:04.545272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:04.545272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:04.545272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:04.545272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:04.545272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:04.545272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:04.545272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:04.545272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:04.545272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:04.545272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:04.545272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:04.545272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:04.546182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:04.546182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:04.546182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:04.546182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:04.546182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:04.546182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:04.546182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:04.546182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:04.546182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:04.546182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:04.546182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:04.546182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:04.546182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 13 19:45:04.546182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:45:04.550879 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 501/994] 10.222.0.59 () {56 vars in 1126 bytes} [Tue Sep 13 19:45:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:04.551772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb544b11-0438-40d1-bf21-b4374f763447 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:04.554236 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cef20-f66d-4d5c-9d98-d514637567a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:04.554880 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cef20-f66d-4d5c-9d98-d514637567a4 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:04.555160 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cef20-f66d-4d5c-9d98-d514637567a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:04.555431 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5cef20-f66d-4d5c-9d98-d514637567a4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:04.556137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cef20-f66d-4d5c-9d98-d514637567a4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:04.557636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5cef20-f66d-4d5c-9d98-d514637567a4 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:04.567716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-7c5cef20-f66d-4d5c-9d98-d514637567a4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:45:04.567716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:04.567716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:04.567716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:04.567716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:04.567716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:04.567716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:04.567716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:04.567716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:45:04.567716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:04.567716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:04.567716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:04.567716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:04.567716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:04.567716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:04.567716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:04.567716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:04.568714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:04.568714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:04.568714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:04.568714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:04.568714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:04.568714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:04.568714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:04.568714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:04.568714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:04.568714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:04.568714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:04.568714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:04.568714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:04.568714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:04.568714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:04.568714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:04.569579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:04.569579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:04.569579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:04.569579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:04.569579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:04.569579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:04.569579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:04.569579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:04.569579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:04.569579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:04.569579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:04.569579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:04.569579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:45:04.569579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:04.573799 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 494/995] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:04.574635 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cef20-f66d-4d5c-9d98-d514637567a4 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:04.653773 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:04.659476 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb544b11-0438-40d1-bf21-b4374f763447 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:04.677513 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5cef20-f66d-4d5c-9d98-d514637567a4 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:04.695141 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d593ad-64d6-499a-8b33-9ff0b0c7bb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:04.695745 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d593ad-64d6-499a-8b33-9ff0b0c7bb96 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:04.696021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d593ad-64d6-499a-8b33-9ff0b0c7bb96 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:04.696288 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d593ad-64d6-499a-8b33-9ff0b0c7bb96 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:04.696916 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d593ad-64d6-499a-8b33-9ff0b0c7bb96 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:04.697216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d593ad-64d6-499a-8b33-9ff0b0c7bb96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:04.698604 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d593ad-64d6-499a-8b33-9ff0b0c7bb96 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:04.703567 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 502/996] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Sep 13 19:45:04 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:04.709114 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d593ad-64d6-499a-8b33-9ff0b0c7bb96 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:04.714085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c786045-2082-4084-aebb-80b8457f1eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:04.714750 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c786045-2082-4084-aebb-80b8457f1eaf None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:04.715038 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c786045-2082-4084-aebb-80b8457f1eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:04.715319 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c786045-2082-4084-aebb-80b8457f1eaf None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:04.715951 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c786045-2082-4084-aebb-80b8457f1eaf None admin] RBAC: Adding query filter params (name=compute) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:04.716254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c786045-2082-4084-aebb-80b8457f1eaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:04.717684 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c786045-2082-4084-aebb-80b8457f1eaf None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:04.722830 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 495/997] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Sep 13 19:45:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:04.728254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c786045-2082-4084-aebb-80b8457f1eaf None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:04.748877 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:04.817052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d593ad-64d6-499a-8b33-9ff0b0c7bb96 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:04.836708 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c786045-2082-4084-aebb-80b8457f1eaf None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:04.855445 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2341a-48e3-424f-aa65-98d4785b7859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:04.856174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2341a-48e3-424f-aa65-98d4785b7859 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:04.856570 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2341a-48e3-424f-aa65-98d4785b7859 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:04.856943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c2341a-48e3-424f-aa65-98d4785b7859 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:04.857678 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2341a-48e3-424f-aa65-98d4785b7859 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:04.858001 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2341a-48e3-424f-aa65-98d4785b7859 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:04.859355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c2341a-48e3-424f-aa65-98d4785b7859 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:04.864916 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 503/998] 10.222.0.59 () {56 vars in 1122 bytes} [Tue Sep 13 19:45:04 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:04.870690 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2341a-48e3-424f-aa65-98d4785b7859 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:04.872865 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7bea8-3331-416b-9b2e-ea68cc148e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:04.873543 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7bea8-3331-416b-9b2e-ea68cc148e7c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:04.874023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7bea8-3331-416b-9b2e-ea68cc148e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:04.874304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c7bea8-3331-416b-9b2e-ea68cc148e7c None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:04.877833 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7bea8-3331-416b-9b2e-ea68cc148e7c None admin] RBAC: Adding query filter params (type=compute) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:04.877833 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7bea8-3331-416b-9b2e-ea68cc148e7c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:04.877833 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c7bea8-3331-416b-9b2e-ea68cc148e7c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:04.888221 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 496/999] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Sep 13 19:45:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:04.891972 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7bea8-3331-416b-9b2e-ea68cc148e7c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:04.899187 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:04.973612 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:04.977817 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c2341a-48e3-424f-aa65-98d4785b7859 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:04.998687 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c7bea8-3331-416b-9b2e-ea68cc148e7c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:05.012467 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2f48ed-424a-408c-a78c-ed8cb467a0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:05.013109 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f48ed-424a-408c-a78c-ed8cb467a0c2 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:05.013389 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f48ed-424a-408c-a78c-ed8cb467a0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:05.013662 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2f48ed-424a-408c-a78c-ed8cb467a0c2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:05.014380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f48ed-424a-408c-a78c-ed8cb467a0c2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:05.015821 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2f48ed-424a-408c-a78c-ed8cb467a0c2 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:05.037634 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a010c-bf3d-4fdf-90d9-9d35c22c3344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:05.038279 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a010c-bf3d-4fdf-90d9-9d35c22c3344 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:05.038581 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a010c-bf3d-4fdf-90d9-9d35c22c3344 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:05.038853 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66a010c-bf3d-4fdf-90d9-9d35c22c3344 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:05.039592 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a010c-bf3d-4fdf-90d9-9d35c22c3344 None admin] RBAC: Adding query filter params (interface=public, service_id=01672886b8ca47f397a16b25fa5b481d, region_id=RegionOne) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:05.039899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a010c-bf3d-4fdf-90d9-9d35c22c3344 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:05.041452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66a010c-bf3d-4fdf-90d9-9d35c22c3344 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:05.047399 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 497/1000] 10.222.0.59 () {56 vars in 1251 bytes} [Tue Sep 13 19:45:04 2022] GET /identity/v3/endpoints?service_id=01672886b8ca47f397a16b25fa5b481d&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:05.053767 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a010c-bf3d-4fdf-90d9-9d35c22c3344 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:05.086769 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 504/1001] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 19:45:04 2022] POST /identity/v3/endpoints => generated 325 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:05.125054 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:05.138435 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de557a10-a145-4bc8-9091-25acd5fdfd20 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:05.138730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de557a10-a145-4bc8-9091-25acd5fdfd20 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:05.139007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de557a10-a145-4bc8-9091-25acd5fdfd20 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:05.140489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 505/1002] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:45:05.146878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27eae8-86f0-44de-8643-57f4ce6cfc5f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:05.147165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27eae8-86f0-44de-8643-57f4ce6cfc5f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:05.147447 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f27eae8-86f0-44de-8643-57f4ce6cfc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:05.166600 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66a010c-bf3d-4fdf-90d9-9d35c22c3344 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:05.167150 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9f27eae8-86f0-44de-8643-57f4ce6cfc5f None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:05.168376 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9f27eae8-86f0-44de-8643-57f4ce6cfc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:05.210140 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60dfe6f-86be-4907-a197-5c9dc2500163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:05.210764 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dfe6f-86be-4907-a197-5c9dc2500163 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:05.211039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dfe6f-86be-4907-a197-5c9dc2500163 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:05.211308 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60dfe6f-86be-4907-a197-5c9dc2500163 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:05.211910 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60dfe6f-86be-4907-a197-5c9dc2500163 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:05.213321 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60dfe6f-86be-4907-a197-5c9dc2500163 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:05.230236 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 498/1003] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Sep 13 19:45:05 2022] GET /identity/v3/services => generated 1727 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:45:05.244061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 506/1004] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:05 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:45:05.509499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60dfe6f-86be-4907-a197-5c9dc2500163 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:05.613533 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60dfe6f-86be-4907-a197-5c9dc2500163 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:05.642082 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:05.650294 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b6848-0f77-4e32-b467-0fa705d4ce72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:05.650934 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b6848-0f77-4e32-b467-0fa705d4ce72 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:05.651215 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b6848-0f77-4e32-b467-0fa705d4ce72 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:05.664678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875b6848-0f77-4e32-b467-0fa705d4ce72 None admin] PATH_INFO: `/v3/services/image` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:05.664678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b6848-0f77-4e32-b467-0fa705d4ce72 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:05.664678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875b6848-0f77-4e32-b467-0fa705d4ce72 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:05.664678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-875b6848-0f77-4e32-b467-0fa705d4ce72 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:45:05.664678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:05.664678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:05.664678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:05.664678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:05.664678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:05.664678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:05.664678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:05.665404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:45:05.665404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:05.665404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:05.665404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:05.665404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:05.665404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:05.665404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:05.665404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:05.665404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:05.665404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:05.665404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:05.665404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:05.665404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:05.665404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:05.665404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:05.665404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:05.665404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:05.665404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:05.666545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:05.666545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:05.666545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:05.666545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:05.666545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:05.666545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:05.666545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:05.666545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:05.666545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:05.666545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:05.666545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:05.666545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:05.666545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:05.666545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:05.666545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:05.666545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:05.666545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:05.667488 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:05.667488 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:05.667488 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:45:05.667488 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:05.667488 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 499/1005] 10.222.0.59 () {56 vars in 1105 bytes} [Tue Sep 13 19:45:05 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:05.669856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27eae8-86f0-44de-8643-57f4ce6cfc5f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:05.762930 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:05.775808 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f27eae8-86f0-44de-8643-57f4ce6cfc5f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:05.810699 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7cc970-a5a7-4a52-bc74-d04df3eb5ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:05.811307 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cc970-a5a7-4a52-bc74-d04df3eb5ab4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:05.811599 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cc970-a5a7-4a52-bc74-d04df3eb5ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:05.811919 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7cc970-a5a7-4a52-bc74-d04df3eb5ab4 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:05.812553 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7cc970-a5a7-4a52-bc74-d04df3eb5ab4 None admin] RBAC: Adding query filter params (name=image) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:05.813743 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7cc970-a5a7-4a52-bc74-d04df3eb5ab4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:05.815356 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7cc970-a5a7-4a52-bc74-d04df3eb5ab4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:05.825409 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 507/1006] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:05.826627 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b6848-0f77-4e32-b467-0fa705d4ce72 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:05.936711 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875b6848-0f77-4e32-b467-0fa705d4ce72 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:05.971197 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef954e35-9ed4-4ec9-b84e-91def8502093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:05.971809 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef954e35-9ed4-4ec9-b84e-91def8502093 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:05.972090 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef954e35-9ed4-4ec9-b84e-91def8502093 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:05.972363 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef954e35-9ed4-4ec9-b84e-91def8502093 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:05.972990 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef954e35-9ed4-4ec9-b84e-91def8502093 None admin] RBAC: Adding query filter params (type=image) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:05.973289 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef954e35-9ed4-4ec9-b84e-91def8502093 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:05.974706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef954e35-9ed4-4ec9-b84e-91def8502093 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:05.986075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 500/1007] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:05 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:07.255509 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92304eb-31b3-41aa-a342-a969402d3894 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:07.256060 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92304eb-31b3-41aa-a342-a969402d3894 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:07.256060 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92304eb-31b3-41aa-a342-a969402d3894 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:07.257653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 508/1008] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:07.263344 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd733f-037e-46b0-9ec2-2256b59391db None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:07.263862 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd733f-037e-46b0-9ec2-2256b59391db None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:07.263945 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd733f-037e-46b0-9ec2-2256b59391db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:07.283978 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-96fd733f-037e-46b0-9ec2-2256b59391db None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:07.285163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-96fd733f-037e-46b0-9ec2-2256b59391db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:07.337419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:07.357831 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 501/1009] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:07 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:07.369654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5a7eb-6f18-4495-b67f-91aa457166d2 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:07.369968 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5a7eb-6f18-4495-b67f-91aa457166d2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:07.370237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5a7eb-6f18-4495-b67f-91aa457166d2 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:07.371673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 509/1010] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:07.376664 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f9d81-4263-466d-b3cc-ca12167fc1cf None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:07.376958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f9d81-4263-466d-b3cc-ca12167fc1cf None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:07.377235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332f9d81-4263-466d-b3cc-ca12167fc1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:07.396696 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-332f9d81-4263-466d-b3cc-ca12167fc1cf None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:07.397915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-332f9d81-4263-466d-b3cc-ca12167fc1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:07.464899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 502/1011] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:07 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:45:07.615870 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5a7eb-6f18-4495-b67f-91aa457166d2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:07.719357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5a7eb-6f18-4495-b67f-91aa457166d2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:07.734213 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f9d81-4263-466d-b3cc-ca12167fc1cf None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:07.757788 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d960c-b84e-4e31-8955-c1eafd0ad9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:07.758425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d960c-b84e-4e31-8955-c1eafd0ad9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:07.758722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d960c-b84e-4e31-8955-c1eafd0ad9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:07.758967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3d960c-b84e-4e31-8955-c1eafd0ad9d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:07.760116 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d960c-b84e-4e31-8955-c1eafd0ad9d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:07.761510 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3d960c-b84e-4e31-8955-c1eafd0ad9d3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:07.763264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 510/1012] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:07.769136 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d960c-b84e-4e31-8955-c1eafd0ad9d3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:07.790755 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:07.848250 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332f9d81-4263-466d-b3cc-ca12167fc1cf None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:07.870604 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:07.870768 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3d960c-b84e-4e31-8955-c1eafd0ad9d3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:07.901713 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7cc41-d8e2-4513-b70f-aec9f0125bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:07.902417 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7cc41-d8e2-4513-b70f-aec9f0125bc1 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:07.902835 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7cc41-d8e2-4513-b70f-aec9f0125bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:07.903120 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7cc41-d8e2-4513-b70f-aec9f0125bc1 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:07.903987 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7cc41-d8e2-4513-b70f-aec9f0125bc1 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:07.905802 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b7cc41-d8e2-4513-b70f-aec9f0125bc1 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:07.908246 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0e670-8900-4957-bdf1-583858d2f36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:07.908863 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0e670-8900-4957-bdf1-583858d2f36c None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:07.909172 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0e670-8900-4957-bdf1-583858d2f36c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:07.909444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0e670-8900-4957-bdf1-583858d2f36c None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:07.910120 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0e670-8900-4957-bdf1-583858d2f36c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:07.911537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0e670-8900-4957-bdf1-583858d2f36c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:07.917915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-43b7cc41-d8e2-4513-b70f-aec9f0125bc1 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:45:07.917915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:07.917915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:07.917915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:07.917915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:07.917915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:07.917915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:07.917915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:07.917915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:45:07.917915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:07.917915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:07.917915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:07.917915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:07.917915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:07.917915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:07.917915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:07.917915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:07.922798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:07.922798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:07.922798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:07.922798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:07.922798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:07.922798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:07.922798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:07.922798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:07.922798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:07.922798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:07.922798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:07.922798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:07.922798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:07.922798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:07.922798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:07.922798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:07.923677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:07.923677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:07.923677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:07.923677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:07.923677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:07.923677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:07.923677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:07.923677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:07.923677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:07.923677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:07.923677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:07.923677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:07.923677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 13 19:45:07.923677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:07.923677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 503/1013] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:07 2022] GET /identity/v3/services/compute => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:07.925597 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7cc41-d8e2-4513-b70f-aec9f0125bc1 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:08.010313 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 511/1014] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Sep 13 19:45:07 2022] POST /identity/v3/projects => generated 311 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:45:08.039168 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7cc41-d8e2-4513-b70f-aec9f0125bc1 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:08.077169 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b051d7-22e0-4503-a05d-f3e66fff850f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:08.077827 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b051d7-22e0-4503-a05d-f3e66fff850f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:08.078109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b051d7-22e0-4503-a05d-f3e66fff850f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:08.078381 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b051d7-22e0-4503-a05d-f3e66fff850f None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:08.079631 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b051d7-22e0-4503-a05d-f3e66fff850f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:08.079937 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b051d7-22e0-4503-a05d-f3e66fff850f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:08.081358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b051d7-22e0-4503-a05d-f3e66fff850f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:08.091510 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 504/1015] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Sep 13 19:45:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:08.093058 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0e670-8900-4957-bdf1-583858d2f36c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:08.145800 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845b110-40c9-4d7b-a5a9-aa45f974051a None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:08.145988 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845b110-40c9-4d7b-a5a9-aa45f974051a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:08.146260 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8845b110-40c9-4d7b-a5a9-aa45f974051a None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:08.147637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 505/1016] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:45:08.153285 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b718de5-141e-4813-9c9c-fc7eb7acd46b None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:08.153575 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b718de5-141e-4813-9c9c-fc7eb7acd46b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:08.153912 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b718de5-141e-4813-9c9c-fc7eb7acd46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:08.174407 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-7b718de5-141e-4813-9c9c-fc7eb7acd46b None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:08.174913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7b718de5-141e-4813-9c9c-fc7eb7acd46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:08.175185 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:08.210681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0e670-8900-4957-bdf1-583858d2f36c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:08.219623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:08.251539 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 506/1017] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:08 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:45:08.254312 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8726e4e-18ca-4d01-8af0-e70eba45b50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:08.254924 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8726e4e-18ca-4d01-8af0-e70eba45b50a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:08.255197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8726e4e-18ca-4d01-8af0-e70eba45b50a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:08.255462 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8726e4e-18ca-4d01-8af0-e70eba45b50a None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:08.256090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8726e4e-18ca-4d01-8af0-e70eba45b50a None admin] RBAC: Adding query filter params (type=compute) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:08.256605 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8726e4e-18ca-4d01-8af0-e70eba45b50a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:08.257790 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8726e4e-18ca-4d01-8af0-e70eba45b50a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:08.262669 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 512/1018] 10.222.0.59 () {56 vars in 1112 bytes} [Tue Sep 13 19:45:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:08.268571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b718de5-141e-4813-9c9c-fc7eb7acd46b None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:08.369708 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b718de5-141e-4813-9c9c-fc7eb7acd46b None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:08.403903 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85d0d25-a02e-49cc-882f-8c36c36cdad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:08.404454 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d0d25-a02e-49cc-882f-8c36c36cdad3 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:08.404818 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d0d25-a02e-49cc-882f-8c36c36cdad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:08.405094 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85d0d25-a02e-49cc-882f-8c36c36cdad3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:08.405800 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d0d25-a02e-49cc-882f-8c36c36cdad3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:08.407181 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85d0d25-a02e-49cc-882f-8c36c36cdad3 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:08.485763 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 507/1019] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 19:45:08 2022] POST /identity/v3/endpoints => generated 334 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 19:45:08.524027 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8726e4e-18ca-4d01-8af0-e70eba45b50a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:08.635145 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8726e4e-18ca-4d01-8af0-e70eba45b50a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:08.672213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:08.677566 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7718e192-5eb9-4a6b-bccd-57472229c8be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:08.678210 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718e192-5eb9-4a6b-bccd-57472229c8be None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:08.678494 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718e192-5eb9-4a6b-bccd-57472229c8be None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:08.678765 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7718e192-5eb9-4a6b-bccd-57472229c8be None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:08.679413 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718e192-5eb9-4a6b-bccd-57472229c8be None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:08.680801 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7718e192-5eb9-4a6b-bccd-57472229c8be None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:08.790597 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 513/1020] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Sep 13 19:45:08 2022] POST /identity/v3/services => generated 242 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:10.210039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbbfc8-dd4b-463a-906f-b992ca5294d7 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:10.210595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbbfc8-dd4b-463a-906f-b992ca5294d7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:10.210595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fbbfc8-dd4b-463a-906f-b992ca5294d7 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:10.211980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 508/1021] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:10.216979 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d427a-65e6-4af2-9053-204e75e32560 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:10.217361 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d427a-65e6-4af2-9053-204e75e32560 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:10.217540 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4d427a-65e6-4af2-9053-204e75e32560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:10.236320 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6a4d427a-65e6-4af2-9053-204e75e32560 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:10.237482 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6a4d427a-65e6-4af2-9053-204e75e32560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:10.307319 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 514/1022] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:10.574110 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbbfc8-dd4b-463a-906f-b992ca5294d7 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:10.607202 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:10.684465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fbbfc8-dd4b-463a-906f-b992ca5294d7 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:10.717956 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676b01d5-4050-4b7c-8149-f7dc390adf47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:10.718583 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b01d5-4050-4b7c-8149-f7dc390adf47 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:10.718856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b01d5-4050-4b7c-8149-f7dc390adf47 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:10.719124 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676b01d5-4050-4b7c-8149-f7dc390adf47 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:10.720263 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b01d5-4050-4b7c-8149-f7dc390adf47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:10.721662 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676b01d5-4050-4b7c-8149-f7dc390adf47 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:10.723410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 509/1023] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:10.728835 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d427a-65e6-4af2-9053-204e75e32560 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:10.745292 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4d986-8a68-44cf-8528-79e6a3bdb79e None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:10.745599 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4d986-8a68-44cf-8528-79e6a3bdb79e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:10.745903 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4d986-8a68-44cf-8528-79e6a3bdb79e None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:10.747232 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 510/1024] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:10.752998 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0b656-bddc-443b-9e48-3ca718015c3b None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:10.753295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0b656-bddc-443b-9e48-3ca718015c3b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:10.753570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d0b656-bddc-443b-9e48-3ca718015c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:10.772769 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e1d0b656-bddc-443b-9e48-3ca718015c3b None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:10.773987 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e1d0b656-bddc-443b-9e48-3ca718015c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:10.834676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4d427a-65e6-4af2-9053-204e75e32560 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:10.842351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 511/1025] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:10.857136 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:10.877206 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c357c3-bbe7-4250-bf8d-9bbe517a82bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:10.878123 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c357c3-bbe7-4250-bf8d-9bbe517a82bc None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:10.883402 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c357c3-bbe7-4250-bf8d-9bbe517a82bc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:10.883402 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c357c3-bbe7-4250-bf8d-9bbe517a82bc None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:10.883402 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c357c3-bbe7-4250-bf8d-9bbe517a82bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:10.883402 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c357c3-bbe7-4250-bf8d-9bbe517a82bc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:10.976171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c741b-473c-4bfd-8769-83b303cd7fb3 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:10.976457 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c741b-473c-4bfd-8769-83b303cd7fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:10.976732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c741b-473c-4bfd-8769-83b303cd7fb3 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:10.978230 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 512/1026] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:45:10.983080 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc91f8a-741f-4397-bb66-f2b56d7f5788 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:10.983389 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc91f8a-741f-4397-bb66-f2b56d7f5788 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:10.983665 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc91f8a-741f-4397-bb66-f2b56d7f5788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:10.991737 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 515/1027] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Sep 13 19:45:10 2022] POST /identity/v3/users => generated 285 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:11.003731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-0dc91f8a-741f-4397-bb66-f2b56d7f5788 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:11.004975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0dc91f8a-741f-4397-bb66-f2b56d7f5788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:11.031932 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:11.081492 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 513/1028] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:10 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:45:11.114908 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c357c3-bbe7-4250-bf8d-9bbe517a82bc None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:11.221144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c357c3-bbe7-4250-bf8d-9bbe517a82bc None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:11.256786 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689381f9-04e3-44f4-b664-e53c2c92fe52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:11.257530 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689381f9-04e3-44f4-b664-e53c2c92fe52 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:11.257913 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689381f9-04e3-44f4-b664-e53c2c92fe52 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:11.258188 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689381f9-04e3-44f4-b664-e53c2c92fe52 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:11.270496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689381f9-04e3-44f4-b664-e53c2c92fe52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:11.275324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-689381f9-04e3-44f4-b664-e53c2c92fe52 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:45:11.275324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:11.275324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:11.275324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:11.275324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:11.275324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:11.275324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:11.275324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:11.275324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:11.275324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:11.275324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:11.275324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:11.275324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:11.275324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:11.275324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:11.275324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:11.276341 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:11.276341 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:11.276341 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:11.276341 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:11.276341 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:11.276341 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:11.276341 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:11.276341 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:11.276341 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:11.276341 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:11.276341 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:11.276341 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:11.276341 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:11.276341 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:11.276341 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:11.276341 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:11.277237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:11.277237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:11.277237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:11.277237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:11.277237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:11.277237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:11.277237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:11.277237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:11.277237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:11.277237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:11.277237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:45:11.277237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:45:11.277237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 516/1029] 10.222.0.59 () {56 vars in 1120 bytes} [Tue Sep 13 19:45:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:11.283242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc91f8a-741f-4397-bb66-f2b56d7f5788 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:11.357405 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689381f9-04e3-44f4-b664-e53c2c92fe52 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:11.383275 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc91f8a-741f-4397-bb66-f2b56d7f5788 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:11.395985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:11.419704 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e9530-f220-423c-9624-93050942b3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:11.420322 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e9530-f220-423c-9624-93050942b3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:11.420604 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e9530-f220-423c-9624-93050942b3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:11.420875 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e9530-f220-423c-9624-93050942b3d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:11.421549 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e9530-f220-423c-9624-93050942b3d8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:11.421863 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e9530-f220-423c-9624-93050942b3d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:11.423309 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860e9530-f220-423c-9624-93050942b3d8 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:11.431639 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 514/1030] 10.222.0.59 () {56 vars in 1115 bytes} [Tue Sep 13 19:45:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:11.437362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e9530-f220-423c-9624-93050942b3d8 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:11.459565 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:11.469616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689381f9-04e3-44f4-b664-e53c2c92fe52 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:11.506921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6882f-1453-4d51-8773-f8583664c55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:11.507546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6882f-1453-4d51-8773-f8583664c55d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:11.507824 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6882f-1453-4d51-8773-f8583664c55d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:11.508091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f6882f-1453-4d51-8773-f8583664c55d None admin] PATH_INFO: `/v3/services/image` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:11.508704 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6882f-1453-4d51-8773-f8583664c55d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:11.510064 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f6882f-1453-4d51-8773-f8583664c55d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:11.519385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-f5f6882f-1453-4d51-8773-f8583664c55d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:45:11.519385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:11.519385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:11.519385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:11.519385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:11.519385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:11.519385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:11.519385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:11.519385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:45:11.519385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:45:11.519385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:11.519385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:45:11.519385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:11.519385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:11.519385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:11.519385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:11.519385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:11.520559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:11.520559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:11.520559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:11.520559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:11.520559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:11.520559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:11.520559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:11.520559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:11.520559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:11.520559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:11.520559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:11.520559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:11.520559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:11.520559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:11.520559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:11.520559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:11.521436 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:11.521436 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:11.521436 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:11.521436 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:11.521436 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:11.521436 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:11.521436 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:11.521436 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:11.521436 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:11.521436 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:11.521436 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:11.521436 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:11.521436 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:45:11.521436 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:45:11.521436 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 517/1031] 10.222.0.59 () {56 vars in 1105 bytes} [Tue Sep 13 19:45:11 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:11.526321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6882f-1453-4d51-8773-f8583664c55d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:11.550295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e9530-f220-423c-9624-93050942b3d8 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:11.587110 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec1ecf-62d9-4b38-923e-efd7cd3900f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:11.588118 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec1ecf-62d9-4b38-923e-efd7cd3900f6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:11.588495 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec1ecf-62d9-4b38-923e-efd7cd3900f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:11.588777 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec1ecf-62d9-4b38-923e-efd7cd3900f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:11.600546 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec1ecf-62d9-4b38-923e-efd7cd3900f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:11.602008 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec1ecf-62d9-4b38-923e-efd7cd3900f6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:11.616276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-7fec1ecf-62d9-4b38-923e-efd7cd3900f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:11.616276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:11.616276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:11.616276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:11.616276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:11.616276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:11.616276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:11.616276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:11.616276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:11.616276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:11.616276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:11.616276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:11.616276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:11.616276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:11.616276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:11.616276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:11.617247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:11.617247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:11.617247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:11.617247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:11.617247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:11.617247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:11.617247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:11.617247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:11.617247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:11.617247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:11.617247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:11.617247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:11.617247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:11.617247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:11.617247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:11.617247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:11.617247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:11.619333 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:11.619333 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:11.619333 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:11.619333 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 515/1032] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:11.622932 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec1ecf-62d9-4b38-923e-efd7cd3900f6 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:11.629249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:11.633039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f6882f-1453-4d51-8773-f8583664c55d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:11.666563 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c955d3-73bb-4445-b580-b3a056e206f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:11.667088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c955d3-73bb-4445-b580-b3a056e206f2 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:11.667369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c955d3-73bb-4445-b580-b3a056e206f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:11.667640 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c955d3-73bb-4445-b580-b3a056e206f2 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:11.668271 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c955d3-73bb-4445-b580-b3a056e206f2 None admin] RBAC: Adding query filter params (name=image) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:11.668941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c955d3-73bb-4445-b580-b3a056e206f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:11.670390 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c955d3-73bb-4445-b580-b3a056e206f2 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:11.680326 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 518/1033] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:11.681180 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c955d3-73bb-4445-b580-b3a056e206f2 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:11.696509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:11.728599 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec1ecf-62d9-4b38-923e-efd7cd3900f6 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:11.765821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb5bf4-fd9c-4185-87bf-3943c5105d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:11.766548 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb5bf4-fd9c-4185-87bf-3943c5105d90 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:11.767533 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb5bf4-fd9c-4185-87bf-3943c5105d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:11.767877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cb5bf4-fd9c-4185-87bf-3943c5105d90 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:11.768580 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb5bf4-fd9c-4185-87bf-3943c5105d90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:11.768883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb5bf4-fd9c-4185-87bf-3943c5105d90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:11.770274 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cb5bf4-fd9c-4185-87bf-3943c5105d90 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:11.787494 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 516/1034] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:11.787909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c955d3-73bb-4445-b580-b3a056e206f2 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:11.790155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb5bf4-fd9c-4185-87bf-3943c5105d90 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:11.830223 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6797d-4513-425c-aea4-e4d5ae256b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:11.830820 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6797d-4513-425c-aea4-e4d5ae256b2d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:11.831095 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6797d-4513-425c-aea4-e4d5ae256b2d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:11.831360 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6797d-4513-425c-aea4-e4d5ae256b2d None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:11.831978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6797d-4513-425c-aea4-e4d5ae256b2d None admin] RBAC: Adding query filter params (type=image) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:11.832275 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6797d-4513-425c-aea4-e4d5ae256b2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:11.833987 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc6797d-4513-425c-aea4-e4d5ae256b2d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:11.843331 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 519/1035] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:11 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:11.844515 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6797d-4513-425c-aea4-e4d5ae256b2d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:11.871865 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:11.910588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cb5bf4-fd9c-4185-87bf-3943c5105d90 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:11.944500 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:11.950358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43562531-49cc-45e0-ac2d-f732d93bcfa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:11.951328 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43562531-49cc-45e0-ac2d-f732d93bcfa4 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:11.951643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43562531-49cc-45e0-ac2d-f732d93bcfa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:11.952008 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43562531-49cc-45e0-ac2d-f732d93bcfa4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:11.956605 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc6797d-4513-425c-aea4-e4d5ae256b2d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:11.960535 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43562531-49cc-45e0-ac2d-f732d93bcfa4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:11.961939 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43562531-49cc-45e0-ac2d-f732d93bcfa4 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:11.974377 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-43562531-49cc-45e0-ac2d-f732d93bcfa4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:45:11.974377 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:11.974377 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:11.974377 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:11.974377 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:11.974377 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:11.974377 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:11.974377 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:11.974377 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:11.974377 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:11.974377 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:11.974377 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:11.974377 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:45:11.974377 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:45:11.974377 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:45:11.974377 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:45:11.975551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:11.975551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:11.975551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:11.975551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:11.975551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:11.975551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:11.975551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:11.975551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:11.975551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:11.975551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:11.975551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:11.975551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:11.975551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:11.975551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:11.975551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:11.975551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:11.975551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:11.975551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:11.976659 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:11.976659 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:11.976659 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:45:11.976659 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:45:11.976659 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:45:11.976659 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:45:11.976659 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:45:11.976659 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:45:11.976659 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:45:11.976659 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:11.979576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 517/1036] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Sep 13 19:45:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:11.984887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43562531-49cc-45e0-ac2d-f732d93bcfa4 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:11.997152 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62954ce9-151e-4bf9-a9b5-eec4c053fb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:11.998001 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62954ce9-151e-4bf9-a9b5-eec4c053fb9d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:11.998804 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62954ce9-151e-4bf9-a9b5-eec4c053fb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:11.999491 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62954ce9-151e-4bf9-a9b5-eec4c053fb9d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:12.000346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62954ce9-151e-4bf9-a9b5-eec4c053fb9d None admin] RBAC: Adding query filter params (interface=public, service_id=8eefcd70e782419c8b9b28f1c2e6c72d, region_id=RegionOne) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:12.001070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62954ce9-151e-4bf9-a9b5-eec4c053fb9d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:12.004110 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62954ce9-151e-4bf9-a9b5-eec4c053fb9d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:12.011101 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 520/1037] 10.222.0.59 () {56 vars in 1251 bytes} [Tue Sep 13 19:45:11 2022] GET /identity/v3/endpoints?service_id=8eefcd70e782419c8b9b28f1c2e6c72d&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:12.016344 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62954ce9-151e-4bf9-a9b5-eec4c053fb9d None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:12.088129 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43562531-49cc-45e0-ac2d-f732d93bcfa4 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:12.108873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:12.119649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62954ce9-151e-4bf9-a9b5-eec4c053fb9d None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:12.121869 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d48642-b36b-4af4-8075-25a9e5d8ed3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:12.122474 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d48642-b36b-4af4-8075-25a9e5d8ed3b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:12.122752 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d48642-b36b-4af4-8075-25a9e5d8ed3b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:12.123018 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d48642-b36b-4af4-8075-25a9e5d8ed3b None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:12.123728 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d48642-b36b-4af4-8075-25a9e5d8ed3b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:12.124048 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d48642-b36b-4af4-8075-25a9e5d8ed3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:12.125432 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d48642-b36b-4af4-8075-25a9e5d8ed3b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:12.151004 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 518/1038] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Sep 13 19:45:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:12.152591 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d48642-b36b-4af4-8075-25a9e5d8ed3b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:12.153626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c85c4-5ef5-41a0-b40b-2dd299e996c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:12.154259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c85c4-5ef5-41a0-b40b-2dd299e996c0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:12.154538 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c85c4-5ef5-41a0-b40b-2dd299e996c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:12.154809 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96c85c4-5ef5-41a0-b40b-2dd299e996c0 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:12.155635 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c85c4-5ef5-41a0-b40b-2dd299e996c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:12.157575 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96c85c4-5ef5-41a0-b40b-2dd299e996c0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:12.168396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 521/1039] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Sep 13 19:45:12 2022] GET /identity/v3/services => generated 1957 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:45:12.210952 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:12.267203 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d48642-b36b-4af4-8075-25a9e5d8ed3b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:12.306574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd600c8-b6da-4b6b-9a0c-b51de5867096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:12.307257 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd600c8-b6da-4b6b-9a0c-b51de5867096 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:12.307504 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd600c8-b6da-4b6b-9a0c-b51de5867096 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:12.307735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd600c8-b6da-4b6b-9a0c-b51de5867096 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:12.383396 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd600c8-b6da-4b6b-9a0c-b51de5867096 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:12.384831 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd600c8-b6da-4b6b-9a0c-b51de5867096 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:12.433641 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:12.484012 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 519/1040] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:12 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 19:45:12.490598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c85c4-5ef5-41a0-b40b-2dd299e996c0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:12.591390 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96c85c4-5ef5-41a0-b40b-2dd299e996c0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:12.626731 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e2cd7-f328-4594-bdaa-4ef3c57557a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:12.627649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e2cd7-f328-4594-bdaa-4ef3c57557a9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:12.628362 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e2cd7-f328-4594-bdaa-4ef3c57557a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:12.628809 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e2cd7-f328-4594-bdaa-4ef3c57557a9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:12.640270 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e2cd7-f328-4594-bdaa-4ef3c57557a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:12.642423 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8e2cd7-f328-4594-bdaa-4ef3c57557a9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:12.656910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-ec8e2cd7-f328-4594-bdaa-4ef3c57557a9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:12.656910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:12.656910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:12.656910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:12.656910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:12.656910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:12.656910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:12.656910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:12.656910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:12.656910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:12.656910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:12.656910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:12.656910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:12.656910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:12.656910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:12.656910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:12.658492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:12.658492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:12.658492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:12.658492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:12.658492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:12.658492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:12.658492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:12.658492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:12.658492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:12.658492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:12.658492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:12.658492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:12.658492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:12.658492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:12.658492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:12.658492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:12.658492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:12.659563 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:12.659563 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:12.659563 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:45:12.659563 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 522/1041] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:12.665067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd600c8-b6da-4b6b-9a0c-b51de5867096 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:12.766463 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd600c8-b6da-4b6b-9a0c-b51de5867096 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:12.801631 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05022a0-5032-4261-85bb-831575b24a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:12.802266 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05022a0-5032-4261-85bb-831575b24a84 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:12.802544 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05022a0-5032-4261-85bb-831575b24a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:12.802812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05022a0-5032-4261-85bb-831575b24a84 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:12.803445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05022a0-5032-4261-85bb-831575b24a84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:12.803746 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05022a0-5032-4261-85bb-831575b24a84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:12.805158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05022a0-5032-4261-85bb-831575b24a84 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:12.821246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 520/1042] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:12.822810 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e2cd7-f328-4594-bdaa-4ef3c57557a9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:12.833148 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:12.932805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e2cd7-f328-4594-bdaa-4ef3c57557a9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:12.966788 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e8a4f-410b-44ec-bf12-8c5d2ef122e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:12.967679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e8a4f-410b-44ec-bf12-8c5d2ef122e8 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:12.968100 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e8a4f-410b-44ec-bf12-8c5d2ef122e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:12.968521 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e8a4f-410b-44ec-bf12-8c5d2ef122e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:12.977378 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e8a4f-410b-44ec-bf12-8c5d2ef122e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:12.978988 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-445e8a4f-410b-44ec-bf12-8c5d2ef122e8 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:12.990446 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-445e8a4f-410b-44ec-bf12-8c5d2ef122e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:12.990446 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:12.990446 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:12.990446 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:12.990446 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:12.990446 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:12.990446 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:12.990446 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:12.990446 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:12.990446 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:12.990446 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:12.990446 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:12.990446 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:45:12.990446 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:45:12.990446 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:45:12.991487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:45:12.991487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:12.991487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:12.991487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:12.991487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:12.991487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:12.991487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:12.991487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:12.991487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:12.991487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:12.991487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:12.991487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:12.991487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:12.991487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:12.991487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:12.991487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:12.991487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:12.992617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:45:12.992617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:45:12.992617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:12.992617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:12.992617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:12.992617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:12.992617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:12.992617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:45:12.994304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 523/1043] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:13.000146 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05022a0-5032-4261-85bb-831575b24a84 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:13.014240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:13.104384 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05022a0-5032-4261-85bb-831575b24a84 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:13.140944 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfdc251-ef88-4dbd-b6bf-66a2c7f1ebea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:13.141553 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdc251-ef88-4dbd-b6bf-66a2c7f1ebea None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:13.141933 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdc251-ef88-4dbd-b6bf-66a2c7f1ebea None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:13.142701 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfdc251-ef88-4dbd-b6bf-66a2c7f1ebea None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:13.143384 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdc251-ef88-4dbd-b6bf-66a2c7f1ebea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:13.143688 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdc251-ef88-4dbd-b6bf-66a2c7f1ebea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:13.145099 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfdc251-ef88-4dbd-b6bf-66a2c7f1ebea None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:13.161881 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 521/1044] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:45:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:13.163414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e8a4f-410b-44ec-bf12-8c5d2ef122e8 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:13.221222 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa45c9-d1f7-4cd2-b097-5ce8c9c45c25 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:13.221540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa45c9-d1f7-4cd2-b097-5ce8c9c45c25 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:13.221822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efa45c9-d1f7-4cd2-b097-5ce8c9c45c25 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:13.225737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 522/1045] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:45:13.228262 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c1e11-bda1-4622-8181-199652e29d18 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:13.228550 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c1e11-bda1-4622-8181-199652e29d18 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:13.228825 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1c1e11-bda1-4622-8181-199652e29d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:13.233366 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:13.248441 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-0c1c1e11-bda1-4622-8181-199652e29d18 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:13.249798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0c1c1e11-bda1-4622-8181-199652e29d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:13.273401 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445e8a4f-410b-44ec-bf12-8c5d2ef122e8 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:13.308782 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5bd66-91ec-4f82-a02c-6ed9ff47ead3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:13.309387 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5bd66-91ec-4f82-a02c-6ed9ff47ead3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:13.309665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5bd66-91ec-4f82-a02c-6ed9ff47ead3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:13.309965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5bd66-91ec-4f82-a02c-6ed9ff47ead3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:13.310682 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5bd66-91ec-4f82-a02c-6ed9ff47ead3 None admin] RBAC: Adding query filter params (role.id=6a6942f029514d3ca77a5a30059bab3d, scope.project.id=ad67761fec0a430181877e216e90e7d4, user.id=3919b24291f54df99a9da0f5d3164ccf) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:13.310989 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5bd66-91ec-4f82-a02c-6ed9ff47ead3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:13.312410 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5bd66-91ec-4f82-a02c-6ed9ff47ead3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:13.317480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:13.318656 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 524/1046] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:45:13 2022] GET /identity/v3/role_assignments?user.id=3919b24291f54df99a9da0f5d3164ccf&scope.project.id=ad67761fec0a430181877e216e90e7d4&role.id=6a6942f029514d3ca77a5a30059bab3d => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:13.328629 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 523/1047] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:13 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:45:13.596992 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5bd66-91ec-4f82-a02c-6ed9ff47ead3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:13.698383 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5bd66-91ec-4f82-a02c-6ed9ff47ead3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:13.725981 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:13.732130 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134e5c6-b5a9-45ef-ae66-88c480cdb0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:13.732761 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134e5c6-b5a9-45ef-ae66-88c480cdb0c4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:13.733041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134e5c6-b5a9-45ef-ae66-88c480cdb0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:13.733312 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a134e5c6-b5a9-45ef-ae66-88c480cdb0c4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:13.744569 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a134e5c6-b5a9-45ef-ae66-88c480cdb0c4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:13.749451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-a134e5c6-b5a9-45ef-ae66-88c480cdb0c4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:13.749451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:13.749451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:13.749451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:13.749451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:13.749451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:13.749451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:13.749451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:13.749451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:13.749451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:13.749451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:13.749451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:13.749451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:13.749451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:13.749451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:13.749451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:13.750428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:13.750428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:13.750428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:13.750428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:13.750428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:13.750428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:13.750428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:13.750428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:13.750428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:13.750428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:13.750428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:13.750428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:13.750428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:13.750428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:13.750428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:13.750428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:13.754723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:13.754723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:13.754723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:13.754723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:13.754723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:13.754723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:13.754723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:13.754723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:13.754723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:13.754723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:13.754723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:13.754723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:45:13.754723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 525/1048] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:45:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:13.757747 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c1e11-bda1-4622-8181-199652e29d18 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:13.860182 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1c1e11-bda1-4622-8181-199652e29d18 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:13.901563 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af86845-7af6-4498-9cd2-4e0d63353255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:13.902209 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af86845-7af6-4498-9cd2-4e0d63353255 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:13.902491 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af86845-7af6-4498-9cd2-4e0d63353255 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:13.902764 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af86845-7af6-4498-9cd2-4e0d63353255 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:13.903426 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af86845-7af6-4498-9cd2-4e0d63353255 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:13.903729 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af86845-7af6-4498-9cd2-4e0d63353255 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:13.905119 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af86845-7af6-4498-9cd2-4e0d63353255 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:13.914160 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 524/1049] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:45:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:13.919883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134e5c6-b5a9-45ef-ae66-88c480cdb0c4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:14.021985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a134e5c6-b5a9-45ef-ae66-88c480cdb0c4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:14.055700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ba031f-8f20-4739-9b6e-1cb0f3840f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:14.056314 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba031f-8f20-4739-9b6e-1cb0f3840f26 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:14.056588 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba031f-8f20-4739-9b6e-1cb0f3840f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:14.056856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ba031f-8f20-4739-9b6e-1cb0f3840f26 None admin] PATH_INFO: `/v3/users/3ab189b9266a4ea49baeed48a66b3d13` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:14.070128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba031f-8f20-4739-9b6e-1cb0f3840f26 None admin] RBAC: Authorizing `identity:get_user(user_id=3ab189b9266a4ea49baeed48a66b3d13)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:14.071562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ba031f-8f20-4739-9b6e-1cb0f3840f26 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:14.073352 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 526/1050] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:45:13 2022] GET /identity/v3/users/3ab189b9266a4ea49baeed48a66b3d13 => generated 285 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:14.079002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af86845-7af6-4498-9cd2-4e0d63353255 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:14.143091 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:14.183390 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af86845-7af6-4498-9cd2-4e0d63353255 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:14.218252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b75f5-f745-4b64-a22f-7efb76ece3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:14.218861 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b75f5-f745-4b64-a22f-7efb76ece3a1 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:14.219142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b75f5-f745-4b64-a22f-7efb76ece3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:14.219415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b75f5-f745-4b64-a22f-7efb76ece3a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:14.291570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b75f5-f745-4b64-a22f-7efb76ece3a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:14.293042 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b75f5-f745-4b64-a22f-7efb76ece3a1 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:14.352553 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:14.355628 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649208eb-5742-4c00-9168-f7a0c929f6e3 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:14.355911 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649208eb-5742-4c00-9168-f7a0c929f6e3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:14.356181 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649208eb-5742-4c00-9168-f7a0c929f6e3 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:14.357706 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 527/1051] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:14.362467 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3936e5f-d31a-4bde-a6df-40418e0c7435 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:14.362756 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3936e5f-d31a-4bde-a6df-40418e0c7435 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:14.363029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3936e5f-d31a-4bde-a6df-40418e0c7435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:14.381417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f3936e5f-d31a-4bde-a6df-40418e0c7435 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:14.382633 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f3936e5f-d31a-4bde-a6df-40418e0c7435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:14.400399 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 525/1052] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:14 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:45:14.406553 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b75f5-f745-4b64-a22f-7efb76ece3a1 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:14.429622 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:14.453599 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 528/1053] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:45:14.505833 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b75f5-f745-4b64-a22f-7efb76ece3a1 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:14.539088 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70bc601-c940-4b90-be60-39a03a065865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:14.539717 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70bc601-c940-4b90-be60-39a03a065865 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:14.539994 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70bc601-c940-4b90-be60-39a03a065865 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:14.540261 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70bc601-c940-4b90-be60-39a03a065865 None admin] PATH_INFO: `/v3/projects/6f3f326e37a040b7a83ecb9fce82e85b` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:14.541353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70bc601-c940-4b90-be60-39a03a065865 None admin] RBAC: Authorizing `identity:get_project(project_id=6f3f326e37a040b7a83ecb9fce82e85b)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:14.542793 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70bc601-c940-4b90-be60-39a03a065865 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:14.544404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 526/1054] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:45:14 2022] GET /identity/v3/projects/6f3f326e37a040b7a83ecb9fce82e85b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:14.550787 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3936e5f-d31a-4bde-a6df-40418e0c7435 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:14.649589 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3936e5f-d31a-4bde-a6df-40418e0c7435 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:14.682375 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb10da7-6306-49f9-ae1a-a8af825c7112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:14.682912 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb10da7-6306-49f9-ae1a-a8af825c7112 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:14.683190 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb10da7-6306-49f9-ae1a-a8af825c7112 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:14.683462 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb10da7-6306-49f9-ae1a-a8af825c7112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:14.684177 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb10da7-6306-49f9-ae1a-a8af825c7112 None admin] RBAC: Adding query filter params (role.id=cd02ef2043de492a8bff6c165485f255, scope.project.id=6f3f326e37a040b7a83ecb9fce82e85b, user.id=3ab189b9266a4ea49baeed48a66b3d13) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:14.684483 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb10da7-6306-49f9-ae1a-a8af825c7112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:14.685935 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb10da7-6306-49f9-ae1a-a8af825c7112 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:14.697731 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 529/1055] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:45:14 2022] GET /identity/v3/role_assignments?user.id=3ab189b9266a4ea49baeed48a66b3d13&scope.project.id=6f3f326e37a040b7a83ecb9fce82e85b&role.id=cd02ef2043de492a8bff6c165485f255 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:14.724252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70bc601-c940-4b90-be60-39a03a065865 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:14.758230 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:14.832856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70bc601-c940-4b90-be60-39a03a065865 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:14.869889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136492e-ff09-47ee-b5fe-fdd2fce56308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:14.870516 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136492e-ff09-47ee-b5fe-fdd2fce56308 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:14.870798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136492e-ff09-47ee-b5fe-fdd2fce56308 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:14.871066 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d136492e-ff09-47ee-b5fe-fdd2fce56308 None admin] PATH_INFO: `/v3/services/image` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:14.872285 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136492e-ff09-47ee-b5fe-fdd2fce56308 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:14.873606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d136492e-ff09-47ee-b5fe-fdd2fce56308 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:14.883351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-d136492e-ff09-47ee-b5fe-fdd2fce56308 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:45:14.883351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:14.883351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:45:14.883351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:45:14.883351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:45:14.883351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:45:14.883351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:45:14.883351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:14.883351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:45:14.883351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:14.883351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:14.883351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:14.883351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:14.883351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:14.883351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:14.883351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:14.883351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:14.884394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:14.884394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:14.884394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:14.884394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:14.884394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:14.884394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:14.884394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:45:14.884394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:45:14.884394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:45:14.884394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:45:14.884394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:14.884394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:14.884394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:14.884394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:14.884394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:14.884394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:14.885252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:14.885252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:14.885252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:14.885252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:14.885252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:14.885252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:14.885252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:14.885252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:14.885252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:14.885252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:14.885252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:45:14.885252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:45:14.885252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 13 19:45:14.885252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:14.885252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 527/1056] 10.222.0.59 () {56 vars in 1105 bytes} [Tue Sep 13 19:45:14 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:14.893071 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb10da7-6306-49f9-ae1a-a8af825c7112 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:14.943169 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:15.004230 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb10da7-6306-49f9-ae1a-a8af825c7112 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:15.037261 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22b78e-7f0e-454a-a80e-f5f0985417be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:15.037893 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22b78e-7f0e-454a-a80e-f5f0985417be None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:15.038175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22b78e-7f0e-454a-a80e-f5f0985417be None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:15.038443 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22b78e-7f0e-454a-a80e-f5f0985417be None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:15.039066 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22b78e-7f0e-454a-a80e-f5f0985417be None admin] RBAC: Adding query filter params (name=image) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:15.039366 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22b78e-7f0e-454a-a80e-f5f0985417be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:15.040726 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd22b78e-7f0e-454a-a80e-f5f0985417be None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:15.050731 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 530/1057] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:15.052311 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136492e-ff09-47ee-b5fe-fdd2fce56308 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:15.145394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:15.152482 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d136492e-ff09-47ee-b5fe-fdd2fce56308 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:15.186306 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad63955-e95c-48c8-a6e6-ad6172ecba31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:15.186912 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad63955-e95c-48c8-a6e6-ad6172ecba31 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:15.187186 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad63955-e95c-48c8-a6e6-ad6172ecba31 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:15.187454 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad63955-e95c-48c8-a6e6-ad6172ecba31 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:15.188073 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad63955-e95c-48c8-a6e6-ad6172ecba31 None admin] RBAC: Adding query filter params (type=image) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:15.188369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad63955-e95c-48c8-a6e6-ad6172ecba31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:15.190380 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad63955-e95c-48c8-a6e6-ad6172ecba31 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:15.200034 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 528/1058] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:15.201491 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22b78e-7f0e-454a-a80e-f5f0985417be None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:15.300129 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd22b78e-7f0e-454a-a80e-f5f0985417be None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:15.307182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:15.334289 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c00d6be-560c-4968-b7bd-01b20b9a8d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:15.334973 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00d6be-560c-4968-b7bd-01b20b9a8d17 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:15.335254 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00d6be-560c-4968-b7bd-01b20b9a8d17 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:15.335523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c00d6be-560c-4968-b7bd-01b20b9a8d17 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:15.336222 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00d6be-560c-4968-b7bd-01b20b9a8d17 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:15.337640 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c00d6be-560c-4968-b7bd-01b20b9a8d17 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:15.441776 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 531/1059] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 19:45:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:15.457203 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28187c3-a5a2-4782-a6b8-ffe0a8e72b5b None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:15.457753 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28187c3-a5a2-4782-a6b8-ffe0a8e72b5b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:15.457753 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28187c3-a5a2-4782-a6b8-ffe0a8e72b5b None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:15.461737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 529/1060] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:15.464944 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bfa61-5e17-415b-af08-2e92c8a279d6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:15.465232 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bfa61-5e17-415b-af08-2e92c8a279d6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:15.465499 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3bfa61-5e17-415b-af08-2e92c8a279d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:15.485063 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-bd3bfa61-5e17-415b-af08-2e92c8a279d6 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:15.486971 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bd3bfa61-5e17-415b-af08-2e92c8a279d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:15.568779 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 532/1061] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:15.833499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28187c3-a5a2-4782-a6b8-ffe0a8e72b5b None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:15.945327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28187c3-a5a2-4782-a6b8-ffe0a8e72b5b None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:15.980155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd36d56-b4d0-447c-8be2-69d880a67bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:15.980789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd36d56-b4d0-447c-8be2-69d880a67bda None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:15.981069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd36d56-b4d0-447c-8be2-69d880a67bda None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:15.981342 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd36d56-b4d0-447c-8be2-69d880a67bda None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:15.992040 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd36d56-b4d0-447c-8be2-69d880a67bda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:15.996856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-6dd36d56-b4d0-447c-8be2-69d880a67bda None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:45:15.996856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:15.996856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:15.996856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:15.996856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:15.996856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:15.996856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:15.996856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:15.996856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:15.996856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:15.996856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:15.996856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:15.996856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:15.996856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:15.996856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:15.996856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:15.998069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:15.998069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:15.998069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:15.998069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:15.998069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:15.998069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:15.998069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:15.998069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:15.998069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:15.998069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:15.998069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:15.998069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:15.998069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:15.998069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:15.998069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:15.998069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:15.998953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:15.998953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:15.998953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:15.998953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:15.998953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:15.998953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:15.998953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:15.998953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:15.998953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:15.998953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:15.998953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:45:15.998953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:15.998953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 530/1062] 10.222.0.59 () {56 vars in 1120 bytes} [Tue Sep 13 19:45:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:16.006408 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bfa61-5e17-415b-af08-2e92c8a279d6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:16.093203 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:16.105248 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3bfa61-5e17-415b-af08-2e92c8a279d6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:16.139487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccd227-2349-45c9-9b10-9447f81074de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:16.140094 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccd227-2349-45c9-9b10-9447f81074de None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:16.140376 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccd227-2349-45c9-9b10-9447f81074de None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:16.140650 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ccd227-2349-45c9-9b10-9447f81074de None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:16.141310 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ccd227-2349-45c9-9b10-9447f81074de None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:16.141614 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ccd227-2349-45c9-9b10-9447f81074de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:16.143561 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ccd227-2349-45c9-9b10-9447f81074de None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:16.156260 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 533/1063] 10.222.0.59 () {56 vars in 1115 bytes} [Tue Sep 13 19:45:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:16.157544 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd36d56-b4d0-447c-8be2-69d880a67bda None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:16.177629 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:16.261115 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd36d56-b4d0-447c-8be2-69d880a67bda None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:16.294755 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c0b15-6d55-4ebc-b208-58541b5e849c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:16.295383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c0b15-6d55-4ebc-b208-58541b5e849c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:16.295716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c0b15-6d55-4ebc-b208-58541b5e849c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:16.295990 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555c0b15-6d55-4ebc-b208-58541b5e849c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:16.306568 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c0b15-6d55-4ebc-b208-58541b5e849c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:16.307997 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555c0b15-6d55-4ebc-b208-58541b5e849c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:16.322606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-555c0b15-6d55-4ebc-b208-58541b5e849c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:16.322606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:16.322606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:16.322606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:16.322606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:16.322606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:16.322606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:16.322606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:16.322606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:16.322606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:16.322606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:16.322606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:16.322606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:16.322606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:16.322606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:16.322606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:16.326223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:16.326223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:16.326223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:16.326223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:16.326223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:16.326223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:16.326223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:16.326223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:16.326223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:16.326223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:16.326223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:16.326223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:16.326223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:16.326223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:16.326223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:16.326223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:16.326223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:16.327170 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:16.327170 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:16.327170 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:16.327170 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 531/1064] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:16.329663 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccd227-2349-45c9-9b10-9447f81074de None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:16.435597 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ccd227-2349-45c9-9b10-9447f81074de None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:16.469267 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741ec2d-9922-4fbc-aab0-4199b47cd8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:16.469914 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741ec2d-9922-4fbc-aab0-4199b47cd8ee None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:16.470216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741ec2d-9922-4fbc-aab0-4199b47cd8ee None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:16.470493 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7741ec2d-9922-4fbc-aab0-4199b47cd8ee None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:16.471130 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741ec2d-9922-4fbc-aab0-4199b47cd8ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:16.471432 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741ec2d-9922-4fbc-aab0-4199b47cd8ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:16.472823 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7741ec2d-9922-4fbc-aab0-4199b47cd8ee None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:16.489679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 534/1065] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:16.491171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c0b15-6d55-4ebc-b208-58541b5e849c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:16.562115 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:16.593469 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555c0b15-6d55-4ebc-b208-58541b5e849c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:16.631739 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51f8f6-0e43-472b-b000-2c050d14b320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:16.632368 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51f8f6-0e43-472b-b000-2c050d14b320 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:16.632649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51f8f6-0e43-472b-b000-2c050d14b320 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:16.632922 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f51f8f6-0e43-472b-b000-2c050d14b320 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:16.640365 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51f8f6-0e43-472b-b000-2c050d14b320 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:16.641827 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f51f8f6-0e43-472b-b000-2c050d14b320 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:16.652950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-3f51f8f6-0e43-472b-b000-2c050d14b320 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:45:16.652950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:16.652950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:16.652950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:16.652950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:16.652950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:16.652950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:16.652950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:16.652950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:16.652950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:16.652950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:16.652950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:16.652950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:45:16.652950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:45:16.652950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:45:16.652950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:45:16.654036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:16.654036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:16.654036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:16.654036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:16.654036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:16.654036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:16.654036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:16.654036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:16.654036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:16.654036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:16.654036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:16.654036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:16.654036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:16.654036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:16.654036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:16.654036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:16.654036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:16.654036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:16.655026 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:16.655026 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:16.655026 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:45:16.655026 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:45:16.655026 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:45:16.655026 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:45:16.655026 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:45:16.655026 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:45:16.655026 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:45:16.655026 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:16.655026 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 532/1066] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Sep 13 19:45:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:16.659833 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741ec2d-9922-4fbc-aab0-4199b47cd8ee None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:16.672155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:16.765049 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7741ec2d-9922-4fbc-aab0-4199b47cd8ee None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:16.799771 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca37615-b4f0-4d9f-90b0-b820546526ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:16.800372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca37615-b4f0-4d9f-90b0-b820546526ea None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:16.800651 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca37615-b4f0-4d9f-90b0-b820546526ea None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:16.800918 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca37615-b4f0-4d9f-90b0-b820546526ea None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:16.801637 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca37615-b4f0-4d9f-90b0-b820546526ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:16.801968 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca37615-b4f0-4d9f-90b0-b820546526ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:16.803379 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca37615-b4f0-4d9f-90b0-b820546526ea None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:16.824998 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 535/1067] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Sep 13 19:45:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:16.826221 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51f8f6-0e43-472b-b000-2c050d14b320 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:16.849731 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a0254-1146-41e1-b017-5fb4faa8ade5 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:16.850051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a0254-1146-41e1-b017-5fb4faa8ade5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:16.850326 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a0254-1146-41e1-b017-5fb4faa8ade5 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:16.851650 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 536/1068] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:45:16.857179 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ba09d-fa67-4b35-a00a-3889a8d101a3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:16.857463 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ba09d-fa67-4b35-a00a-3889a8d101a3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:16.857756 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648ba09d-fa67-4b35-a00a-3889a8d101a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:16.876349 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-648ba09d-fa67-4b35-a00a-3889a8d101a3 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:16.877568 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-648ba09d-fa67-4b35-a00a-3889a8d101a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:16.940915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f51f8f6-0e43-472b-b000-2c050d14b320 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:16.943708 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:16.951841 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 537/1069] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:16.975856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:16.981626 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860813d4-94eb-4ad0-bf15-c262a8110e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:16.982281 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860813d4-94eb-4ad0-bf15-c262a8110e75 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:16.982565 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860813d4-94eb-4ad0-bf15-c262a8110e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:16.982838 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860813d4-94eb-4ad0-bf15-c262a8110e75 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:16.994249 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860813d4-94eb-4ad0-bf15-c262a8110e75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:16.995738 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860813d4-94eb-4ad0-bf15-c262a8110e75 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:17.010473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-860813d4-94eb-4ad0-bf15-c262a8110e75 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:17.010473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:17.010473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:17.010473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:17.010473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:17.010473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:17.010473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:17.010473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:17.010473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:17.010473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:17.010473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:17.010473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:17.010473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:17.010473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:17.010473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:17.010473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:17.011480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:17.011480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:17.011480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:17.011480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:17.011480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:17.011480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:17.011480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:17.011480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:17.011480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:17.011480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:17.011480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:17.011480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:17.011480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:17.011480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:17.011480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:17.011480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:17.011480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:17.012388 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:17.012388 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:17.012388 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:17.014071 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 533/1070] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:17.017583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ba09d-fa67-4b35-a00a-3889a8d101a3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:17.119706 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648ba09d-fa67-4b35-a00a-3889a8d101a3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:17.154305 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95494450-44cb-414f-ab97-9eb9181602c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:17.154905 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95494450-44cb-414f-ab97-9eb9181602c6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:17.155179 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95494450-44cb-414f-ab97-9eb9181602c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:17.155446 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95494450-44cb-414f-ab97-9eb9181602c6 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:17.156075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95494450-44cb-414f-ab97-9eb9181602c6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:17.156372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95494450-44cb-414f-ab97-9eb9181602c6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:17.157748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95494450-44cb-414f-ab97-9eb9181602c6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:17.169848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 538/1071] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:17.175481 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860813d4-94eb-4ad0-bf15-c262a8110e75 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:17.222720 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95494450-44cb-414f-ab97-9eb9181602c6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:17.283533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:17.284297 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860813d4-94eb-4ad0-bf15-c262a8110e75 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:17.318642 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df208e7d-ae56-4a5d-b880-b86ffabbb369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:17.319273 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df208e7d-ae56-4a5d-b880-b86ffabbb369 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:17.319550 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df208e7d-ae56-4a5d-b880-b86ffabbb369 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:17.319818 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df208e7d-ae56-4a5d-b880-b86ffabbb369 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:17.326474 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df208e7d-ae56-4a5d-b880-b86ffabbb369 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:17.328022 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df208e7d-ae56-4a5d-b880-b86ffabbb369 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:17.328127 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95494450-44cb-414f-ab97-9eb9181602c6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:17.342165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-df208e7d-ae56-4a5d-b880-b86ffabbb369 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:17.342165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:17.342165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:17.342165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:17.342165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:17.342165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:17.342165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:17.342165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:17.342165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:17.342165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:17.342165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:17.342165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:17.342165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:45:17.342165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:45:17.342165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:45:17.343132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:45:17.343132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:17.343132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:17.343132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:17.343132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:17.343132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:17.343132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:17.343132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:17.343132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:17.343132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:17.343132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:17.343132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:17.343132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:17.343132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:17.343132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:17.343132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:17.343132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:17.344056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:45:17.344056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:45:17.344056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:17.344056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:17.344056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:17.344056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:17.344056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:17.344056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:17.344056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 534/1072] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:17.349495 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df208e7d-ae56-4a5d-b880-b86ffabbb369 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:17.366296 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab0225-7b81-44fe-a8b9-6077b78070d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:17.367065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab0225-7b81-44fe-a8b9-6077b78070d9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:17.367374 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab0225-7b81-44fe-a8b9-6077b78070d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:17.367641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdab0225-7b81-44fe-a8b9-6077b78070d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:17.377877 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdab0225-7b81-44fe-a8b9-6077b78070d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:17.384261 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-cdab0225-7b81-44fe-a8b9-6077b78070d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:17.384261 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:17.384261 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:17.384261 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:17.384261 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:17.384261 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:17.384261 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:17.384261 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:17.384261 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:17.384261 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:17.384261 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:17.384261 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:17.384261 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:17.384261 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:17.384261 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:17.384261 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:17.385197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:17.385197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:17.385197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:17.385197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:17.385197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:17.385197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:17.385197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:17.385197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:17.385197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:17.385197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:17.385197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:17.385197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:17.385197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:17.385197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:17.385197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:17.385197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:17.386304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:17.386304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:17.386304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:17.386304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:17.386304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:17.386304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:17.386304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:17.386304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:17.386304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:17.386304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:17.386304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:17.386304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:45:17.386304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 539/1073] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:45:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:17.391250 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab0225-7b81-44fe-a8b9-6077b78070d9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:17.398806 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:17.460634 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df208e7d-ae56-4a5d-b880-b86ffabbb369 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:17.491460 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdab0225-7b81-44fe-a8b9-6077b78070d9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:17.496500 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510f24b-b912-41fb-80b9-e2569d64af1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:17.497751 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510f24b-b912-41fb-80b9-e2569d64af1e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:17.498213 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510f24b-b912-41fb-80b9-e2569d64af1e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:17.498772 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510f24b-b912-41fb-80b9-e2569d64af1e None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:17.499499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510f24b-b912-41fb-80b9-e2569d64af1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:17.499809 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510f24b-b912-41fb-80b9-e2569d64af1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:17.501424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510f24b-b912-41fb-80b9-e2569d64af1e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:17.510522 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:17.518033 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 535/1074] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:45:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:17.524052 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510f24b-b912-41fb-80b9-e2569d64af1e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:17.530362 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9056bd4-bfb9-4442-8a46-05869724304f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:17.532425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9056bd4-bfb9-4442-8a46-05869724304f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:17.532425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9056bd4-bfb9-4442-8a46-05869724304f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:17.532425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9056bd4-bfb9-4442-8a46-05869724304f None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:17.532425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9056bd4-bfb9-4442-8a46-05869724304f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:17.532425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9056bd4-bfb9-4442-8a46-05869724304f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:17.534162 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9056bd4-bfb9-4442-8a46-05869724304f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:17.543449 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 540/1075] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:45:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:17.549069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9056bd4-bfb9-4442-8a46-05869724304f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:17.631009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510f24b-b912-41fb-80b9-e2569d64af1e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:17.632553 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:17.651772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9056bd4-bfb9-4442-8a46-05869724304f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:17.666222 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb7c1cd-a728-4e94-bfdf-c3770c30de79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:17.666877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7c1cd-a728-4e94-bfdf-c3770c30de79 None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:17.667156 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7c1cd-a728-4e94-bfdf-c3770c30de79 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:17.667428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb7c1cd-a728-4e94-bfdf-c3770c30de79 None admin] PATH_INFO: `/v3/projects/ad67761fec0a430181877e216e90e7d4/users/3919b24291f54df99a9da0f5d3164ccf/roles/6a6942f029514d3ca77a5a30059bab3d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:17.669559 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb7c1cd-a728-4e94-bfdf-c3770c30de79 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad67761fec0a430181877e216e90e7d4, user_id=3919b24291f54df99a9da0f5d3164ccf, role_id=6a6942f029514d3ca77a5a30059bab3d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:17.671017 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb7c1cd-a728-4e94-bfdf-c3770c30de79 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:17.684380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c867bc3-2eca-47bb-8152-78760ed4df9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:17.684997 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c867bc3-2eca-47bb-8152-78760ed4df9d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:17.685271 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c867bc3-2eca-47bb-8152-78760ed4df9d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:17.685539 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c867bc3-2eca-47bb-8152-78760ed4df9d None admin] PATH_INFO: `/v3/users/3ab189b9266a4ea49baeed48a66b3d13` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:17.686714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c867bc3-2eca-47bb-8152-78760ed4df9d None admin] RBAC: Authorizing `identity:get_user(user_id=3ab189b9266a4ea49baeed48a66b3d13)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:17.688113 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c867bc3-2eca-47bb-8152-78760ed4df9d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:17.693305 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 541/1076] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:45:17 2022] GET /identity/v3/users/3ab189b9266a4ea49baeed48a66b3d13 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:17.693305 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f4a78-5828-440e-9433-9cb14b401375 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:17.693305 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f4a78-5828-440e-9433-9cb14b401375 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:17.693305 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152f4a78-5828-440e-9433-9cb14b401375 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:17.693305 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 542/1077] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:17.695962 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f4a78-5828-440e-9433-9cb14b401375 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:17.743587 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:17.774545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 536/1078] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Sep 13 19:45:17 2022] PUT /identity/v3/projects/ad67761fec0a430181877e216e90e7d4/users/3919b24291f54df99a9da0f5d3164ccf/roles/6a6942f029514d3ca77a5a30059bab3d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:45:17.787495 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd4591-d9ab-411f-ae32-84ed257c40d8 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:17.787719 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd4591-d9ab-411f-ae32-84ed257c40d8 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:17.788000 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbd4591-d9ab-411f-ae32-84ed257c40d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:17.794842 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152f4a78-5828-440e-9433-9cb14b401375 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:17.816634 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-2bbd4591-d9ab-411f-ae32-84ed257c40d8 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:17.817903 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2bbd4591-d9ab-411f-ae32-84ed257c40d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:17.834339 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5063d-e28b-4f31-8683-0dd359f4a39a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:17.835176 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5063d-e28b-4f31-8683-0dd359f4a39a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:17.835516 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5063d-e28b-4f31-8683-0dd359f4a39a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:17.835860 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae5063d-e28b-4f31-8683-0dd359f4a39a None admin] PATH_INFO: `/v3/projects/6f3f326e37a040b7a83ecb9fce82e85b` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:17.837132 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5063d-e28b-4f31-8683-0dd359f4a39a None admin] RBAC: Authorizing `identity:get_project(project_id=6f3f326e37a040b7a83ecb9fce82e85b)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:17.838765 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae5063d-e28b-4f31-8683-0dd359f4a39a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:17.845577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 543/1079] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:45:17 2022] GET /identity/v3/projects/6f3f326e37a040b7a83ecb9fce82e85b => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:17.846714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5063d-e28b-4f31-8683-0dd359f4a39a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:17.921727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 537/1080] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:17.968465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae5063d-e28b-4f31-8683-0dd359f4a39a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:17.985578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:18.004598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135200b2-ddb2-441d-af7b-47a80cf1de11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:18.005264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135200b2-ddb2-441d-af7b-47a80cf1de11 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:18.005543 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135200b2-ddb2-441d-af7b-47a80cf1de11 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:18.005849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135200b2-ddb2-441d-af7b-47a80cf1de11 None admin] PATH_INFO: `/v3/projects/6f3f326e37a040b7a83ecb9fce82e85b/users/3ab189b9266a4ea49baeed48a66b3d13/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:18.007824 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135200b2-ddb2-441d-af7b-47a80cf1de11 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f3f326e37a040b7a83ecb9fce82e85b, user_id=3ab189b9266a4ea49baeed48a66b3d13, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:18.009253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135200b2-ddb2-441d-af7b-47a80cf1de11 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:18.077036 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 544/1081] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Sep 13 19:45:17 2022] PUT /identity/v3/projects/6f3f326e37a040b7a83ecb9fce82e85b/users/3ab189b9266a4ea49baeed48a66b3d13/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:45:18.188869 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd4591-d9ab-411f-ae32-84ed257c40d8 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:18.287653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:18.296044 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbd4591-d9ab-411f-ae32-84ed257c40d8 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:18.330855 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1253c5-a460-42c8-bc63-c92ef8eb35df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:18.331396 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1253c5-a460-42c8-bc63-c92ef8eb35df None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:18.331673 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1253c5-a460-42c8-bc63-c92ef8eb35df None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:18.331942 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1253c5-a460-42c8-bc63-c92ef8eb35df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:18.399653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1253c5-a460-42c8-bc63-c92ef8eb35df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:18.401103 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1253c5-a460-42c8-bc63-c92ef8eb35df None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:18.491329 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:18.501457 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 538/1082] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:45:18.507383 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135200b2-ddb2-441d-af7b-47a80cf1de11 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:18.610749 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135200b2-ddb2-441d-af7b-47a80cf1de11 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:18.646546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c6f423-0264-410d-ba95-e1135600248e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:18.647172 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6f423-0264-410d-ba95-e1135600248e None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:18.647447 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6f423-0264-410d-ba95-e1135600248e None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:18.647714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c6f423-0264-410d-ba95-e1135600248e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:18.659561 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6f423-0264-410d-ba95-e1135600248e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:18.661039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c6f423-0264-410d-ba95-e1135600248e None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:18.677789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-10c6f423-0264-410d-ba95-e1135600248e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:18.677789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:18.677789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:18.677789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:18.677789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:18.677789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:18.677789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:18.677789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:18.677789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:18.677789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:18.677789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:18.677789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:18.677789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:18.677789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:18.677789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:18.677789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:18.678818 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:18.678818 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:18.678818 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:18.678818 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:18.678818 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:18.678818 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:18.678818 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:18.678818 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:18.678818 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:18.678818 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:18.678818 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:18.678818 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:18.678818 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:18.678818 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:18.678818 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:18.678818 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:18.678818 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:18.684599 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:18.684599 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:18.684599 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:45:18.684599 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 545/1083] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:18.684831 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1253c5-a460-42c8-bc63-c92ef8eb35df None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:18.784846 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1253c5-a460-42c8-bc63-c92ef8eb35df None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:18.818546 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb603ca-bcdc-4bb1-b547-15a77bf572c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:18.819146 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb603ca-bcdc-4bb1-b547-15a77bf572c8 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:18.819422 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb603ca-bcdc-4bb1-b547-15a77bf572c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:18.819691 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb603ca-bcdc-4bb1-b547-15a77bf572c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:18.820316 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb603ca-bcdc-4bb1-b547-15a77bf572c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:18.820610 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb603ca-bcdc-4bb1-b547-15a77bf572c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:18.821978 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb603ca-bcdc-4bb1-b547-15a77bf572c8 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:18.841229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 539/1084] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:19.935001 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e637347-0ca3-476f-8747-65822dce2998 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:19.935512 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e637347-0ca3-476f-8747-65822dce2998 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:19.935601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e637347-0ca3-476f-8747-65822dce2998 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:19.936873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 546/1085] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:19.942124 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28c018-20b2-4e31-b35f-ca287ccdabbe None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:19.942533 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28c018-20b2-4e31-b35f-ca287ccdabbe None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:19.942793 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d28c018-20b2-4e31-b35f-ca287ccdabbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:19.960646 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-7d28c018-20b2-4e31-b35f-ca287ccdabbe None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:19.961861 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7d28c018-20b2-4e31-b35f-ca287ccdabbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:20.007963 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:20.027206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 540/1086] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:20.202125 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93030312-0990-4569-9c34-b536d15926ad None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:20.202329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93030312-0990-4569-9c34-b536d15926ad None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:20.202599 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93030312-0990-4569-9c34-b536d15926ad None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:20.203995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 547/1087] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:20.209781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ea793-d7a9-4220-bc04-33c1b90bf78c None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:20.210073 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ea793-d7a9-4220-bc04-33c1b90bf78c None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:20.210351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003ea793-d7a9-4220-bc04-33c1b90bf78c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:20.228691 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-003ea793-d7a9-4220-bc04-33c1b90bf78c None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:20.229899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-003ea793-d7a9-4220-bc04-33c1b90bf78c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:20.295565 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93030312-0990-4569-9c34-b536d15926ad None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:20.300201 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 541/1088] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:20.325474 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:20.396243 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93030312-0990-4569-9c34-b536d15926ad None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:20.428476 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41af55-f492-47de-b77d-6b509b9ac5de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:20.429101 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41af55-f492-47de-b77d-6b509b9ac5de None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:20.429642 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41af55-f492-47de-b77d-6b509b9ac5de None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:20.430204 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b41af55-f492-47de-b77d-6b509b9ac5de None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:20.440797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b41af55-f492-47de-b77d-6b509b9ac5de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:20.445673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-3b41af55-f492-47de-b77d-6b509b9ac5de None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:45:20.445673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:20.445673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:20.445673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:20.445673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:20.445673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:20.445673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:20.445673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:20.445673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:20.445673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:20.445673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:20.445673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:20.445673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:20.445673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:20.445673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:20.445673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:20.446888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:20.446888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:20.446888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:20.446888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:20.446888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:20.446888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:20.446888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:20.446888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:20.446888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:20.446888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:20.446888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:20.446888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:20.446888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:20.446888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:20.446888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:20.446888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:20.448236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:20.448236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:20.448236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:20.448236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:20.448236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:20.448236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:20.448236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:20.448236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:20.448236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:20.448236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:20.448236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 13 19:45:20.448236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:45:20.448236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 548/1089] 10.222.0.59 () {56 vars in 1120 bytes} [Tue Sep 13 19:45:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:20.457264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ea793-d7a9-4220-bc04-33c1b90bf78c None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:20.550606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003ea793-d7a9-4220-bc04-33c1b90bf78c None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:20.563176 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:20.567474 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41af55-f492-47de-b77d-6b509b9ac5de None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:20.584332 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0316e-1678-41d4-8a03-7acf94641fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:20.584932 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0316e-1678-41d4-8a03-7acf94641fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:20.585206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0316e-1678-41d4-8a03-7acf94641fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:20.585471 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b0316e-1678-41d4-8a03-7acf94641fd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:20.586153 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0316e-1678-41d4-8a03-7acf94641fd2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:20.586448 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0316e-1678-41d4-8a03-7acf94641fd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:20.587829 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b0316e-1678-41d4-8a03-7acf94641fd2 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:20.596293 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 542/1090] 10.222.0.59 () {56 vars in 1115 bytes} [Tue Sep 13 19:45:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:20.601984 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0316e-1678-41d4-8a03-7acf94641fd2 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:20.658632 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:20.670215 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b41af55-f492-47de-b77d-6b509b9ac5de None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:20.699581 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b0316e-1678-41d4-8a03-7acf94641fd2 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:20.703453 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4aa08-0d8f-4547-984b-079c17c3896a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:20.704067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4aa08-0d8f-4547-984b-079c17c3896a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:20.704340 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4aa08-0d8f-4547-984b-079c17c3896a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:20.704604 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc4aa08-0d8f-4547-984b-079c17c3896a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:20.715683 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc4aa08-0d8f-4547-984b-079c17c3896a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:20.720395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-2cc4aa08-0d8f-4547-984b-079c17c3896a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:20.720395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:20.720395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:20.720395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:20.720395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:20.720395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:20.720395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:20.720395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:20.720395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:20.720395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:20.720395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:20.720395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:20.720395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:20.720395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:20.720395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:20.720395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:20.721583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:20.721583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:20.721583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:20.721583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:20.721583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:20.721583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:20.721583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:20.721583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:20.721583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:20.721583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:20.721583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:20.721583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:20.721583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:20.721583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:20.721583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:20.721583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:20.722524 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:20.722524 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:20.722524 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:20.722524 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:20.722524 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:20.722524 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:20.722524 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:20.722524 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:20.722524 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:20.722524 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:20.722524 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:20.722524 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:45:20.722524 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 549/1091] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:45:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:20.727451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4aa08-0d8f-4547-984b-079c17c3896a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:20.736836 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd81110-0d7d-4d1a-b3fb-6acab80a08b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:20.737466 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd81110-0d7d-4d1a-b3fb-6acab80a08b2 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:20.737776 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd81110-0d7d-4d1a-b3fb-6acab80a08b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:20.738052 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd81110-0d7d-4d1a-b3fb-6acab80a08b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:20.748392 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd81110-0d7d-4d1a-b3fb-6acab80a08b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:20.749839 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd81110-0d7d-4d1a-b3fb-6acab80a08b2 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:20.764508 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-dcd81110-0d7d-4d1a-b3fb-6acab80a08b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:20.764508 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:20.764508 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:20.764508 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:20.764508 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:20.764508 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:20.764508 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:20.764508 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:20.764508 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:20.764508 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:20.764508 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:20.764508 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:20.764508 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:20.764508 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:20.764508 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:20.764508 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:20.765656 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:20.765656 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:20.765656 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:20.765656 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:20.765656 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:20.765656 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:20.765656 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:20.765656 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:20.765656 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:20.765656 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:20.765656 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:20.765656 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:20.765656 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:20.765656 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:20.765656 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:20.765656 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:20.765656 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:20.767035 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:20.767035 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:20.767035 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:20.767035 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 543/1092] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:20.771681 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd81110-0d7d-4d1a-b3fb-6acab80a08b2 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:20.798136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:20.826638 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc4aa08-0d8f-4547-984b-079c17c3896a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:20.859339 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176e290-6123-4bd1-a09f-18c2f5a6e8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:20.859934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176e290-6123-4bd1-a09f-18c2f5a6e8b3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:20.860210 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176e290-6123-4bd1-a09f-18c2f5a6e8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:20.860482 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176e290-6123-4bd1-a09f-18c2f5a6e8b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:20.861137 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176e290-6123-4bd1-a09f-18c2f5a6e8b3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:20.861989 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176e290-6123-4bd1-a09f-18c2f5a6e8b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:20.863336 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4176e290-6123-4bd1-a09f-18c2f5a6e8b3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:20.870081 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd81110-0d7d-4d1a-b3fb-6acab80a08b2 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:20.871558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 550/1093] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:45:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:20.878379 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176e290-6123-4bd1-a09f-18c2f5a6e8b3 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:20.891410 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:20.905605 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfce461-950e-4623-92a4-1b1ea26b412c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:20.906322 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfce461-950e-4623-92a4-1b1ea26b412c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:20.906596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfce461-950e-4623-92a4-1b1ea26b412c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:20.906870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfce461-950e-4623-92a4-1b1ea26b412c None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:20.907530 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfce461-950e-4623-92a4-1b1ea26b412c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:20.907829 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfce461-950e-4623-92a4-1b1ea26b412c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:20.909176 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfce461-950e-4623-92a4-1b1ea26b412c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:20.920612 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 544/1094] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:20.926651 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfce461-950e-4623-92a4-1b1ea26b412c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:20.978934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176e290-6123-4bd1-a09f-18c2f5a6e8b3 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:21.010104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:21.012759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65f17d-54f3-4ed0-8ca6-b3ac95d2f6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:21.013375 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65f17d-54f3-4ed0-8ca6-b3ac95d2f6bf None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:21.013654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65f17d-54f3-4ed0-8ca6-b3ac95d2f6bf None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:21.013944 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c65f17d-54f3-4ed0-8ca6-b3ac95d2f6bf None admin] PATH_INFO: `/v3/users/3ab189b9266a4ea49baeed48a66b3d13` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:21.015050 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65f17d-54f3-4ed0-8ca6-b3ac95d2f6bf None admin] RBAC: Authorizing `identity:get_user(user_id=3ab189b9266a4ea49baeed48a66b3d13)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:21.016458 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c65f17d-54f3-4ed0-8ca6-b3ac95d2f6bf None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:21.018067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 551/1095] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:45:20 2022] GET /identity/v3/users/3ab189b9266a4ea49baeed48a66b3d13 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:21.024730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfce461-950e-4623-92a4-1b1ea26b412c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:21.029787 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65f17d-54f3-4ed0-8ca6-b3ac95d2f6bf None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:21.059767 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba4d77-a48d-4d9c-88cc-b2be06269ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:21.060386 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba4d77-a48d-4d9c-88cc-b2be06269ecb None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:21.060661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba4d77-a48d-4d9c-88cc-b2be06269ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:21.060927 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba4d77-a48d-4d9c-88cc-b2be06269ecb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:21.068354 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba4d77-a48d-4d9c-88cc-b2be06269ecb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:21.069813 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba4d77-a48d-4d9c-88cc-b2be06269ecb None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:21.081101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-ccba4d77-a48d-4d9c-88cc-b2be06269ecb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:45:21.081101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:21.081101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:21.081101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:21.081101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:21.081101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:21.081101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:21.081101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:21.081101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:21.081101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:21.081101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:21.081101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:21.081101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:45:21.081101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:45:21.081101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:45:21.081101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:45:21.082171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:21.082171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:21.082171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:45:21.082171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:21.082171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:45:21.082171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:45:21.082171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:21.082171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:21.082171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:21.082171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:21.082171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:21.082171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:21.082171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:21.082171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:21.082171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:21.082171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:21.082171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:21.082171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:21.083253 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:21.083253 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:21.083253 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:45:21.083253 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:45:21.083253 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:45:21.083253 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:45:21.083253 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:45:21.083253 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:45:21.083253 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 13 19:45:21.083253 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:21.083253 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 545/1096] 10.222.0.59 () {56 vars in 1093 bytes} [Tue Sep 13 19:45:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:21.087923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba4d77-a48d-4d9c-88cc-b2be06269ecb None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:21.109182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:21.130876 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c65f17d-54f3-4ed0-8ca6-b3ac95d2f6bf None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:21.163846 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebe39a-285c-4f99-802e-c8fc051a34ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:21.164442 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebe39a-285c-4f99-802e-c8fc051a34ac None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:21.164724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebe39a-285c-4f99-802e-c8fc051a34ac None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:21.164992 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bebe39a-285c-4f99-802e-c8fc051a34ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:21.184675 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba4d77-a48d-4d9c-88cc-b2be06269ecb None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:21.217196 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368eeb0-e771-45cd-9cbb-99ae6d76594c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:21.217819 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368eeb0-e771-45cd-9cbb-99ae6d76594c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:21.218103 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368eeb0-e771-45cd-9cbb-99ae6d76594c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:21.218369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368eeb0-e771-45cd-9cbb-99ae6d76594c None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:21.219073 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368eeb0-e771-45cd-9cbb-99ae6d76594c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:21.219374 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368eeb0-e771-45cd-9cbb-99ae6d76594c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:21.220775 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2368eeb0-e771-45cd-9cbb-99ae6d76594c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:21.230888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebe39a-285c-4f99-802e-c8fc051a34ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:21.232317 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bebe39a-285c-4f99-802e-c8fc051a34ac None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:21.237832 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 546/1097] 10.222.0.59 () {56 vars in 1133 bytes} [Tue Sep 13 19:45:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:21.243480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368eeb0-e771-45cd-9cbb-99ae6d76594c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:21.246867 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:21.309185 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:21.330868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 552/1098] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 19:45:21.336829 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebe39a-285c-4f99-802e-c8fc051a34ac None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:21.341126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2368eeb0-e771-45cd-9cbb-99ae6d76594c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:21.375883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003289b0-1eec-4283-b432-06a07b187546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:21.376480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003289b0-1eec-4283-b432-06a07b187546 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:21.376757 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003289b0-1eec-4283-b432-06a07b187546 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:21.377052 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003289b0-1eec-4283-b432-06a07b187546 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:21.432774 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bebe39a-285c-4f99-802e-c8fc051a34ac None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:21.442594 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003289b0-1eec-4283-b432-06a07b187546 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:21.444038 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003289b0-1eec-4283-b432-06a07b187546 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:21.447045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:21.465751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41183930-3cbd-4e4e-a475-d449024ea9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:21.466378 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41183930-3cbd-4e4e-a475-d449024ea9cd None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:21.466659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41183930-3cbd-4e4e-a475-d449024ea9cd None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:21.466932 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41183930-3cbd-4e4e-a475-d449024ea9cd None admin] PATH_INFO: `/v3/projects/6f3f326e37a040b7a83ecb9fce82e85b` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:21.468099 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41183930-3cbd-4e4e-a475-d449024ea9cd None admin] RBAC: Authorizing `identity:get_project(project_id=6f3f326e37a040b7a83ecb9fce82e85b)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:21.469517 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41183930-3cbd-4e4e-a475-d449024ea9cd None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:21.476676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 553/1099] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:45:21 2022] GET /identity/v3/projects/6f3f326e37a040b7a83ecb9fce82e85b => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:45:21.477624 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41183930-3cbd-4e4e-a475-d449024ea9cd None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:21.523150 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:21.541572 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 547/1100] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 13 19:45:21.547422 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003289b0-1eec-4283-b432-06a07b187546 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:21.574704 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41183930-3cbd-4e4e-a475-d449024ea9cd None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:21.607975 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fd927-ec86-44db-b486-5435f5fb009f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:21.608560 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fd927-ec86-44db-b486-5435f5fb009f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:21.608833 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fd927-ec86-44db-b486-5435f5fb009f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:21.609100 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fd927-ec86-44db-b486-5435f5fb009f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:21.609837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fd927-ec86-44db-b486-5435f5fb009f None admin] RBAC: Adding query filter params (role.id=cd02ef2043de492a8bff6c165485f255, scope.project.id=6f3f326e37a040b7a83ecb9fce82e85b, user.id=3ab189b9266a4ea49baeed48a66b3d13) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:21.610139 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fd927-ec86-44db-b486-5435f5fb009f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:21.612098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fd927-ec86-44db-b486-5435f5fb009f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:21.617660 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 554/1101] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:45:21 2022] GET /identity/v3/role_assignments?user.id=3ab189b9266a4ea49baeed48a66b3d13&scope.project.id=6f3f326e37a040b7a83ecb9fce82e85b&role.id=cd02ef2043de492a8bff6c165485f255 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:21.645428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003289b0-1eec-4283-b432-06a07b187546 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:21.648106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:21.683355 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a14e6-b1b4-401f-94a0-67d90ae0c83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:21.684004 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a14e6-b1b4-401f-94a0-67d90ae0c83f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:21.684283 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a14e6-b1b4-401f-94a0-67d90ae0c83f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:21.684556 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5a14e6-b1b4-401f-94a0-67d90ae0c83f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:21.695716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a14e6-b1b4-401f-94a0-67d90ae0c83f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:21.697185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5a14e6-b1b4-401f-94a0-67d90ae0c83f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:21.713421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-7e5a14e6-b1b4-401f-94a0-67d90ae0c83f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:21.713421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:21.713421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:21.713421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:21.713421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:21.713421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:21.713421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:21.713421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:21.713421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:21.713421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:21.713421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:21.713421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:21.713421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:21.713421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:21.713421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:21.713421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:21.714614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:21.714614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:21.714614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:21.714614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:21.714614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:21.714614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:21.714614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:21.714614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:21.714614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:21.714614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:21.714614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:21.714614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:21.714614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:21.714614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:21.714614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:21.714614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:21.714614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:45:21.715894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:21.715894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:45:21.715894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:21.715894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 548/1102] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:45:21.720472 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fd927-ec86-44db-b486-5435f5fb009f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:21.822786 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fd927-ec86-44db-b486-5435f5fb009f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:21.833438 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:21.856409 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6c782-81e7-4ff7-8063-03535d8c6fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:21.857054 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6c782-81e7-4ff7-8063-03535d8c6fd4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:21.857307 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6c782-81e7-4ff7-8063-03535d8c6fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:21.857579 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f6c782-81e7-4ff7-8063-03535d8c6fd4 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:21.858250 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6c782-81e7-4ff7-8063-03535d8c6fd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:21.858555 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6c782-81e7-4ff7-8063-03535d8c6fd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:21.859944 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f6c782-81e7-4ff7-8063-03535d8c6fd4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:21.872159 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 555/1103] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:45:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:21.878030 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a14e6-b1b4-401f-94a0-67d90ae0c83f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:21.976755 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5a14e6-b1b4-401f-94a0-67d90ae0c83f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:22.010747 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51814093-1ac4-4b38-975a-12d61e647612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:22.011379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814093-1ac4-4b38-975a-12d61e647612 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:22.011653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814093-1ac4-4b38-975a-12d61e647612 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:22.011924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51814093-1ac4-4b38-975a-12d61e647612 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:22.018529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51814093-1ac4-4b38-975a-12d61e647612 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:22.019951 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51814093-1ac4-4b38-975a-12d61e647612 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:22.031085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-51814093-1ac4-4b38-975a-12d61e647612 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:22.031085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:22.031085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:22.031085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:22.031085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:22.031085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:22.031085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:22.031085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:22.031085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:22.031085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:22.031085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:22.031085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:22.031085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:45:22.031085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:45:22.031085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:45:22.032192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:45:22.032192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:22.032192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:22.032192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:22.032192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:22.032192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:22.032192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:22.032192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:22.032192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:22.032192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:22.032192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:22.032192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:22.032192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:22.032192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:22.032192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:22.032192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:22.032192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:22.033653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:45:22.033653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:45:22.033653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:22.033653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:22.033653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:22.033653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:22.033653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:45:22.033653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:22.033653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 549/1104] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:45:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:22.038558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6c782-81e7-4ff7-8063-03535d8c6fd4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:22.137048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f6c782-81e7-4ff7-8063-03535d8c6fd4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:22.170282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a20be8-d812-46ec-9431-654d8b7a27cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:22.170878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a20be8-d812-46ec-9431-654d8b7a27cb None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:22.171151 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a20be8-d812-46ec-9431-654d8b7a27cb None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:22.171417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a20be8-d812-46ec-9431-654d8b7a27cb None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:22.172094 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a20be8-d812-46ec-9431-654d8b7a27cb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:22.172390 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a20be8-d812-46ec-9431-654d8b7a27cb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:22.174461 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a20be8-d812-46ec-9431-654d8b7a27cb None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:22.185705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 556/1105] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:45:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:22.191749 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51814093-1ac4-4b38-975a-12d61e647612 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:22.210046 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:22.289591 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51814093-1ac4-4b38-975a-12d61e647612 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:22.323114 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e16031-6cc0-41bd-9366-310d4dfcf889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:22.323713 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e16031-6cc0-41bd-9366-310d4dfcf889 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:22.323993 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e16031-6cc0-41bd-9366-310d4dfcf889 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:22.324264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e16031-6cc0-41bd-9366-310d4dfcf889 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:22.324978 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e16031-6cc0-41bd-9366-310d4dfcf889 None admin] RBAC: Adding query filter params (role.id=6a6942f029514d3ca77a5a30059bab3d, scope.project.id=ad67761fec0a430181877e216e90e7d4, user.id=3919b24291f54df99a9da0f5d3164ccf) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:22.325283 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e16031-6cc0-41bd-9366-310d4dfcf889 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:22.326725 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e16031-6cc0-41bd-9366-310d4dfcf889 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:22.332460 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 550/1106] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:45:22 2022] GET /identity/v3/role_assignments?user.id=3919b24291f54df99a9da0f5d3164ccf&scope.project.id=ad67761fec0a430181877e216e90e7d4&role.id=6a6942f029514d3ca77a5a30059bab3d => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:23.768876 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241759d-ada9-4c58-ba98-709acdf11859 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:23.769440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241759d-ada9-4c58-ba98-709acdf11859 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:23.769440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241759d-ada9-4c58-ba98-709acdf11859 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:23.770782 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 557/1107] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:23.775884 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e742d9-8eea-477c-9210-fd76f7c21116 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:23.776269 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e742d9-8eea-477c-9210-fd76f7c21116 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:23.776438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e742d9-8eea-477c-9210-fd76f7c21116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:23.795353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-23e742d9-8eea-477c-9210-fd76f7c21116 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:23.796529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-23e742d9-8eea-477c-9210-fd76f7c21116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:23.859867 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 551/1108] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:24.128858 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241759d-ada9-4c58-ba98-709acdf11859 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:24.158468 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:24.227182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241759d-ada9-4c58-ba98-709acdf11859 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:24.260010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ca97f3-5232-4942-9b2f-d0ef1d59e1d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:24.260623 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca97f3-5232-4942-9b2f-d0ef1d59e1d5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:24.260902 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca97f3-5232-4942-9b2f-d0ef1d59e1d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:24.261173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ca97f3-5232-4942-9b2f-d0ef1d59e1d5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:24.262291 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca97f3-5232-4942-9b2f-d0ef1d59e1d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:24.263710 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ca97f3-5232-4942-9b2f-d0ef1d59e1d5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:24.265244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 558/1109] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:24.270857 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e742d9-8eea-477c-9210-fd76f7c21116 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:24.282061 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:24.367179 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e742d9-8eea-477c-9210-fd76f7c21116 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:24.399144 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2898070-9496-440e-9ced-9cc5c7a7ee2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:24.399678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2898070-9496-440e-9ced-9cc5c7a7ee2b None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:24.399950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2898070-9496-440e-9ced-9cc5c7a7ee2b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:24.400215 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2898070-9496-440e-9ced-9cc5c7a7ee2b None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:24.400859 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2898070-9496-440e-9ced-9cc5c7a7ee2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:24.402288 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2898070-9496-440e-9ced-9cc5c7a7ee2b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:24.477660 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 552/1110] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Sep 13 19:45:24 2022] POST /identity/v3/users => generated 286 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:26.635691 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ade61e-8e01-4c11-8780-fbc29226b6fb None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:26.636210 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ade61e-8e01-4c11-8780-fbc29226b6fb None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:26.636338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ade61e-8e01-4c11-8780-fbc29226b6fb None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:26.637577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 559/1111] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:26.642675 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a581b82-847f-4262-b3bb-03b3cc83a85e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:26.643633 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a581b82-847f-4262-b3bb-03b3cc83a85e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:26.643834 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a581b82-847f-4262-b3bb-03b3cc83a85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:26.661511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-9a581b82-847f-4262-b3bb-03b3cc83a85e None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:26.662707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9a581b82-847f-4262-b3bb-03b3cc83a85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:26.718905 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:26.725854 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 553/1112] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:26.990706 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ade61e-8e01-4c11-8780-fbc29226b6fb None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:27.086657 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:27.091220 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ade61e-8e01-4c11-8780-fbc29226b6fb None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:27.124062 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b960c-7f07-43bd-aff6-046bae74e2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:27.124673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b960c-7f07-43bd-aff6-046bae74e2eb None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:27.124951 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b960c-7f07-43bd-aff6-046bae74e2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:27.125222 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069b960c-7f07-43bd-aff6-046bae74e2eb None admin] PATH_INFO: `/v3/roles/d520f560be6d45539a966c6de2a934e7` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:27.126619 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b960c-7f07-43bd-aff6-046bae74e2eb None admin] RBAC: Authorizing `identity:get_role(role_id=d520f560be6d45539a966c6de2a934e7)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:27.128575 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069b960c-7f07-43bd-aff6-046bae74e2eb None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:27.130155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 560/1113] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:45:26 2022] GET /identity/v3/roles/d520f560be6d45539a966c6de2a934e7 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:27.135932 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a581b82-847f-4262-b3bb-03b3cc83a85e None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:27.230029 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a581b82-847f-4262-b3bb-03b3cc83a85e None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:27.263054 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a237849-4ee0-479a-a781-e4454fd1d6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:27.263667 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a237849-4ee0-479a-a781-e4454fd1d6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:27.264116 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a237849-4ee0-479a-a781-e4454fd1d6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:27.264230 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a237849-4ee0-479a-a781-e4454fd1d6d6 None admin] PATH_INFO: `/v3/users/a95b248e4d8b415388e1b5865da207ef` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:27.276741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a237849-4ee0-479a-a781-e4454fd1d6d6 None admin] RBAC: Authorizing `identity:get_user(user_id=a95b248e4d8b415388e1b5865da207ef)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:27.278188 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a237849-4ee0-479a-a781-e4454fd1d6d6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:27.279739 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 554/1114] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:45:27 2022] GET /identity/v3/users/a95b248e4d8b415388e1b5865da207ef => generated 286 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:27.285906 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b960c-7f07-43bd-aff6-046bae74e2eb None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:27.381105 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069b960c-7f07-43bd-aff6-046bae74e2eb None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:27.413211 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e05b52-a28f-49e0-a0c0-c150dfac7e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:27.413817 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e05b52-a28f-49e0-a0c0-c150dfac7e1f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:27.414092 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e05b52-a28f-49e0-a0c0-c150dfac7e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:27.414354 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e05b52-a28f-49e0-a0c0-c150dfac7e1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:27.446214 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:27.477740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e05b52-a28f-49e0-a0c0-c150dfac7e1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:27.479157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e05b52-a28f-49e0-a0c0-c150dfac7e1f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:27.573433 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 561/1115] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:45:27.579549 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a237849-4ee0-479a-a781-e4454fd1d6d6 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:27.634596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:27.678868 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a237849-4ee0-479a-a781-e4454fd1d6d6 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:27.711395 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d0370b-061f-40c9-a09e-252a0f67ba23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:27.712011 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0370b-061f-40c9-a09e-252a0f67ba23 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:27.712286 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0370b-061f-40c9-a09e-252a0f67ba23 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:27.712605 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d0370b-061f-40c9-a09e-252a0f67ba23 None admin] PATH_INFO: `/v3/projects/6f3f326e37a040b7a83ecb9fce82e85b` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:27.713636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d0370b-061f-40c9-a09e-252a0f67ba23 None admin] RBAC: Authorizing `identity:get_project(project_id=6f3f326e37a040b7a83ecb9fce82e85b)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:27.715122 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d0370b-061f-40c9-a09e-252a0f67ba23 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:27.716702 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 555/1116] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:45:27 2022] GET /identity/v3/projects/6f3f326e37a040b7a83ecb9fce82e85b => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:27.722878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e05b52-a28f-49e0-a0c0-c150dfac7e1f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:27.786777 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:27.819561 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e05b52-a28f-49e0-a0c0-c150dfac7e1f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:27.852209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68eac97-b41c-4f46-86d1-353a404f0d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:27.852732 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68eac97-b41c-4f46-86d1-353a404f0d33 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:27.853009 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68eac97-b41c-4f46-86d1-353a404f0d33 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:27.853277 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68eac97-b41c-4f46-86d1-353a404f0d33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:27.854055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68eac97-b41c-4f46-86d1-353a404f0d33 None admin] RBAC: Adding query filter params (role.id=d520f560be6d45539a966c6de2a934e7, scope.project.id=6f3f326e37a040b7a83ecb9fce82e85b, user.id=a95b248e4d8b415388e1b5865da207ef) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:27.854352 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68eac97-b41c-4f46-86d1-353a404f0d33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:27.855766 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68eac97-b41c-4f46-86d1-353a404f0d33 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:27.860969 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 562/1117] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:45:27 2022] GET /identity/v3/role_assignments?user.id=a95b248e4d8b415388e1b5865da207ef&scope.project.id=6f3f326e37a040b7a83ecb9fce82e85b&role.id=d520f560be6d45539a966c6de2a934e7 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:29.959259 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803adaed-03fe-4915-883d-82caae0b5097 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:29.959762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803adaed-03fe-4915-883d-82caae0b5097 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:29.959860 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803adaed-03fe-4915-883d-82caae0b5097 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:29.961178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 556/1118] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:29.966427 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7624d4-38f7-4648-a61d-c0816d386338 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:29.966833 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7624d4-38f7-4648-a61d-c0816d386338 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:29.966963 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7624d4-38f7-4648-a61d-c0816d386338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:29.985029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7c7624d4-38f7-4648-a61d-c0816d386338 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:29.986224 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7c7624d4-38f7-4648-a61d-c0816d386338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:30.050203 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 563/1119] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:30.319731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803adaed-03fe-4915-883d-82caae0b5097 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:30.417888 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803adaed-03fe-4915-883d-82caae0b5097 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:30.440455 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:30.451373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec0937-0599-4919-9da3-a13000180c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:30.451986 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec0937-0599-4919-9da3-a13000180c4d None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:30.452263 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec0937-0599-4919-9da3-a13000180c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:30.452532 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ec0937-0599-4919-9da3-a13000180c4d None admin] PATH_INFO: `/v3/roles/d520f560be6d45539a966c6de2a934e7` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:30.453929 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec0937-0599-4919-9da3-a13000180c4d None admin] RBAC: Authorizing `identity:get_role(role_id=d520f560be6d45539a966c6de2a934e7)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:30.462882 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ec0937-0599-4919-9da3-a13000180c4d None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:30.462882 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 557/1120] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:45:30 2022] GET /identity/v3/roles/d520f560be6d45539a966c6de2a934e7 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:30.463129 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7624d4-38f7-4648-a61d-c0816d386338 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:30.519776 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:30.558012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7624d4-38f7-4648-a61d-c0816d386338 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:30.591188 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287799c4-8b03-410c-8734-123461425aee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:30.591741 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287799c4-8b03-410c-8734-123461425aee None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:30.592018 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287799c4-8b03-410c-8734-123461425aee None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:30.592289 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287799c4-8b03-410c-8734-123461425aee None admin] PATH_INFO: `/v3/users/a95b248e4d8b415388e1b5865da207ef` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:30.593381 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287799c4-8b03-410c-8734-123461425aee None admin] RBAC: Authorizing `identity:get_user(user_id=a95b248e4d8b415388e1b5865da207ef)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:30.594836 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287799c4-8b03-410c-8734-123461425aee None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:30.596400 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 564/1121] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:45:30 2022] GET /identity/v3/users/a95b248e4d8b415388e1b5865da207ef => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:30.602036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec0937-0599-4919-9da3-a13000180c4d None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:30.699383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ec0937-0599-4919-9da3-a13000180c4d None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:30.731808 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55f7189-235c-4e28-99fe-25427e85f474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:30.732418 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f7189-235c-4e28-99fe-25427e85f474 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:30.732696 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f7189-235c-4e28-99fe-25427e85f474 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:30.732966 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55f7189-235c-4e28-99fe-25427e85f474 None admin] PATH_INFO: `/v3/projects/6f3f326e37a040b7a83ecb9fce82e85b` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:30.734088 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f7189-235c-4e28-99fe-25427e85f474 None admin] RBAC: Authorizing `identity:get_project(project_id=6f3f326e37a040b7a83ecb9fce82e85b)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:30.735497 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55f7189-235c-4e28-99fe-25427e85f474 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:30.737609 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 558/1122] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:45:30 2022] GET /identity/v3/projects/6f3f326e37a040b7a83ecb9fce82e85b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:30.743280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287799c4-8b03-410c-8734-123461425aee None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:30.838987 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287799c4-8b03-410c-8734-123461425aee None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:30.864492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:30.872040 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddbb81b-5b0b-4aa1-8c8c-480e4254a918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:30.872682 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbb81b-5b0b-4aa1-8c8c-480e4254a918 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:30.872958 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbb81b-5b0b-4aa1-8c8c-480e4254a918 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:30.877657 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddbb81b-5b0b-4aa1-8c8c-480e4254a918 None admin] PATH_INFO: `/v3/projects/6f3f326e37a040b7a83ecb9fce82e85b/users/a95b248e4d8b415388e1b5865da207ef/roles/d520f560be6d45539a966c6de2a934e7` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:30.877657 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddbb81b-5b0b-4aa1-8c8c-480e4254a918 None admin] RBAC: Authorizing `identity:create_grant(project_id=6f3f326e37a040b7a83ecb9fce82e85b, user_id=a95b248e4d8b415388e1b5865da207ef, role_id=d520f560be6d45539a966c6de2a934e7)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:30.877657 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddbb81b-5b0b-4aa1-8c8c-480e4254a918 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:30.952066 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 565/1123] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Sep 13 19:45:30 2022] PUT /identity/v3/projects/6f3f326e37a040b7a83ecb9fce82e85b/users/a95b248e4d8b415388e1b5865da207ef/roles/d520f560be6d45539a966c6de2a934e7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:45:33.060688 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5dfb4-194f-4069-b050-25b69cd35d11 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.061232 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5dfb4-194f-4069-b050-25b69cd35d11 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.061232 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5dfb4-194f-4069-b050-25b69cd35d11 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.062586 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 559/1124] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:33.068403 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b471396-e665-41b5-bc1d-eac839a1d0f5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.068824 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b471396-e665-41b5-bc1d-eac839a1d0f5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.068952 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b471396-e665-41b5-bc1d-eac839a1d0f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.086642 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8b471396-e665-41b5-bc1d-eac839a1d0f5 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:33.087820 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8b471396-e665-41b5-bc1d-eac839a1d0f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:33.153074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 566/1125] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:33.422668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5dfb4-194f-4069-b050-25b69cd35d11 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:33.480073 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:33.520714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5dfb4-194f-4069-b050-25b69cd35d11 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:33.553262 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e00f8f-e97c-4963-a009-3bee3fb3e220 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:33.553896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e00f8f-e97c-4963-a009-3bee3fb3e220 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.554174 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e00f8f-e97c-4963-a009-3bee3fb3e220 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.554442 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e00f8f-e97c-4963-a009-3bee3fb3e220 None admin] PATH_INFO: `/v3/roles/d520f560be6d45539a966c6de2a934e7` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.555793 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e00f8f-e97c-4963-a009-3bee3fb3e220 None admin] RBAC: Authorizing `identity:get_role(role_id=d520f560be6d45539a966c6de2a934e7)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:33.557135 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e00f8f-e97c-4963-a009-3bee3fb3e220 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:33.558449 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 560/1126] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:45:33 2022] GET /identity/v3/roles/d520f560be6d45539a966c6de2a934e7 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:33.564207 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b471396-e665-41b5-bc1d-eac839a1d0f5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:33.660298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b471396-e665-41b5-bc1d-eac839a1d0f5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:33.676776 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:33.692831 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23794936-9045-4ce2-82da-febfeb730987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:33.693449 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23794936-9045-4ce2-82da-febfeb730987 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.693756 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23794936-9045-4ce2-82da-febfeb730987 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.694040 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23794936-9045-4ce2-82da-febfeb730987 None admin] PATH_INFO: `/v3/users/a95b248e4d8b415388e1b5865da207ef` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.695145 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23794936-9045-4ce2-82da-febfeb730987 None admin] RBAC: Authorizing `identity:get_user(user_id=a95b248e4d8b415388e1b5865da207ef)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:33.696758 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23794936-9045-4ce2-82da-febfeb730987 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:33.698326 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 567/1127] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:45:33 2022] GET /identity/v3/users/a95b248e4d8b415388e1b5865da207ef => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:33.704005 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e00f8f-e97c-4963-a009-3bee3fb3e220 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:33.804169 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e00f8f-e97c-4963-a009-3bee3fb3e220 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:33.828154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:33.836622 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6465708-a885-4505-bf65-c4201a18b991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:33.837206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6465708-a885-4505-bf65-c4201a18b991 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:33.837481 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6465708-a885-4505-bf65-c4201a18b991 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:33.837780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6465708-a885-4505-bf65-c4201a18b991 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:33.902176 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6465708-a885-4505-bf65-c4201a18b991 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:33.903599 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6465708-a885-4505-bf65-c4201a18b991 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:33.996830 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 561/1128] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:45:34.003266 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23794936-9045-4ce2-82da-febfeb730987 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:34.100589 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23794936-9045-4ce2-82da-febfeb730987 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:34.133420 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23eaa7-acf9-4a09-a791-50e31cafc0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:34.134053 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23eaa7-acf9-4a09-a791-50e31cafc0ff None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:34.134331 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23eaa7-acf9-4a09-a791-50e31cafc0ff None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:34.134601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23eaa7-acf9-4a09-a791-50e31cafc0ff None admin] PATH_INFO: `/v3/projects/6f3f326e37a040b7a83ecb9fce82e85b` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:34.135680 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23eaa7-acf9-4a09-a791-50e31cafc0ff None admin] RBAC: Authorizing `identity:get_project(project_id=6f3f326e37a040b7a83ecb9fce82e85b)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:34.137097 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb23eaa7-acf9-4a09-a791-50e31cafc0ff None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:34.138700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 568/1129] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:45:34 2022] GET /identity/v3/projects/6f3f326e37a040b7a83ecb9fce82e85b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:34.145219 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6465708-a885-4505-bf65-c4201a18b991 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:34.171147 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:34.240421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6465708-a885-4505-bf65-c4201a18b991 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:34.273994 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9a988d-f5cb-4634-ab84-8aa9b1dd9832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:34.274533 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a988d-f5cb-4634-ab84-8aa9b1dd9832 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:34.274815 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a988d-f5cb-4634-ab84-8aa9b1dd9832 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:34.275090 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9a988d-f5cb-4634-ab84-8aa9b1dd9832 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:34.275806 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a988d-f5cb-4634-ab84-8aa9b1dd9832 None admin] RBAC: Adding query filter params (role.id=d520f560be6d45539a966c6de2a934e7, scope.project.id=6f3f326e37a040b7a83ecb9fce82e85b, user.id=a95b248e4d8b415388e1b5865da207ef) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:34.276117 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a988d-f5cb-4634-ab84-8aa9b1dd9832 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:34.277524 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9a988d-f5cb-4634-ab84-8aa9b1dd9832 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:34.283103 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 562/1130] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:45:34 2022] GET /identity/v3/role_assignments?user.id=a95b248e4d8b415388e1b5865da207ef&scope.project.id=6f3f326e37a040b7a83ecb9fce82e85b&role.id=d520f560be6d45539a966c6de2a934e7 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:36.430423 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385284f0-14ad-49ee-9f6b-2d05f67c3b67 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:36.431011 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385284f0-14ad-49ee-9f6b-2d05f67c3b67 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:36.431011 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385284f0-14ad-49ee-9f6b-2d05f67c3b67 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:36.432294 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 569/1131] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:36.437485 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374e5c4-f1ee-4ce8-a4bb-dcf5ebc8d69e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:36.437937 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374e5c4-f1ee-4ce8-a4bb-dcf5ebc8d69e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:36.438062 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374e5c4-f1ee-4ce8-a4bb-dcf5ebc8d69e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:36.456530 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-3374e5c4-f1ee-4ce8-a4bb-dcf5ebc8d69e None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:36.457747 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3374e5c4-f1ee-4ce8-a4bb-dcf5ebc8d69e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:36.521639 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 563/1132] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:36.786240 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385284f0-14ad-49ee-9f6b-2d05f67c3b67 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:36.840539 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:36.884420 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385284f0-14ad-49ee-9f6b-2d05f67c3b67 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:36.918349 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0417bd99-4f5d-4904-b8aa-fdab7adbc75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:36.918966 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417bd99-4f5d-4904-b8aa-fdab7adbc75b None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:36.919242 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417bd99-4f5d-4904-b8aa-fdab7adbc75b None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:36.919512 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0417bd99-4f5d-4904-b8aa-fdab7adbc75b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:36.920598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417bd99-4f5d-4904-b8aa-fdab7adbc75b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:36.922046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0417bd99-4f5d-4904-b8aa-fdab7adbc75b None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:36.923598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 570/1133] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:36.929421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374e5c4-f1ee-4ce8-a4bb-dcf5ebc8d69e None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:36.949935 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:37.026057 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374e5c4-f1ee-4ce8-a4bb-dcf5ebc8d69e None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:37.058253 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c15fb7-cd01-4c62-8880-8bb91418fae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:37.058798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c15fb7-cd01-4c62-8880-8bb91418fae8 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:37.059077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c15fb7-cd01-4c62-8880-8bb91418fae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:37.059350 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c15fb7-cd01-4c62-8880-8bb91418fae8 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:37.059991 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c15fb7-cd01-4c62-8880-8bb91418fae8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:37.061405 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c15fb7-cd01-4c62-8880-8bb91418fae8 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:37.141764 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 564/1134] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Sep 13 19:45:36 2022] POST /identity/v3/projects => generated 311 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:39.318479 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10954a26-3da9-4751-8781-85518552e2a8 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:39.319034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10954a26-3da9-4751-8781-85518552e2a8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:39.319034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10954a26-3da9-4751-8781-85518552e2a8 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:39.320328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 571/1135] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:39.325663 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea2a89-2ef0-4cc0-8567-bce9afede70e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:39.326089 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea2a89-2ef0-4cc0-8567-bce9afede70e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:39.326259 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea2a89-2ef0-4cc0-8567-bce9afede70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:39.344018 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-8bea2a89-2ef0-4cc0-8567-bce9afede70e None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:39.345234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8bea2a89-2ef0-4cc0-8567-bce9afede70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:39.409841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 565/1136] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:39.680387 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10954a26-3da9-4751-8781-85518552e2a8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:39.777984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10954a26-3da9-4751-8781-85518552e2a8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:39.799230 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:39.810558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a08639-17b7-4933-94b6-9100a7cea8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:39.811164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a08639-17b7-4933-94b6-9100a7cea8a9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:39.811438 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a08639-17b7-4933-94b6-9100a7cea8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:39.811706 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a08639-17b7-4933-94b6-9100a7cea8a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:39.822503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a08639-17b7-4933-94b6-9100a7cea8a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:39.822503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a08639-17b7-4933-94b6-9100a7cea8a9 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:39.822503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 572/1137] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:45:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:39.822781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea2a89-2ef0-4cc0-8567-bce9afede70e None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:39.824213 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:39.917963 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea2a89-2ef0-4cc0-8567-bce9afede70e None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:39.951267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9912a0f9-cc84-4fe2-9da8-0d56d5041a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:39.951809 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912a0f9-cc84-4fe2-9da8-0d56d5041a0c None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:39.952089 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912a0f9-cc84-4fe2-9da8-0d56d5041a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:39.952365 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9912a0f9-cc84-4fe2-9da8-0d56d5041a0c None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:39.953006 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912a0f9-cc84-4fe2-9da8-0d56d5041a0c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:39.954453 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9912a0f9-cc84-4fe2-9da8-0d56d5041a0c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:40.031200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 566/1138] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Sep 13 19:45:39 2022] POST /identity/v3/users => generated 286 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:42.197729 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fb67d-6d1a-4b0d-8b10-43f2cbc3164b None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:42.198234 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fb67d-6d1a-4b0d-8b10-43f2cbc3164b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:42.198234 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553fb67d-6d1a-4b0d-8b10-43f2cbc3164b None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:42.199533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 573/1139] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:42.204662 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261ebf2-7128-4a2a-a9e0-f0ba34c00c1f None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:42.205059 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261ebf2-7128-4a2a-a9e0-f0ba34c00c1f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:42.205216 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b261ebf2-7128-4a2a-a9e0-f0ba34c00c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:42.223954 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-b261ebf2-7128-4a2a-a9e0-f0ba34c00c1f None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:42.225127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b261ebf2-7128-4a2a-a9e0-f0ba34c00c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:42.276420 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:42.289250 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 567/1140] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:42.558384 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fb67d-6d1a-4b0d-8b10-43f2cbc3164b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:42.656559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553fb67d-6d1a-4b0d-8b10-43f2cbc3164b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:42.688763 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bc303-f4be-4f2c-9711-bfb859f644f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:42.689364 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bc303-f4be-4f2c-9711-bfb859f644f9 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:42.689638 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bc303-f4be-4f2c-9711-bfb859f644f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:42.689932 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364bc303-f4be-4f2c-9711-bfb859f644f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:42.700069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364bc303-f4be-4f2c-9711-bfb859f644f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:42.704802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-364bc303-f4be-4f2c-9711-bfb859f644f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:42.704802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:42.704802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:42.704802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:42.704802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:42.704802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:42.704802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:42.704802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:42.704802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:42.704802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:42.704802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:42.704802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:42.704802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:42.704802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:42.704802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:42.704802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:42.705956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:42.705956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:42.705956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:42.705956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:42.705956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:42.705956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:42.705956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:42.705956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:42.705956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:42.705956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:42.705956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:42.705956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:42.705956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:42.705956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:42.705956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:42.705956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:42.707010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:42.707010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:42.707010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:42.707010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:42.707010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:42.707010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:42.707010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:42.707010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:42.707010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:42.707010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:42.707010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:42.707010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:45:42.707010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 574/1141] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:45:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:42.711846 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261ebf2-7128-4a2a-a9e0-f0ba34c00c1f None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:42.807315 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b261ebf2-7128-4a2a-a9e0-f0ba34c00c1f None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:42.840127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75ed09-abd6-4781-9935-79d380750aba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:42.840663 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75ed09-abd6-4781-9935-79d380750aba None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:42.840942 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75ed09-abd6-4781-9935-79d380750aba None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:42.841214 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d75ed09-abd6-4781-9935-79d380750aba None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:42.841896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75ed09-abd6-4781-9935-79d380750aba None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:42.842199 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75ed09-abd6-4781-9935-79d380750aba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:42.843553 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d75ed09-abd6-4781-9935-79d380750aba None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:42.851315 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 568/1142] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:45:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:42.856912 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bc303-f4be-4f2c-9711-bfb859f644f9 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:42.906783 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:42.955108 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364bc303-f4be-4f2c-9711-bfb859f644f9 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:42.986978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b97bca-56e7-4f3b-8600-07ad73fe3f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:42.988120 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b97bca-56e7-4f3b-8600-07ad73fe3f1c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:42.988390 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b97bca-56e7-4f3b-8600-07ad73fe3f1c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:42.988662 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b97bca-56e7-4f3b-8600-07ad73fe3f1c None admin] PATH_INFO: `/v3/users/fbb41853c7704410a5a9b3c65c858357` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:43.001057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b97bca-56e7-4f3b-8600-07ad73fe3f1c None admin] RBAC: Authorizing `identity:get_user(user_id=fbb41853c7704410a5a9b3c65c858357)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:43.002515 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b97bca-56e7-4f3b-8600-07ad73fe3f1c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:43.004682 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 575/1143] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:45:42 2022] GET /identity/v3/users/fbb41853c7704410a5a9b3c65c858357 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:43.010692 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75ed09-abd6-4781-9935-79d380750aba None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:43.059962 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:43.107626 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d75ed09-abd6-4781-9935-79d380750aba None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:43.139630 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cff32-0ad1-4a15-b5dc-45e690342647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:43.140213 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cff32-0ad1-4a15-b5dc-45e690342647 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:43.140487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cff32-0ad1-4a15-b5dc-45e690342647 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:43.140752 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124cff32-0ad1-4a15-b5dc-45e690342647 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:43.203867 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124cff32-0ad1-4a15-b5dc-45e690342647 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:43.205284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124cff32-0ad1-4a15-b5dc-45e690342647 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:43.251933 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:43.301185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 569/1144] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:43 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:45:43.307114 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b97bca-56e7-4f3b-8600-07ad73fe3f1c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:43.402333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b97bca-56e7-4f3b-8600-07ad73fe3f1c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:43.411555 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:43.434675 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606b6a90-fb14-4da2-9282-fd8bdcdcfabb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:43.435280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b6a90-fb14-4da2-9282-fd8bdcdcfabb None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:43.435562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b6a90-fb14-4da2-9282-fd8bdcdcfabb None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:43.435865 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606b6a90-fb14-4da2-9282-fd8bdcdcfabb None admin] PATH_INFO: `/v3/projects/4a6deda8c717499489bc64224cbeebcf` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:43.437231 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b6a90-fb14-4da2-9282-fd8bdcdcfabb None admin] RBAC: Authorizing `identity:get_project(project_id=4a6deda8c717499489bc64224cbeebcf)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:43.438939 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606b6a90-fb14-4da2-9282-fd8bdcdcfabb None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:43.440507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 576/1145] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:45:43 2022] GET /identity/v3/projects/4a6deda8c717499489bc64224cbeebcf => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:43.446513 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cff32-0ad1-4a15-b5dc-45e690342647 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:43.541964 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124cff32-0ad1-4a15-b5dc-45e690342647 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:43.575061 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30befb95-e327-42f7-bb43-d90687280116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:43.575647 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30befb95-e327-42f7-bb43-d90687280116 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:43.575926 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30befb95-e327-42f7-bb43-d90687280116 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:43.576197 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30befb95-e327-42f7-bb43-d90687280116 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:43.576906 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30befb95-e327-42f7-bb43-d90687280116 None admin] RBAC: Adding query filter params (role.id=cd02ef2043de492a8bff6c165485f255, scope.project.id=4a6deda8c717499489bc64224cbeebcf, user.id=fbb41853c7704410a5a9b3c65c858357) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:43.577210 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30befb95-e327-42f7-bb43-d90687280116 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:43.578639 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30befb95-e327-42f7-bb43-d90687280116 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:43.583761 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 570/1146] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:45:43 2022] GET /identity/v3/role_assignments?user.id=fbb41853c7704410a5a9b3c65c858357&scope.project.id=4a6deda8c717499489bc64224cbeebcf&role.id=cd02ef2043de492a8bff6c165485f255 => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:45.687139 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3cb74-c462-463d-a3d5-51532632cf76 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:45.687666 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3cb74-c462-463d-a3d5-51532632cf76 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:45.687666 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e3cb74-c462-463d-a3d5-51532632cf76 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:45.689000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 577/1147] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:45.694773 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65117cdf-292d-4e47-a5ae-c6222b9fff8d None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:45.695196 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65117cdf-292d-4e47-a5ae-c6222b9fff8d None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:45.695328 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65117cdf-292d-4e47-a5ae-c6222b9fff8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:45.713259 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-65117cdf-292d-4e47-a5ae-c6222b9fff8d None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:45.714465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-65117cdf-292d-4e47-a5ae-c6222b9fff8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:45.723526 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:45.778840 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 571/1148] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:46.045759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3cb74-c462-463d-a3d5-51532632cf76 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:46.142237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e3cb74-c462-463d-a3d5-51532632cf76 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:46.174345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea7194-937b-4288-b00d-22e654579942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:46.174944 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea7194-937b-4288-b00d-22e654579942 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:46.175792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea7194-937b-4288-b00d-22e654579942 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:46.176060 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ea7194-937b-4288-b00d-22e654579942 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:46.185892 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ea7194-937b-4288-b00d-22e654579942 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:46.190574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-73ea7194-937b-4288-b00d-22e654579942 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:46.190574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:46.190574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:46.190574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:46.190574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:46.190574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:46.190574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:46.190574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:46.190574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:46.190574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:46.190574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:46.190574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:46.190574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:46.190574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:46.190574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:46.190574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:46.191672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:46.191672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:46.191672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:46.191672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:46.191672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:46.191672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:46.191672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:46.191672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:46.191672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:46.191672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:46.191672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:46.191672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:46.191672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:46.191672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:46.191672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:46.191672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:46.192665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:46.192665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:46.192665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:46.192665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:46.192665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:46.192665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:46.192665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:46.192665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:46.192665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:46.192665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:46.192665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:46.192665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:45:46.192665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 578/1149] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:45:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:46.197534 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65117cdf-292d-4e47-a5ae-c6222b9fff8d None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:46.293063 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65117cdf-292d-4e47-a5ae-c6222b9fff8d None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:46.325797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bba19d-d9d0-4642-99af-c43d6719b3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:46.326337 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bba19d-d9d0-4642-99af-c43d6719b3ff None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:46.326616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bba19d-d9d0-4642-99af-c43d6719b3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:46.326888 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bba19d-d9d0-4642-99af-c43d6719b3ff None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:46.327543 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bba19d-d9d0-4642-99af-c43d6719b3ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:46.327866 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bba19d-d9d0-4642-99af-c43d6719b3ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:46.329220 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bba19d-d9d0-4642-99af-c43d6719b3ff None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:46.336964 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 572/1150] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:45:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:46.342651 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea7194-937b-4288-b00d-22e654579942 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:46.380500 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:46.443735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ea7194-937b-4288-b00d-22e654579942 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:46.476435 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6aa44-33b5-4ec2-aa2c-0f45f76b5d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:46.477040 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6aa44-33b5-4ec2-aa2c-0f45f76b5d1a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:46.477312 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6aa44-33b5-4ec2-aa2c-0f45f76b5d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:46.477577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b6aa44-33b5-4ec2-aa2c-0f45f76b5d1a None admin] PATH_INFO: `/v3/users/fbb41853c7704410a5a9b3c65c858357` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:46.478691 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6aa44-33b5-4ec2-aa2c-0f45f76b5d1a None admin] RBAC: Authorizing `identity:get_user(user_id=fbb41853c7704410a5a9b3c65c858357)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:46.480099 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b6aa44-33b5-4ec2-aa2c-0f45f76b5d1a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:46.481633 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 579/1151] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:45:46 2022] GET /identity/v3/users/fbb41853c7704410a5a9b3c65c858357 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:46.487443 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bba19d-d9d0-4642-99af-c43d6719b3ff None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:46.496630 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:46.585956 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bba19d-d9d0-4642-99af-c43d6719b3ff None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:46.618276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826c925d-4f87-4884-bae9-cff594bffd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:46.618889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c925d-4f87-4884-bae9-cff594bffd54 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:46.619168 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c925d-4f87-4884-bae9-cff594bffd54 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:46.619440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826c925d-4f87-4884-bae9-cff594bffd54 None admin] PATH_INFO: `/v3/projects/4a6deda8c717499489bc64224cbeebcf` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:46.620546 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c925d-4f87-4884-bae9-cff594bffd54 None admin] RBAC: Authorizing `identity:get_project(project_id=4a6deda8c717499489bc64224cbeebcf)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:46.621986 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826c925d-4f87-4884-bae9-cff594bffd54 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:46.623577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 573/1152] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:45:46 2022] GET /identity/v3/projects/4a6deda8c717499489bc64224cbeebcf => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:46.629424 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6aa44-33b5-4ec2-aa2c-0f45f76b5d1a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:46.726084 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b6aa44-33b5-4ec2-aa2c-0f45f76b5d1a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:46.728312 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:46.759593 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c8f4a5-1ef9-4496-ba09-60e0d28e5bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:46.760227 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8f4a5-1ef9-4496-ba09-60e0d28e5bcf None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:46.760503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8f4a5-1ef9-4496-ba09-60e0d28e5bcf None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:46.760772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c8f4a5-1ef9-4496-ba09-60e0d28e5bcf None admin] PATH_INFO: `/v3/projects/4a6deda8c717499489bc64224cbeebcf/users/fbb41853c7704410a5a9b3c65c858357/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:46.762720 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8f4a5-1ef9-4496-ba09-60e0d28e5bcf None admin] RBAC: Authorizing `identity:create_grant(project_id=4a6deda8c717499489bc64224cbeebcf, user_id=fbb41853c7704410a5a9b3c65c858357, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:46.764132 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c8f4a5-1ef9-4496-ba09-60e0d28e5bcf None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:46.850617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 580/1153] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Sep 13 19:45:46 2022] PUT /identity/v3/projects/4a6deda8c717499489bc64224cbeebcf/users/fbb41853c7704410a5a9b3c65c858357/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:45:48.960938 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2db133-bbfe-4447-a28f-8fcffd0e816f None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:48.961431 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2db133-bbfe-4447-a28f-8fcffd0e816f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:48.961530 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2db133-bbfe-4447-a28f-8fcffd0e816f None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:48.962853 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 574/1154] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:48.968038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6a4bf-08a5-427b-8e5c-d29b4de2b123 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:48.968481 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6a4bf-08a5-427b-8e5c-d29b4de2b123 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:48.968575 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef6a4bf-08a5-427b-8e5c-d29b4de2b123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:48.986826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2ef6a4bf-08a5-427b-8e5c-d29b4de2b123 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:48.988000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2ef6a4bf-08a5-427b-8e5c-d29b4de2b123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:49.051773 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 581/1155] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:49.324153 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2db133-bbfe-4447-a28f-8fcffd0e816f None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:49.399001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:49.423134 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2db133-bbfe-4447-a28f-8fcffd0e816f None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:49.456292 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5b773-88f5-43ca-a34f-d09321c14f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:49.456929 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5b773-88f5-43ca-a34f-d09321c14f61 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:49.457207 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5b773-88f5-43ca-a34f-d09321c14f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:49.457479 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f5b773-88f5-43ca-a34f-d09321c14f61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:49.467739 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f5b773-88f5-43ca-a34f-d09321c14f61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:45:49.472542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-e1f5b773-88f5-43ca-a34f-d09321c14f61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:49.472542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:49.472542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:49.472542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:49.472542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:49.472542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:49.472542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:49.472542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:49.472542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:49.472542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:49.472542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:49.472542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:49.472542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:45:49.472542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:45:49.472542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:45:49.472542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:45:49.473716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:45:49.473716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:45:49.473716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:45:49.473716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:45:49.473716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:49.473716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:49.473716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:49.473716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:49.473716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:49.473716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:49.473716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:49.473716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:49.473716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:49.473716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:49.473716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:49.473716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:49.474782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:49.474782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:49.474782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:49.474782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:49.474782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:45:49.474782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:45:49.474782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:45:49.474782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:45:49.474782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:45:49.474782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:45:49.474782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:45:49.474782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:45:49.474782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 575/1156] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:45:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:49.479713 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6a4bf-08a5-427b-8e5c-d29b4de2b123 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:49.569759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:49.579365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef6a4bf-08a5-427b-8e5c-d29b4de2b123 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:49.609513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496a010-fb50-4f4c-b28d-74c67f1fb8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:49.610129 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496a010-fb50-4f4c-b28d-74c67f1fb8b1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:49.610405 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496a010-fb50-4f4c-b28d-74c67f1fb8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:49.610671 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3496a010-fb50-4f4c-b28d-74c67f1fb8b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:49.611316 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496a010-fb50-4f4c-b28d-74c67f1fb8b1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:49.611610 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496a010-fb50-4f4c-b28d-74c67f1fb8b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:49.613461 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3496a010-fb50-4f4c-b28d-74c67f1fb8b1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:49.625743 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 582/1157] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:45:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:49.627242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5b773-88f5-43ca-a34f-d09321c14f61 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:49.724334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f5b773-88f5-43ca-a34f-d09321c14f61 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:49.757384 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c4868-66f7-47b9-b9e7-77f7e60aa3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:49.758021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c4868-66f7-47b9-b9e7-77f7e60aa3ef None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:49.758303 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c4868-66f7-47b9-b9e7-77f7e60aa3ef None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:49.758576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81c4868-66f7-47b9-b9e7-77f7e60aa3ef None admin] PATH_INFO: `/v3/users/fbb41853c7704410a5a9b3c65c858357` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:49.759676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c4868-66f7-47b9-b9e7-77f7e60aa3ef None admin] RBAC: Authorizing `identity:get_user(user_id=fbb41853c7704410a5a9b3c65c858357)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:49.761099 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81c4868-66f7-47b9-b9e7-77f7e60aa3ef None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:49.762667 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 576/1158] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:45:49 2022] GET /identity/v3/users/fbb41853c7704410a5a9b3c65c858357 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:49.768206 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496a010-fb50-4f4c-b28d-74c67f1fb8b1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:49.863489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3496a010-fb50-4f4c-b28d-74c67f1fb8b1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:49.895053 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873a6ef-be79-4900-bb04-da98a5acb322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:49.895650 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873a6ef-be79-4900-bb04-da98a5acb322 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:49.895925 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873a6ef-be79-4900-bb04-da98a5acb322 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:49.896193 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9873a6ef-be79-4900-bb04-da98a5acb322 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:49.920316 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:49.961382 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873a6ef-be79-4900-bb04-da98a5acb322 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:49.962848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9873a6ef-be79-4900-bb04-da98a5acb322 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:50.057301 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 583/1159] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:49 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:45:50.063265 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c4868-66f7-47b9-b9e7-77f7e60aa3ef None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:50.066108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:50.161409 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81c4868-66f7-47b9-b9e7-77f7e60aa3ef None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:50.193165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39225f2-f235-4a7a-b95c-90dc8987f852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:50.193803 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39225f2-f235-4a7a-b95c-90dc8987f852 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:50.194084 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39225f2-f235-4a7a-b95c-90dc8987f852 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:50.194354 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39225f2-f235-4a7a-b95c-90dc8987f852 None admin] PATH_INFO: `/v3/projects/4a6deda8c717499489bc64224cbeebcf` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:50.195457 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39225f2-f235-4a7a-b95c-90dc8987f852 None admin] RBAC: Authorizing `identity:get_project(project_id=4a6deda8c717499489bc64224cbeebcf)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:50.196870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39225f2-f235-4a7a-b95c-90dc8987f852 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:50.198482 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 577/1160] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:45:50 2022] GET /identity/v3/projects/4a6deda8c717499489bc64224cbeebcf => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:50.204408 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873a6ef-be79-4900-bb04-da98a5acb322 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:50.257519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:50.298798 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9873a6ef-be79-4900-bb04-da98a5acb322 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:50.331061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc86aca-eca7-45e8-9546-ecb57bf1dd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:50.332152 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc86aca-eca7-45e8-9546-ecb57bf1dd6d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:50.332428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc86aca-eca7-45e8-9546-ecb57bf1dd6d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:50.332689 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc86aca-eca7-45e8-9546-ecb57bf1dd6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:50.333393 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc86aca-eca7-45e8-9546-ecb57bf1dd6d None admin] RBAC: Adding query filter params (role.id=cd02ef2043de492a8bff6c165485f255, scope.project.id=4a6deda8c717499489bc64224cbeebcf, user.id=fbb41853c7704410a5a9b3c65c858357) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:50.333715 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc86aca-eca7-45e8-9546-ecb57bf1dd6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:50.335115 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc86aca-eca7-45e8-9546-ecb57bf1dd6d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:50.340651 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 584/1161] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:45:50 2022] GET /identity/v3/role_assignments?user.id=fbb41853c7704410a5a9b3c65c858357&scope.project.id=4a6deda8c717499489bc64224cbeebcf&role.id=cd02ef2043de492a8bff6c165485f255 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:52.472376 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f0303-a471-4b51-943f-e6c230d1279c None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:52.472966 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f0303-a471-4b51-943f-e6c230d1279c None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:52.472966 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34f0303-a471-4b51-943f-e6c230d1279c None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:52.474301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 578/1162] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:52.479488 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd6d5b-c16d-4bef-8e7b-e1db15bcb126 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:52.479908 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd6d5b-c16d-4bef-8e7b-e1db15bcb126 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:52.480042 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebd6d5b-c16d-4bef-8e7b-e1db15bcb126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:52.498450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4ebd6d5b-c16d-4bef-8e7b-e1db15bcb126 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:52.499660 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4ebd6d5b-c16d-4bef-8e7b-e1db15bcb126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:52.563979 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 585/1163] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:52.828686 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f0303-a471-4b51-943f-e6c230d1279c None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:52.897214 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:52.929287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34f0303-a471-4b51-943f-e6c230d1279c None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:52.961148 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c64ef3-6ecf-4e37-8377-ab49fbd86b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:52.961770 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c64ef3-6ecf-4e37-8377-ab49fbd86b61 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:52.962045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c64ef3-6ecf-4e37-8377-ab49fbd86b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:52.962311 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c64ef3-6ecf-4e37-8377-ab49fbd86b61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:53.026863 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c64ef3-6ecf-4e37-8377-ab49fbd86b61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:53.028281 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c64ef3-6ecf-4e37-8377-ab49fbd86b61 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:53.092869 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:53.125155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 579/1164] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:45:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:45:53.131318 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd6d5b-c16d-4bef-8e7b-e1db15bcb126 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:53.179422 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:53.227756 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebd6d5b-c16d-4bef-8e7b-e1db15bcb126 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:53.260253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2608448-3d01-4c8f-91ca-aa88fab1fdf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:53.260863 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2608448-3d01-4c8f-91ca-aa88fab1fdf5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:53.261142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2608448-3d01-4c8f-91ca-aa88fab1fdf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:53.261412 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2608448-3d01-4c8f-91ca-aa88fab1fdf5 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:53.267860 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2608448-3d01-4c8f-91ca-aa88fab1fdf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:53.269832 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2608448-3d01-4c8f-91ca-aa88fab1fdf5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:53.281519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-d2608448-3d01-4c8f-91ca-aa88fab1fdf5 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 13 19:45:53.281519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:53.281519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 13 19:45:53.281519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 13 19:45:53.281519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:45:53.281519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:45:53.281519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:45:53.281519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:45:53.281519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 13 19:45:53.281519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:45:53.281519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:45:53.281519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:45:53.281519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:45:53.281519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:45:53.281519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:45:53.281519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:45:53.281519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:45:53.282855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:45:53.282855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:45:53.282855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:45:53.282855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:45:53.282855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:45:53.282855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:45:53.282855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:45:53.282855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:45:53.282855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:45:53.282855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:45:53.282855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:45:53.282855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:45:53.282855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:45:53.282855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:45:53.282855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:45:53.282855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:45:53.283927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:45:53.283927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:45:53.283927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:45:53.283927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:45:53.283927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:45:53.283927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:45:53.283927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:45:53.283927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:45:53.283927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:45:53.283927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:45:53.283927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 13 19:45:53.283927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:45:53.283927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 13 19:45:53.283927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:45:53.283927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 586/1165] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Sep 13 19:45:53 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:45:53.289091 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c64ef3-6ecf-4e37-8377-ab49fbd86b61 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:53.384846 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c64ef3-6ecf-4e37-8377-ab49fbd86b61 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:53.420579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed5782b-1a49-43b1-abbd-e8919da00af7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:53.421439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5782b-1a49-43b1-abbd-e8919da00af7 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:53.421810 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5782b-1a49-43b1-abbd-e8919da00af7 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:53.422081 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed5782b-1a49-43b1-abbd-e8919da00af7 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:53.422706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5782b-1a49-43b1-abbd-e8919da00af7 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:45:53.423002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5782b-1a49-43b1-abbd-e8919da00af7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:53.424335 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed5782b-1a49-43b1-abbd-e8919da00af7 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:53.432857 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 580/1166] 10.222.0.59 () {56 vars in 1115 bytes} [Tue Sep 13 19:45:53 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:55.548285 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffea5f-0091-4a46-9087-da1e196ae824 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:55.548888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffea5f-0091-4a46-9087-da1e196ae824 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:55.548888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ffea5f-0091-4a46-9087-da1e196ae824 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:55.550235 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 587/1167] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:55.556038 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d506176-6d9c-44a9-9756-9efb768d5d08 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:55.556437 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d506176-6d9c-44a9-9756-9efb768d5d08 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:55.556592 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d506176-6d9c-44a9-9756-9efb768d5d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:55.575373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-9d506176-6d9c-44a9-9756-9efb768d5d08 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:55.576663 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9d506176-6d9c-44a9-9756-9efb768d5d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:55.602222 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:55.641948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 581/1168] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:55.910542 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffea5f-0091-4a46-9087-da1e196ae824 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:56.008744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ffea5f-0091-4a46-9087-da1e196ae824 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:56.018901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:56.041478 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8877611-9a8f-4ea0-98c3-7baa375c3448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:56.042159 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8877611-9a8f-4ea0-98c3-7baa375c3448 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:56.042440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8877611-9a8f-4ea0-98c3-7baa375c3448 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:56.042711 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8877611-9a8f-4ea0-98c3-7baa375c3448 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:56.043380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8877611-9a8f-4ea0-98c3-7baa375c3448 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:56.044734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8877611-9a8f-4ea0-98c3-7baa375c3448 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:56.131730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 588/1169] 10.222.0.59 () {60 vars in 1138 bytes} [Tue Sep 13 19:45:55 2022] POST /identity/v3/domains => generated 267 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:45:58.278617 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30dafd3-5216-4a8a-b53d-6c4ea5b22862 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:58.279131 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30dafd3-5216-4a8a-b53d-6c4ea5b22862 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:58.279246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30dafd3-5216-4a8a-b53d-6c4ea5b22862 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:58.280514 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 582/1170] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:45:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:45:58.286703 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac8f03-2c81-48c3-bb03-b3ef9a676ce2 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:58.287131 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac8f03-2c81-48c3-bb03-b3ef9a676ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:58.287258 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ac8f03-2c81-48c3-bb03-b3ef9a676ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:58.305793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b7ac8f03-2c81-48c3-bb03-b3ef9a676ce2 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:45:58.306962 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b7ac8f03-2c81-48c3-bb03-b3ef9a676ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:45:58.372226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 589/1171] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:45:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:45:58.637191 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30dafd3-5216-4a8a-b53d-6c4ea5b22862 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:58.735104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30dafd3-5216-4a8a-b53d-6c4ea5b22862 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:58.767837 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f64de0b-c0c1-4180-b4e1-91b837d1a099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:58.768452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64de0b-c0c1-4180-b4e1-91b837d1a099 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:58.768730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64de0b-c0c1-4180-b4e1-91b837d1a099 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:58.769001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f64de0b-c0c1-4180-b4e1-91b837d1a099 None admin] PATH_INFO: `/v3/domains/f10557f23bb44b80b5d40be1036c6011` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:58.779615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64de0b-c0c1-4180-b4e1-91b837d1a099 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f10557f23bb44b80b5d40be1036c6011)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:58.781038 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f64de0b-c0c1-4180-b4e1-91b837d1a099 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:58.782613 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 583/1172] 10.222.0.59 () {56 vars in 1183 bytes} [Tue Sep 13 19:45:58 2022] GET /identity/v3/domains/f10557f23bb44b80b5d40be1036c6011 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:45:58.788366 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac8f03-2c81-48c3-bb03-b3ef9a676ce2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:45:58.879527 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:45:58.882774 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ac8f03-2c81-48c3-bb03-b3ef9a676ce2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:45:58.915579 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760ef20-9717-429b-80a5-199fd14afdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:45:58.916173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760ef20-9717-429b-80a5-199fd14afdac None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:45:58.916448 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760ef20-9717-429b-80a5-199fd14afdac None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:45:58.916794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760ef20-9717-429b-80a5-199fd14afdac None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:45:58.917429 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760ef20-9717-429b-80a5-199fd14afdac None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:45:58.918885 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760ef20-9717-429b-80a5-199fd14afdac None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:45:58.999982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 590/1173] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Sep 13 19:45:58 2022] POST /identity/v3/projects => generated 361 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:46:01.145958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4175f4-0514-4f7f-b6a6-bb26832c4609 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:01.146476 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4175f4-0514-4f7f-b6a6-bb26832c4609 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:01.146476 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4175f4-0514-4f7f-b6a6-bb26832c4609 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:01.147749 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 584/1174] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:46:01.153125 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa104e2-0c36-40df-b163-3ae29e95f028 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:01.153498 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa104e2-0c36-40df-b163-3ae29e95f028 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:01.153667 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa104e2-0c36-40df-b163-3ae29e95f028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:01.171815 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0aa104e2-0c36-40df-b163-3ae29e95f028 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:46:01.172986 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0aa104e2-0c36-40df-b163-3ae29e95f028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:46:01.239749 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 591/1175] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:46:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:46:01.505303 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4175f4-0514-4f7f-b6a6-bb26832c4609 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:01.530813 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:01.603512 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4175f4-0514-4f7f-b6a6-bb26832c4609 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:01.635038 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bd234-45d6-4605-a469-bddda209f333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:01.635646 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bd234-45d6-4605-a469-bddda209f333 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:01.635920 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bd234-45d6-4605-a469-bddda209f333 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:01.636187 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bd234-45d6-4605-a469-bddda209f333 None admin] PATH_INFO: `/v3/domains/f10557f23bb44b80b5d40be1036c6011` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:01.637264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365bd234-45d6-4605-a469-bddda209f333 None admin] RBAC: Authorizing `identity:get_domain(domain_id=f10557f23bb44b80b5d40be1036c6011)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:01.638695 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365bd234-45d6-4605-a469-bddda209f333 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:01.640220 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 585/1176] 10.222.0.59 () {56 vars in 1183 bytes} [Tue Sep 13 19:46:01 2022] GET /identity/v3/domains/f10557f23bb44b80b5d40be1036c6011 => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:01.646398 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa104e2-0c36-40df-b163-3ae29e95f028 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:01.723835 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:01.740977 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa104e2-0c36-40df-b163-3ae29e95f028 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:01.774695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ffd2a-238c-43b8-badc-616d1aa0601a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:01.775227 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ffd2a-238c-43b8-badc-616d1aa0601a None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:01.775502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ffd2a-238c-43b8-badc-616d1aa0601a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:01.775776 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ffd2a-238c-43b8-badc-616d1aa0601a None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:01.776405 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ffd2a-238c-43b8-badc-616d1aa0601a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:01.777858 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5ffd2a-238c-43b8-badc-616d1aa0601a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:01.867401 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 592/1177] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Sep 13 19:46:01 2022] POST /identity/v3/users => generated 311 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:46:04.008211 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d445e-a921-4da6-b99a-334ff46cf282 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:04.008751 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d445e-a921-4da6-b99a-334ff46cf282 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:04.008751 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5d445e-a921-4da6-b99a-334ff46cf282 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:04.010104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 586/1178] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:46:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:46:04.015208 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cf17b-6dc9-4d4b-bce4-ad3ce86b16b4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:04.015596 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cf17b-6dc9-4d4b-bce4-ad3ce86b16b4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:04.015751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2cf17b-6dc9-4d4b-bce4-ad3ce86b16b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:04.033545 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3b2cf17b-6dc9-4d4b-bce4-ad3ce86b16b4 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:46:04.034759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3b2cf17b-6dc9-4d4b-bce4-ad3ce86b16b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:46:04.099902 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 593/1179] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:46:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:46:04.371577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d445e-a921-4da6-b99a-334ff46cf282 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:04.537279 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:04.546351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5d445e-a921-4da6-b99a-334ff46cf282 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:04.578130 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f584a2-3fcd-4f82-9fed-582fbba4a4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:04.578738 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f584a2-3fcd-4f82-9fed-582fbba4a4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:04.579041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f584a2-3fcd-4f82-9fed-582fbba4a4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:04.579310 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f584a2-3fcd-4f82-9fed-582fbba4a4f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:04.589486 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f584a2-3fcd-4f82-9fed-582fbba4a4f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:46:04.594242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-36f584a2-3fcd-4f82-9fed-582fbba4a4f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:46:04.594242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:46:04.594242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:46:04.594242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:46:04.594242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:46:04.594242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:46:04.594242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:46:04.594242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:46:04.594242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:46:04.594242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:46:04.594242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:46:04.594242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:46:04.594242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:46:04.594242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:46:04.594242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:46:04.594242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:46:04.595358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:46:04.595358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:46:04.595358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:46:04.595358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:46:04.595358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:46:04.595358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:46:04.595358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:46:04.595358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:46:04.595358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:46:04.595358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:46:04.595358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:46:04.595358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:46:04.595358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:46:04.595358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:46:04.595358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:46:04.595358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:46:04.596418 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:46:04.596418 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:46:04.596418 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:46:04.596418 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:46:04.596418 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:46:04.596418 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:46:04.596418 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:46:04.596418 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:46:04.596418 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:46:04.596418 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:46:04.596418 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:46:04.596418 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:46:04.596418 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 587/1180] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:46:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:46:04.602071 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cf17b-6dc9-4d4b-bce4-ad3ce86b16b4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:04.665466 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:04.696953 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2cf17b-6dc9-4d4b-bce4-ad3ce86b16b4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:04.730268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e418f-f47a-421d-a086-6ec472711c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:04.731036 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e418f-f47a-421d-a086-6ec472711c80 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:04.731512 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e418f-f47a-421d-a086-6ec472711c80 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:04.732214 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7e418f-f47a-421d-a086-6ec472711c80 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:04.732910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e418f-f47a-421d-a086-6ec472711c80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:46:04.733211 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e418f-f47a-421d-a086-6ec472711c80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:04.734601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7e418f-f47a-421d-a086-6ec472711c80 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:04.742367 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 594/1181] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:46:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:04.748119 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f584a2-3fcd-4f82-9fed-582fbba4a4f2 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:04.844730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f584a2-3fcd-4f82-9fed-582fbba4a4f2 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:04.875879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d4245-377c-47ac-83b8-d6cad843b87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:04.876495 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d4245-377c-47ac-83b8-d6cad843b87a None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:04.876766 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d4245-377c-47ac-83b8-d6cad843b87a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:04.877032 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84d4245-377c-47ac-83b8-d6cad843b87a None admin] PATH_INFO: `/v3/users/0079b02a3a9b4b12b2e0ac4d8a2ae07e` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:04.890626 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d4245-377c-47ac-83b8-d6cad843b87a None admin] RBAC: Authorizing `identity:get_user(user_id=0079b02a3a9b4b12b2e0ac4d8a2ae07e)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:04.892054 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84d4245-377c-47ac-83b8-d6cad843b87a None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:04.893633 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 588/1182] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:46:04 2022] GET /identity/v3/users/0079b02a3a9b4b12b2e0ac4d8a2ae07e => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:04.899881 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e418f-f47a-421d-a086-6ec472711c80 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:04.994942 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7e418f-f47a-421d-a086-6ec472711c80 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:05.022906 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:05.028401 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978563a0-0cbf-41c8-9163-3c40da586511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:05.028985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978563a0-0cbf-41c8-9163-3c40da586511 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:05.029264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978563a0-0cbf-41c8-9163-3c40da586511 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:05.029532 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978563a0-0cbf-41c8-9163-3c40da586511 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:05.094247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978563a0-0cbf-41c8-9163-3c40da586511 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:05.095672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978563a0-0cbf-41c8-9163-3c40da586511 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:05.189903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 595/1183] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:46:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:46:05.196430 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d4245-377c-47ac-83b8-d6cad843b87a None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:05.208260 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:05.291327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84d4245-377c-47ac-83b8-d6cad843b87a None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:05.323906 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b706a9d5-1b10-4573-beec-d879027034ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:05.324515 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706a9d5-1b10-4573-beec-d879027034ca None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:05.324787 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706a9d5-1b10-4573-beec-d879027034ca None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:05.325056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b706a9d5-1b10-4573-beec-d879027034ca None admin] PATH_INFO: `/v3/projects/aece1aaff55c4289a367886474350e27` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:05.326151 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b706a9d5-1b10-4573-beec-d879027034ca None admin] RBAC: Authorizing `identity:get_project(project_id=aece1aaff55c4289a367886474350e27)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:05.327553 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b706a9d5-1b10-4573-beec-d879027034ca None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:05.329117 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 589/1184] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:46:05 2022] GET /identity/v3/projects/aece1aaff55c4289a367886474350e27 => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:05.334998 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978563a0-0cbf-41c8-9163-3c40da586511 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:05.362956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:05.430129 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978563a0-0cbf-41c8-9163-3c40da586511 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:05.462507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063310de-b3cb-4b14-ae01-486af5e627dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:05.463086 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063310de-b3cb-4b14-ae01-486af5e627dc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:05.463360 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063310de-b3cb-4b14-ae01-486af5e627dc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:05.463625 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063310de-b3cb-4b14-ae01-486af5e627dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:05.464332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063310de-b3cb-4b14-ae01-486af5e627dc None admin] RBAC: Adding query filter params (role.id=cd02ef2043de492a8bff6c165485f255, scope.project.id=aece1aaff55c4289a367886474350e27, user.id=0079b02a3a9b4b12b2e0ac4d8a2ae07e) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:46:05.464633 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063310de-b3cb-4b14-ae01-486af5e627dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:05.466062 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063310de-b3cb-4b14-ae01-486af5e627dc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:05.471190 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 596/1185] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:46:05 2022] GET /identity/v3/role_assignments?user.id=0079b02a3a9b4b12b2e0ac4d8a2ae07e&scope.project.id=aece1aaff55c4289a367886474350e27&role.id=cd02ef2043de492a8bff6c165485f255 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:07.557181 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0806c46-c7a5-46ff-8fde-371346146889 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:07.557741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0806c46-c7a5-46ff-8fde-371346146889 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:07.557741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0806c46-c7a5-46ff-8fde-371346146889 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:07.559105 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 590/1186] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:46:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:46:07.564096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32841e72-82ce-4793-b367-60614d204d72 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:07.564529 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32841e72-82ce-4793-b367-60614d204d72 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:07.564632 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32841e72-82ce-4793-b367-60614d204d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:07.582749 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-32841e72-82ce-4793-b367-60614d204d72 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:46:07.583917 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-32841e72-82ce-4793-b367-60614d204d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:46:07.647535 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 597/1187] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:46:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:46:07.913873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0806c46-c7a5-46ff-8fde-371346146889 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:07.990727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:08.012555 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0806c46-c7a5-46ff-8fde-371346146889 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:08.045435 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff1924-27d0-41ef-a83b-9a3a604c1d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:08.046073 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff1924-27d0-41ef-a83b-9a3a604c1d47 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:08.046362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff1924-27d0-41ef-a83b-9a3a604c1d47 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:08.046632 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff1924-27d0-41ef-a83b-9a3a604c1d47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:08.056577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff1924-27d0-41ef-a83b-9a3a604c1d47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:46:08.061369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-19ff1924-27d0-41ef-a83b-9a3a604c1d47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:46:08.061369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:46:08.061369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:46:08.061369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:46:08.061369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:46:08.061369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:46:08.061369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:46:08.061369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:46:08.061369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:46:08.061369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:46:08.061369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:46:08.061369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:46:08.061369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:46:08.061369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:46:08.061369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:46:08.061369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:46:08.062499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:46:08.062499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:46:08.062499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:46:08.062499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:46:08.062499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:46:08.062499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:46:08.062499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:46:08.062499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:46:08.062499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:46:08.062499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:46:08.062499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:46:08.062499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:46:08.062499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:46:08.062499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:46:08.062499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:46:08.062499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:46:08.063607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:46:08.063607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:46:08.063607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:46:08.063607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:46:08.063607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:46:08.063607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:46:08.063607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:46:08.063607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:46:08.063607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:46:08.063607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:46:08.063607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:46:08.063607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:46:08.063607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 591/1188] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:46:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:46:08.068866 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32841e72-82ce-4793-b367-60614d204d72 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:08.092931 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:08.165132 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32841e72-82ce-4793-b367-60614d204d72 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:08.198224 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34a86c-677f-40c2-8bde-0a93ea417c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:08.198816 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34a86c-677f-40c2-8bde-0a93ea417c7f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:08.199093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34a86c-677f-40c2-8bde-0a93ea417c7f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:08.199364 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34a86c-677f-40c2-8bde-0a93ea417c7f None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:08.200014 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34a86c-677f-40c2-8bde-0a93ea417c7f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:46:08.200313 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34a86c-677f-40c2-8bde-0a93ea417c7f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:08.201669 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34a86c-677f-40c2-8bde-0a93ea417c7f None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:08.209684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 598/1189] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:46:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:08.215418 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff1924-27d0-41ef-a83b-9a3a604c1d47 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:08.312115 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff1924-27d0-41ef-a83b-9a3a604c1d47 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:08.344358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0758ae-673a-46eb-aea0-04b24b91ce31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:08.344962 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0758ae-673a-46eb-aea0-04b24b91ce31 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:08.345239 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0758ae-673a-46eb-aea0-04b24b91ce31 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:08.345508 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0758ae-673a-46eb-aea0-04b24b91ce31 None admin] PATH_INFO: `/v3/users/0079b02a3a9b4b12b2e0ac4d8a2ae07e` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:08.346621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0758ae-673a-46eb-aea0-04b24b91ce31 None admin] RBAC: Authorizing `identity:get_user(user_id=0079b02a3a9b4b12b2e0ac4d8a2ae07e)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:08.348061 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0758ae-673a-46eb-aea0-04b24b91ce31 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:08.349599 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 592/1190] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:46:08 2022] GET /identity/v3/users/0079b02a3a9b4b12b2e0ac4d8a2ae07e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:08.355210 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34a86c-677f-40c2-8bde-0a93ea417c7f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:08.436082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:08.450539 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34a86c-677f-40c2-8bde-0a93ea417c7f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:08.481877 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547688fb-9f50-44dc-8eb6-3f212baa50e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:08.482483 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547688fb-9f50-44dc-8eb6-3f212baa50e3 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:08.482756 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547688fb-9f50-44dc-8eb6-3f212baa50e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:08.483023 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547688fb-9f50-44dc-8eb6-3f212baa50e3 None admin] PATH_INFO: `/v3/projects/aece1aaff55c4289a367886474350e27` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:08.484095 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547688fb-9f50-44dc-8eb6-3f212baa50e3 None admin] RBAC: Authorizing `identity:get_project(project_id=aece1aaff55c4289a367886474350e27)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:08.485523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547688fb-9f50-44dc-8eb6-3f212baa50e3 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:08.487129 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 599/1191] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:46:08 2022] GET /identity/v3/projects/aece1aaff55c4289a367886474350e27 => generated 361 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:08.493453 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0758ae-673a-46eb-aea0-04b24b91ce31 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:08.502491 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:08.590350 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0758ae-673a-46eb-aea0-04b24b91ce31 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:08.622888 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551d6416-de51-4ce3-8c49-95ffabcdb5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:08.623525 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d6416-de51-4ce3-8c49-95ffabcdb5c9 None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:08.623803 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d6416-de51-4ce3-8c49-95ffabcdb5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:08.624077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551d6416-de51-4ce3-8c49-95ffabcdb5c9 None admin] PATH_INFO: `/v3/projects/aece1aaff55c4289a367886474350e27/users/0079b02a3a9b4b12b2e0ac4d8a2ae07e/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:08.625951 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d6416-de51-4ce3-8c49-95ffabcdb5c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=aece1aaff55c4289a367886474350e27, user_id=0079b02a3a9b4b12b2e0ac4d8a2ae07e, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:08.627356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551d6416-de51-4ce3-8c49-95ffabcdb5c9 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:08.712279 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 593/1192] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Sep 13 19:46:08 2022] PUT /identity/v3/projects/aece1aaff55c4289a367886474350e27/users/0079b02a3a9b4b12b2e0ac4d8a2ae07e/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 19:46:10.819575 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c23ae3-a0d9-4871-839f-1092fb206ac6 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:10.820108 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c23ae3-a0d9-4871-839f-1092fb206ac6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:10.820108 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c23ae3-a0d9-4871-839f-1092fb206ac6 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:10.821444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 600/1193] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:46:10.826575 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020779a1-2dd2-4184-aa66-ccafb8431c23 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:10.826995 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020779a1-2dd2-4184-aa66-ccafb8431c23 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:10.827128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020779a1-2dd2-4184-aa66-ccafb8431c23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:10.845760 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-020779a1-2dd2-4184-aa66-ccafb8431c23 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:46:10.846938 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-020779a1-2dd2-4184-aa66-ccafb8431c23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:46:10.905571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:10.912840 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 594/1194] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:46:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:46:11.185389 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c23ae3-a0d9-4871-839f-1092fb206ac6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:11.283521 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c23ae3-a0d9-4871-839f-1092fb206ac6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:11.315642 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e484dd-0f36-463e-837d-89a04b35d964 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:11.316250 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e484dd-0f36-463e-837d-89a04b35d964 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:11.316548 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e484dd-0f36-463e-837d-89a04b35d964 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:11.317388 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e484dd-0f36-463e-837d-89a04b35d964 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:11.327485 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e484dd-0f36-463e-837d-89a04b35d964 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:46:11.332236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-81e484dd-0f36-463e-837d-89a04b35d964 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:46:11.332236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:46:11.332236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:46:11.332236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:46:11.332236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:46:11.332236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:46:11.332236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:46:11.332236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:46:11.332236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:46:11.332236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:46:11.332236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:46:11.332236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:46:11.332236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:46:11.332236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:46:11.332236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:46:11.332236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:46:11.333357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:46:11.333357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:46:11.333357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:46:11.333357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:46:11.333357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:46:11.333357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:46:11.333357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:46:11.333357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:46:11.333357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:46:11.333357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:46:11.333357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:46:11.333357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:46:11.333357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:46:11.333357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:46:11.333357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:46:11.333357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:46:11.334646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:46:11.334646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:46:11.334646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:46:11.334646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:46:11.334646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:46:11.334646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:46:11.334646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:46:11.334646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:46:11.334646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:46:11.334646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:46:11.334646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:46:11.334646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:46:11.334646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 601/1195] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:46:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:46:11.339172 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020779a1-2dd2-4184-aa66-ccafb8431c23 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:11.433215 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020779a1-2dd2-4184-aa66-ccafb8431c23 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:11.466687 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c9d09-5494-4cf9-abd2-4cfa124d1f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:11.467220 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c9d09-5494-4cf9-abd2-4cfa124d1f62 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:11.467496 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c9d09-5494-4cf9-abd2-4cfa124d1f62 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:11.467764 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c9d09-5494-4cf9-abd2-4cfa124d1f62 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:11.468412 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c9d09-5494-4cf9-abd2-4cfa124d1f62 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:46:11.468707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c9d09-5494-4cf9-abd2-4cfa124d1f62 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:11.470083 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c9d09-5494-4cf9-abd2-4cfa124d1f62 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:11.477785 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 595/1196] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:46:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:11.483510 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e484dd-0f36-463e-837d-89a04b35d964 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:11.499464 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:11.580805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e484dd-0f36-463e-837d-89a04b35d964 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:11.612452 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90493fa-2f08-4bbf-84bd-7b725de29d56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:11.613054 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90493fa-2f08-4bbf-84bd-7b725de29d56 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:11.613329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90493fa-2f08-4bbf-84bd-7b725de29d56 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:11.614148 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90493fa-2f08-4bbf-84bd-7b725de29d56 None admin] PATH_INFO: `/v3/users/0079b02a3a9b4b12b2e0ac4d8a2ae07e` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:11.615225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90493fa-2f08-4bbf-84bd-7b725de29d56 None admin] RBAC: Authorizing `identity:get_user(user_id=0079b02a3a9b4b12b2e0ac4d8a2ae07e)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:11.616627 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90493fa-2f08-4bbf-84bd-7b725de29d56 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:11.618177 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 602/1197] 10.222.0.59 () {56 vars in 1177 bytes} [Tue Sep 13 19:46:11 2022] GET /identity/v3/users/0079b02a3a9b4b12b2e0ac4d8a2ae07e => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:11.623790 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c9d09-5494-4cf9-abd2-4cfa124d1f62 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:11.680443 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:11.719821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c9d09-5494-4cf9-abd2-4cfa124d1f62 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:11.752367 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532bd0c-f42f-429a-8b68-4bd0da8ff8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:11.752959 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532bd0c-f42f-429a-8b68-4bd0da8ff8cc None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:11.753236 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532bd0c-f42f-429a-8b68-4bd0da8ff8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:11.753505 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2532bd0c-f42f-429a-8b68-4bd0da8ff8cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:11.817594 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532bd0c-f42f-429a-8b68-4bd0da8ff8cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:11.819035 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2532bd0c-f42f-429a-8b68-4bd0da8ff8cc None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:11.872608 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:11.914689 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 596/1198] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:46:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:46:11.920512 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90493fa-2f08-4bbf-84bd-7b725de29d56 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:11.999356 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:12.016902 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90493fa-2f08-4bbf-84bd-7b725de29d56 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:12.050347 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce33a32-df78-477a-8d4c-43880aa5079d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:12.050982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce33a32-df78-477a-8d4c-43880aa5079d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:12.051263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce33a32-df78-477a-8d4c-43880aa5079d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:12.051535 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce33a32-df78-477a-8d4c-43880aa5079d None admin] PATH_INFO: `/v3/projects/aece1aaff55c4289a367886474350e27` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:12.052634 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce33a32-df78-477a-8d4c-43880aa5079d None admin] RBAC: Authorizing `identity:get_project(project_id=aece1aaff55c4289a367886474350e27)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:12.054140 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce33a32-df78-477a-8d4c-43880aa5079d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:12.055748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 603/1199] 10.222.0.59 () {56 vars in 1186 bytes} [Tue Sep 13 19:46:11 2022] GET /identity/v3/projects/aece1aaff55c4289a367886474350e27 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:12.061649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532bd0c-f42f-429a-8b68-4bd0da8ff8cc None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:46:12.155231 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2532bd0c-f42f-429a-8b68-4bd0da8ff8cc None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:46:12.187909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c815a8fd-6573-43e2-b950-8bd137fcb46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:46:12.188501 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815a8fd-6573-43e2-b950-8bd137fcb46b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:46:12.188779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815a8fd-6573-43e2-b950-8bd137fcb46b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:46:12.189051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c815a8fd-6573-43e2-b950-8bd137fcb46b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:46:12.189796 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815a8fd-6573-43e2-b950-8bd137fcb46b None admin] RBAC: Adding query filter params (role.id=cd02ef2043de492a8bff6c165485f255, scope.project.id=aece1aaff55c4289a367886474350e27, user.id=0079b02a3a9b4b12b2e0ac4d8a2ae07e) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:46:12.190105 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815a8fd-6573-43e2-b950-8bd137fcb46b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:46:12.191517 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c815a8fd-6573-43e2-b950-8bd137fcb46b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:46:12.197078 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 597/1200] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:46:12 2022] GET /identity/v3/role_assignments?user.id=0079b02a3a9b4b12b2e0ac4d8a2ae07e&scope.project.id=aece1aaff55c4289a367886474350e27&role.id=cd02ef2043de492a8bff6c165485f255 => generated 608 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:46:22.046231 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=25 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:46:22.194711 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:23.576054 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88432a4d-6f43-4531-a532-b31d24b2a288 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:23.576726 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88432a4d-6f43-4531-a532-b31d24b2a288 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:23.576726 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88432a4d-6f43-4531-a532-b31d24b2a288 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:23.578055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 604/1201] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:47:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:47:23.583131 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d34e5-73f3-4183-8c4c-ea93021731d0 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:23.583532 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d34e5-73f3-4183-8c4c-ea93021731d0 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:23.583682 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741d34e5-73f3-4183-8c4c-ea93021731d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:23.602007 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-741d34e5-73f3-4183-8c4c-ea93021731d0 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:47:23.603227 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-741d34e5-73f3-4183-8c4c-ea93021731d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:23.668303 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 598/1202] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:47:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:47:23.934338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88432a4d-6f43-4531-a532-b31d24b2a288 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:24.035161 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88432a4d-6f43-4531-a532-b31d24b2a288 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:24.068293 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75808a42-787f-4ee0-af70-50dbc2d8eab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:24.068919 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75808a42-787f-4ee0-af70-50dbc2d8eab4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:24.069228 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75808a42-787f-4ee0-af70-50dbc2d8eab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:24.069500 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75808a42-787f-4ee0-af70-50dbc2d8eab4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:24.079741 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75808a42-787f-4ee0-af70-50dbc2d8eab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:24.081183 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75808a42-787f-4ee0-af70-50dbc2d8eab4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:24.095772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-75808a42-787f-4ee0-af70-50dbc2d8eab4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:24.095772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:24.095772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:24.095772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:24.095772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:24.095772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:24.095772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:24.095772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:24.095772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:24.095772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:24.095772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:24.095772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:24.095772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:47:24.095772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:47:24.095772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:47:24.095772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:47:24.096882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:24.096882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:24.096882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:24.096882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:24.096882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:24.096882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:24.096882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:24.096882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:24.096882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:24.096882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:24.096882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:24.096882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:24.096882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:24.096882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:24.096882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:24.096882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:24.096882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:47:24.104709 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:47:24.104709 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:24.104709 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:47:24.104709 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 605/1203] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:24.105010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d34e5-73f3-4183-8c4c-ea93021731d0 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:24.201181 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741d34e5-73f3-4183-8c4c-ea93021731d0 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:24.229510 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:24.235359 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494458f1-1b49-48c4-96a0-dc3c7972d434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:24.235963 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494458f1-1b49-48c4-96a0-dc3c7972d434 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:24.236244 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494458f1-1b49-48c4-96a0-dc3c7972d434 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:24.236516 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494458f1-1b49-48c4-96a0-dc3c7972d434 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:24.237151 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494458f1-1b49-48c4-96a0-dc3c7972d434 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:24.237450 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494458f1-1b49-48c4-96a0-dc3c7972d434 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:24.238880 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494458f1-1b49-48c4-96a0-dc3c7972d434 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:24.249907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 599/1204] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:47:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:24.256310 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75808a42-787f-4ee0-af70-50dbc2d8eab4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:24.307898 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:24.353737 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75808a42-787f-4ee0-af70-50dbc2d8eab4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:24.386232 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318a2c15-ce04-4612-a304-813c812ee732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:24.386811 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a2c15-ce04-4612-a304-813c812ee732 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:24.387085 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a2c15-ce04-4612-a304-813c812ee732 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:24.387349 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318a2c15-ce04-4612-a304-813c812ee732 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:24.387974 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a2c15-ce04-4612-a304-813c812ee732 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:24.389408 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-318a2c15-ce04-4612-a304-813c812ee732 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:24.478868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 606/1205] 10.222.0.59 () {60 vars in 1132 bytes} [Tue Sep 13 19:47:24 2022] POST /identity/v3/users => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:47:26.642980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37179aad-1c6f-4e0c-8719-8a6874967bad None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:26.643541 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37179aad-1c6f-4e0c-8719-8a6874967bad None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:26.643541 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37179aad-1c6f-4e0c-8719-8a6874967bad None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:26.644878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 600/1206] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:47:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:47:26.650194 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78741c-5e5b-4aef-a625-3f669c42fbfe None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:26.650639 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78741c-5e5b-4aef-a625-3f669c42fbfe None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:26.650784 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e78741c-5e5b-4aef-a625-3f669c42fbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:26.668934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7e78741c-5e5b-4aef-a625-3f669c42fbfe None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:47:26.670123 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7e78741c-5e5b-4aef-a625-3f669c42fbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:26.735626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 607/1207] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:47:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:47:27.011100 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37179aad-1c6f-4e0c-8719-8a6874967bad None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:27.110465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37179aad-1c6f-4e0c-8719-8a6874967bad None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:27.144055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48a137-74fe-427f-adaf-ddff0490db47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:27.144699 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48a137-74fe-427f-adaf-ddff0490db47 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:27.144974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48a137-74fe-427f-adaf-ddff0490db47 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:27.145239 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e48a137-74fe-427f-adaf-ddff0490db47 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:27.156033 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e48a137-74fe-427f-adaf-ddff0490db47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:47:27.160896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-8e48a137-74fe-427f-adaf-ddff0490db47 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:47:27.160896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:27.160896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:27.160896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:27.160896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:27.160896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:27.160896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:27.160896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:27.160896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:27.160896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:27.160896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:27.160896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:27.160896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:47:27.160896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:47:27.160896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:47:27.160896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:47:27.162650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:47:27.162650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:47:27.162650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:47:27.162650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:47:27.162650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:27.162650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:27.162650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:27.162650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:27.162650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:27.162650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:27.162650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:27.162650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:27.162650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:27.162650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:27.162650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:27.162650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:27.163616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:27.163616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:27.163616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:27.163616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:27.163616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:47:27.163616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:47:27.163616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:47:27.163616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:47:27.163616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:47:27.163616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:47:27.163616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:47:27.163616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:47:27.163616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 601/1208] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Sep 13 19:47:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:27.168847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78741c-5e5b-4aef-a625-3f669c42fbfe None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:27.208171 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:27.266304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e78741c-5e5b-4aef-a625-3f669c42fbfe None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:27.300545 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fe083-80bf-4cec-9247-49748b285b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:27.301141 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fe083-80bf-4cec-9247-49748b285b39 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:27.301415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fe083-80bf-4cec-9247-49748b285b39 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:27.301681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086fe083-80bf-4cec-9247-49748b285b39 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:27.302389 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fe083-80bf-4cec-9247-49748b285b39 None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:27.302681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fe083-80bf-4cec-9247-49748b285b39 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:27.304036 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086fe083-80bf-4cec-9247-49748b285b39 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:27.311691 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 608/1209] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Sep 13 19:47:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:27.318184 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48a137-74fe-427f-adaf-ddff0490db47 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:27.366990 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:27.415324 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e48a137-74fe-427f-adaf-ddff0490db47 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:27.448031 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9387ed3-690c-40d9-b92d-9639637be3ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:27.448670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9387ed3-690c-40d9-b92d-9639637be3ff None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:27.448932 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9387ed3-690c-40d9-b92d-9639637be3ff None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:27.449204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9387ed3-690c-40d9-b92d-9639637be3ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:27.459975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9387ed3-690c-40d9-b92d-9639637be3ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:27.461399 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9387ed3-690c-40d9-b92d-9639637be3ff None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:27.475058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-b9387ed3-690c-40d9-b92d-9639637be3ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:27.475058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:27.475058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:27.475058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:27.475058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:27.475058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:27.475058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:27.475058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:27.475058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:27.475058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:27.475058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:27.475058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:27.475058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:47:27.475058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:47:27.475058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:47:27.475058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:47:27.476195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:27.476195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:27.476195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:27.476195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:27.476195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:27.476195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:27.476195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:27.476195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:27.476195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:27.476195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:27.476195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:27.476195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:27.476195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:27.476195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:27.476195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:27.476195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:27.476195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:47:27.477171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:47:27.477171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:27.477171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:47:27.477171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 602/1210] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:27.481945 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fe083-80bf-4cec-9247-49748b285b39 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:27.578627 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:27.581633 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086fe083-80bf-4cec-9247-49748b285b39 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:27.615604 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fb342-1483-4a47-a48d-5ddcfa9c6ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:27.616215 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fb342-1483-4a47-a48d-5ddcfa9c6ed4 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:27.616491 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fb342-1483-4a47-a48d-5ddcfa9c6ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:27.616760 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26fb342-1483-4a47-a48d-5ddcfa9c6ed4 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:27.617388 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26fb342-1483-4a47-a48d-5ddcfa9c6ed4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:27.617684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26fb342-1483-4a47-a48d-5ddcfa9c6ed4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:27.619067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26fb342-1483-4a47-a48d-5ddcfa9c6ed4 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:27.630489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 609/1211] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:27.636632 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9387ed3-690c-40d9-b92d-9639637be3ff None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:27.735093 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9387ed3-690c-40d9-b92d-9639637be3ff None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:27.736621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:27.767919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01114dd4-aedb-435e-863d-c5aa55b5ead3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:27.768540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01114dd4-aedb-435e-863d-c5aa55b5ead3 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:27.768818 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01114dd4-aedb-435e-863d-c5aa55b5ead3 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:27.769087 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01114dd4-aedb-435e-863d-c5aa55b5ead3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:27.777180 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01114dd4-aedb-435e-863d-c5aa55b5ead3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:27.778646 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01114dd4-aedb-435e-863d-c5aa55b5ead3 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:27.790296 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-01114dd4-aedb-435e-863d-c5aa55b5ead3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:47:27.790296 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:27.790296 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:27.790296 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:27.790296 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:27.790296 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:27.790296 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:27.790296 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:27.790296 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:27.790296 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:27.790296 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:27.790296 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:27.790296 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:47:27.790296 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:47:27.790296 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:47:27.790296 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:47:27.791893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:27.791893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:27.791893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:47:27.791893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:47:27.791893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:47:27.791893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:47:27.791893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:27.791893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:27.791893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:27.791893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:27.791893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:27.791893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:27.791893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:27.791893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:27.791893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:27.791893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:27.791893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:27.791893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:27.793110 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:27.793110 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:27.793110 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:47:27.793110 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:47:27.793110 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:47:27.793110 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:47:27.793110 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:47:27.793110 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:47:27.793110 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:47:27.793110 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:47:27.793110 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 603/1212] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:27 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:27.797433 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fb342-1483-4a47-a48d-5ddcfa9c6ed4 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:27.893714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26fb342-1483-4a47-a48d-5ddcfa9c6ed4 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:27.928075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2344ff-3be0-4ffe-9488-da12acc5fbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:27.928667 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2344ff-3be0-4ffe-9488-da12acc5fbc0 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:27.928946 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2344ff-3be0-4ffe-9488-da12acc5fbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:27.929216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2344ff-3be0-4ffe-9488-da12acc5fbc0 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:27.929950 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2344ff-3be0-4ffe-9488-da12acc5fbc0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:27.930252 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2344ff-3be0-4ffe-9488-da12acc5fbc0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:27.931674 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2344ff-3be0-4ffe-9488-da12acc5fbc0 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:27.948481 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 610/1213] 10.222.0.59 () {56 vars in 1143 bytes} [Tue Sep 13 19:47:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:27.954322 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01114dd4-aedb-435e-863d-c5aa55b5ead3 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:28.053108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01114dd4-aedb-435e-863d-c5aa55b5ead3 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:28.086165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77389aa9-25ae-4b94-bceb-5591bf9917ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:28.086756 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77389aa9-25ae-4b94-bceb-5591bf9917ec None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:28.087039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77389aa9-25ae-4b94-bceb-5591bf9917ec None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:28.087300 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77389aa9-25ae-4b94-bceb-5591bf9917ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:28.115623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:28.152032 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77389aa9-25ae-4b94-bceb-5591bf9917ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:28.153407 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77389aa9-25ae-4b94-bceb-5591bf9917ec None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:28.249106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 604/1214] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:47:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:47:28.255537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2344ff-3be0-4ffe-9488-da12acc5fbc0 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:28.274944 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:28.351990 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2344ff-3be0-4ffe-9488-da12acc5fbc0 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:28.385740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55973b5a-0d7d-4e0e-aff8-0c9cb85d0933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:28.386359 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55973b5a-0d7d-4e0e-aff8-0c9cb85d0933 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:28.386634 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55973b5a-0d7d-4e0e-aff8-0c9cb85d0933 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:28.386900 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55973b5a-0d7d-4e0e-aff8-0c9cb85d0933 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:28.397726 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55973b5a-0d7d-4e0e-aff8-0c9cb85d0933 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:28.399243 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55973b5a-0d7d-4e0e-aff8-0c9cb85d0933 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:28.413734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-55973b5a-0d7d-4e0e-aff8-0c9cb85d0933 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:28.413734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:28.413734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:28.413734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:28.413734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:28.413734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:28.413734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:28.413734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:28.413734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:28.413734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:28.413734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:28.413734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:28.413734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:47:28.413734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:47:28.413734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:47:28.413734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:47:28.414878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:28.414878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:28.414878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:28.414878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:28.414878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:28.414878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:28.414878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:28.414878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:28.414878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:28.414878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:28.414878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:28.414878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:28.414878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:28.414878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:28.414878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:28.414878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:28.414878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:47:28.415832 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:47:28.415832 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:28.415832 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:47:28.415832 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 611/1215] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:28.420479 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77389aa9-25ae-4b94-bceb-5591bf9917ec None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:28.479781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:28.517771 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77389aa9-25ae-4b94-bceb-5591bf9917ec None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:28.550683 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc4716-4cb4-45d1-8f8f-ee5807279237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:28.551274 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc4716-4cb4-45d1-8f8f-ee5807279237 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:28.551548 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc4716-4cb4-45d1-8f8f-ee5807279237 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:28.551814 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc4716-4cb4-45d1-8f8f-ee5807279237 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:28.552434 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc4716-4cb4-45d1-8f8f-ee5807279237 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:28.552730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc4716-4cb4-45d1-8f8f-ee5807279237 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:28.554106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc4716-4cb4-45d1-8f8f-ee5807279237 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:28.564849 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 605/1216] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:47:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:28.570877 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55973b5a-0d7d-4e0e-aff8-0c9cb85d0933 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:28.639313 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:28.670158 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55973b5a-0d7d-4e0e-aff8-0c9cb85d0933 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:28.702463 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5efe31-a9b1-4146-9ab3-e08639900256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:28.703075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5efe31-a9b1-4146-9ab3-e08639900256 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:28.703353 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5efe31-a9b1-4146-9ab3-e08639900256 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:28.703624 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5efe31-a9b1-4146-9ab3-e08639900256 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:28.710542 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5efe31-a9b1-4146-9ab3-e08639900256 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:28.711972 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5efe31-a9b1-4146-9ab3-e08639900256 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:28.722966 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-2a5efe31-a9b1-4146-9ab3-e08639900256 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:47:28.722966 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:28.722966 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:28.722966 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:28.722966 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:28.722966 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:28.722966 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:28.722966 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:28.722966 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:28.722966 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:28.722966 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:28.722966 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:28.722966 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:47:28.722966 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:47:28.722966 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:47:28.728855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:47:28.728855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:28.728855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:28.728855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:28.728855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:28.728855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:28.728855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:28.728855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:28.728855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:28.728855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:28.728855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:28.728855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:28.728855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:28.728855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:28.728855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:28.728855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:28.728855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:28.730207 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:47:28.730207 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:47:28.730207 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:47:28.730207 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:47:28.730207 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:47:28.730207 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:47:28.730207 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:47:28.730207 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:47:28.730207 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 612/1217] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:47:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:28.730840 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc4716-4cb4-45d1-8f8f-ee5807279237 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:28.829305 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc4716-4cb4-45d1-8f8f-ee5807279237 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:28.851543 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:28.864152 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612c82e-aafb-4b50-bc6d-83c7b3fd0e72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:28.864753 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612c82e-aafb-4b50-bc6d-83c7b3fd0e72 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:28.865030 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612c82e-aafb-4b50-bc6d-83c7b3fd0e72 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:28.865297 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612c82e-aafb-4b50-bc6d-83c7b3fd0e72 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:28.866005 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612c82e-aafb-4b50-bc6d-83c7b3fd0e72 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:28.866304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612c82e-aafb-4b50-bc6d-83c7b3fd0e72 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:28.867789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5612c82e-aafb-4b50-bc6d-83c7b3fd0e72 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:28.879493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 606/1218] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:47:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:28.886449 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5efe31-a9b1-4146-9ab3-e08639900256 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:28.984928 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5efe31-a9b1-4146-9ab3-e08639900256 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:29.013649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:29.019594 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcff8e8-a60f-427d-8cf8-a043d7879971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:29.020187 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcff8e8-a60f-427d-8cf8-a043d7879971 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:29.020481 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcff8e8-a60f-427d-8cf8-a043d7879971 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:29.021340 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcff8e8-a60f-427d-8cf8-a043d7879971 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:29.022163 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcff8e8-a60f-427d-8cf8-a043d7879971 None admin] RBAC: Adding query filter params (role.id=b253c1f3cd6a4197a85ca5f672852073, scope.project.id=ad67761fec0a430181877e216e90e7d4, user.id=89e7df5170c841abb449f3b4a547ec4d) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:29.025300 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcff8e8-a60f-427d-8cf8-a043d7879971 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:29.025300 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bcff8e8-a60f-427d-8cf8-a043d7879971 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:29.029257 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 613/1219] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:47:28 2022] GET /identity/v3/role_assignments?user.id=89e7df5170c841abb449f3b4a547ec4d&scope.project.id=ad67761fec0a430181877e216e90e7d4&role.id=b253c1f3cd6a4197a85ca5f672852073 => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:31.121107 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ee664-3477-4e71-ad97-c1786e8fd06a None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:31.121660 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ee664-3477-4e71-ad97-c1786e8fd06a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:31.121660 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ee664-3477-4e71-ad97-c1786e8fd06a None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:31.123061 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 607/1220] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:47:31.128147 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ae5ce-1a61-4a28-aec8-81f6f891aa62 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:31.128577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ae5ce-1a61-4a28-aec8-81f6f891aa62 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:31.128683 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092ae5ce-1a61-4a28-aec8-81f6f891aa62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:31.146903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-092ae5ce-1a61-4a28-aec8-81f6f891aa62 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:47:31.148047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-092ae5ce-1a61-4a28-aec8-81f6f891aa62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:31.212354 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 614/1221] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:47:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:47:31.481252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ee664-3477-4e71-ad97-c1786e8fd06a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:31.580913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ee664-3477-4e71-ad97-c1786e8fd06a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:31.615279 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbdb7c-8bcb-412d-843a-cc606c5b0747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:31.615904 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbdb7c-8bcb-412d-843a-cc606c5b0747 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:31.616205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbdb7c-8bcb-412d-843a-cc606c5b0747 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:31.616475 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbdb7c-8bcb-412d-843a-cc606c5b0747 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:31.626344 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fbdb7c-8bcb-412d-843a-cc606c5b0747 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:47:31.631185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-f7fbdb7c-8bcb-412d-843a-cc606c5b0747 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:47:31.631185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:31.631185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:31.631185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:31.631185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:31.631185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:31.631185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:31.631185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:31.631185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:31.631185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:31.631185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:31.631185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:31.631185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:47:31.631185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:47:31.631185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:47:31.631185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:47:31.632579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:47:31.632579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:47:31.632579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:47:31.632579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:47:31.632579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:31.632579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:31.632579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:31.632579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:31.632579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:31.632579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:31.632579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:31.632579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:31.632579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:31.632579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:31.632579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:31.632579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:31.633740 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:31.633740 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:31.633740 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:31.633740 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:31.633740 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:47:31.633740 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:47:31.633740 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:47:31.633740 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:47:31.633740 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:47:31.633740 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:47:31.633740 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:47:31.633740 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:47:31.633740 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 608/1222] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Sep 13 19:47:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:31.640254 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ae5ce-1a61-4a28-aec8-81f6f891aa62 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:31.737187 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092ae5ce-1a61-4a28-aec8-81f6f891aa62 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:31.760371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:31.771171 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d3765-850c-44c5-9c39-37c74dc5e1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:31.771767 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d3765-850c-44c5-9c39-37c74dc5e1ce None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:31.772041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d3765-850c-44c5-9c39-37c74dc5e1ce None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:31.772306 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d3765-850c-44c5-9c39-37c74dc5e1ce None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:31.772949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d3765-850c-44c5-9c39-37c74dc5e1ce None admin] RBAC: Adding query filter params (name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:31.773244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d3765-850c-44c5-9c39-37c74dc5e1ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:31.774627 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0d3765-850c-44c5-9c39-37c74dc5e1ce None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:31.782206 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 615/1223] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Sep 13 19:47:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:47:31.787962 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbdb7c-8bcb-412d-843a-cc606c5b0747 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:31.832771 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:31.887311 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbdb7c-8bcb-412d-843a-cc606c5b0747 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:31.922002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50394990-8821-42e3-b517-4189e61194d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:31.925677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50394990-8821-42e3-b517-4189e61194d8 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:31.925677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50394990-8821-42e3-b517-4189e61194d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:31.925677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50394990-8821-42e3-b517-4189e61194d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:31.932910 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50394990-8821-42e3-b517-4189e61194d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:31.934364 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50394990-8821-42e3-b517-4189e61194d8 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:31.949041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-50394990-8821-42e3-b517-4189e61194d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:31.949041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:31.949041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:31.949041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:31.949041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:31.949041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:31.949041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:31.949041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:31.949041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:31.949041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:31.949041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:31.949041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:31.949041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:47:31.949041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:47:31.949041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:47:31.949041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:47:31.955264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:31.955264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:31.955264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:31.955264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:31.955264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:31.955264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:31.955264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:31.955264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:31.955264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:31.955264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:31.955264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:31.955264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:31.955264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:31.955264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:31.955264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:31.955264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:31.955264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:47:31.956220 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:47:31.956220 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:31.956220 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:47:31.956220 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 609/1224] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:31.956487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d3765-850c-44c5-9c39-37c74dc5e1ce None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:32.054955 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d3765-850c-44c5-9c39-37c74dc5e1ce None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:32.088687 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632dd15-b922-4d3d-b546-d69bfe409475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:32.089277 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632dd15-b922-4d3d-b546-d69bfe409475 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:32.089554 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632dd15-b922-4d3d-b546-d69bfe409475 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:32.089853 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632dd15-b922-4d3d-b546-d69bfe409475 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:32.090555 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632dd15-b922-4d3d-b546-d69bfe409475 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:32.090860 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632dd15-b922-4d3d-b546-d69bfe409475 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:32.092214 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2632dd15-b922-4d3d-b546-d69bfe409475 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:32.103469 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 616/1225] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:47:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:32.109246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50394990-8821-42e3-b517-4189e61194d8 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:32.201670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:32.208348 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50394990-8821-42e3-b517-4189e61194d8 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:32.241802 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1247b7-6adc-4a14-98e0-33d2e23348d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:32.242448 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1247b7-6adc-4a14-98e0-33d2e23348d6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:32.242729 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1247b7-6adc-4a14-98e0-33d2e23348d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:32.243000 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1247b7-6adc-4a14-98e0-33d2e23348d6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:32.250540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1247b7-6adc-4a14-98e0-33d2e23348d6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:32.251958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1247b7-6adc-4a14-98e0-33d2e23348d6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:32.263801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-ef1247b7-6adc-4a14-98e0-33d2e23348d6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:47:32.263801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:32.263801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:32.263801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:32.263801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:32.263801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:32.263801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:32.263801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:32.263801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:32.263801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:32.263801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:32.263801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:32.263801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:47:32.263801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:47:32.263801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:47:32.263801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:47:32.264828 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:32.264828 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:32.264828 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:47:32.264828 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:47:32.264828 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:47:32.264828 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:47:32.264828 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:32.264828 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:32.264828 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:32.264828 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:32.264828 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:32.264828 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:32.264828 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:32.264828 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:32.264828 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:32.264828 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:32.264828 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:32.264828 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:32.265885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:32.265885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:32.265885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:47:32.265885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:47:32.265885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:47:32.265885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:47:32.265885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:47:32.265885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:47:32.265885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:47:32.265885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:47:32.265885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 610/1226] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:32.270833 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632dd15-b922-4d3d-b546-d69bfe409475 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:32.316768 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:32.367775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632dd15-b922-4d3d-b546-d69bfe409475 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:32.400528 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63df3b3-2c4e-43ae-ac1d-a72c27e71c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:32.401147 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63df3b3-2c4e-43ae-ac1d-a72c27e71c82 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:32.401965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63df3b3-2c4e-43ae-ac1d-a72c27e71c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:32.402238 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63df3b3-2c4e-43ae-ac1d-a72c27e71c82 None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:32.402975 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63df3b3-2c4e-43ae-ac1d-a72c27e71c82 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:32.403280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63df3b3-2c4e-43ae-ac1d-a72c27e71c82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:32.404705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63df3b3-2c4e-43ae-ac1d-a72c27e71c82 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:32.421565 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 617/1227] 10.222.0.59 () {56 vars in 1143 bytes} [Tue Sep 13 19:47:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:32.427892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1247b7-6adc-4a14-98e0-33d2e23348d6 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:32.526212 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1247b7-6adc-4a14-98e0-33d2e23348d6 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:32.559357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d7fd8-36a7-4011-9da7-9f4dca0ab484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:32.559997 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d7fd8-36a7-4011-9da7-9f4dca0ab484 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:32.560281 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d7fd8-36a7-4011-9da7-9f4dca0ab484 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:32.560549 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55d7fd8-36a7-4011-9da7-9f4dca0ab484 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:32.571455 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d7fd8-36a7-4011-9da7-9f4dca0ab484 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:32.572809 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55d7fd8-36a7-4011-9da7-9f4dca0ab484 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:32.587104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-a55d7fd8-36a7-4011-9da7-9f4dca0ab484 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:32.587104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:32.587104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:32.587104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:32.587104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:32.587104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:32.587104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:32.587104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:32.587104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:32.587104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:32.587104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:32.587104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:32.587104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:47:32.587104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:47:32.587104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:47:32.587104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:47:32.588240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:32.588240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:32.588240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:32.588240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:32.588240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:32.588240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:32.588240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:32.588240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:32.588240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:32.588240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:32.588240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:32.588240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:32.588240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:32.588240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:32.588240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:32.588240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:32.588240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:47:32.589323 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:47:32.589323 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:32.589323 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:47:32.589323 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 611/1228] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:32.593977 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63df3b3-2c4e-43ae-ac1d-a72c27e71c82 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:32.691147 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63df3b3-2c4e-43ae-ac1d-a72c27e71c82 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:32.694012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:32.724287 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b856c8-d588-4403-af83-60309bdaf820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:32.724929 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b856c8-d588-4403-af83-60309bdaf820 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:32.725456 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b856c8-d588-4403-af83-60309bdaf820 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:32.725813 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b856c8-d588-4403-af83-60309bdaf820 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:32.726599 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b856c8-d588-4403-af83-60309bdaf820 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:32.727211 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b856c8-d588-4403-af83-60309bdaf820 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:32.728566 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b856c8-d588-4403-af83-60309bdaf820 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:32.739364 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 618/1229] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:47:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:32.745019 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d7fd8-36a7-4011-9da7-9f4dca0ab484 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:32.754265 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:32.842905 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55d7fd8-36a7-4011-9da7-9f4dca0ab484 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:32.875769 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45862196-8ba0-4906-9909-15de08d9a7ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:32.876405 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45862196-8ba0-4906-9909-15de08d9a7ad None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:32.876684 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45862196-8ba0-4906-9909-15de08d9a7ad None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:32.876953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45862196-8ba0-4906-9909-15de08d9a7ad None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:32.884622 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45862196-8ba0-4906-9909-15de08d9a7ad None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:32.886139 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45862196-8ba0-4906-9909-15de08d9a7ad None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:32.897490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-45862196-8ba0-4906-9909-15de08d9a7ad None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:47:32.897490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:32.897490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:32.897490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:32.897490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:32.897490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:32.897490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:32.897490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:32.897490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:32.897490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:32.897490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:32.897490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:32.897490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:47:32.897490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:47:32.897490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:47:32.898574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:47:32.898574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:32.898574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:32.898574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:32.898574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:32.898574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:32.898574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:32.898574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:32.898574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:32.898574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:32.898574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:32.898574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:32.898574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:32.898574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:32.898574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:32.898574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:32.898574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:32.899650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:47:32.899650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:47:32.899650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:47:32.899650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:47:32.899650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:47:32.899650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:47:32.899650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:47:32.899650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:47:32.899650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 612/1230] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:47:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:32.904497 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b856c8-d588-4403-af83-60309bdaf820 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:33.001110 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b856c8-d588-4403-af83-60309bdaf820 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:33.033898 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5e5b3-b921-4242-8369-92bc71dd544d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:33.034491 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5e5b3-b921-4242-8369-92bc71dd544d None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:33.034761 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5e5b3-b921-4242-8369-92bc71dd544d None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:33.035024 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5e5b3-b921-4242-8369-92bc71dd544d None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:33.035696 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5e5b3-b921-4242-8369-92bc71dd544d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:33.035995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5e5b3-b921-4242-8369-92bc71dd544d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:33.037429 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5e5b3-b921-4242-8369-92bc71dd544d None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:33.049617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 619/1231] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:47:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:33.056192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45862196-8ba0-4906-9909-15de08d9a7ad None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:33.120093 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:33.154148 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45862196-8ba0-4906-9909-15de08d9a7ad None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:33.186734 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c829caf-b250-41b6-b768-3d36585cf56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:33.187379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c829caf-b250-41b6-b768-3d36585cf56a None admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:33.187685 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c829caf-b250-41b6-b768-3d36585cf56a None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:33.187950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c829caf-b250-41b6-b768-3d36585cf56a None admin] PATH_INFO: `/v3/projects/ad67761fec0a430181877e216e90e7d4/users/89e7df5170c841abb449f3b4a547ec4d/roles/b253c1f3cd6a4197a85ca5f672852073` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:33.203096 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c829caf-b250-41b6-b768-3d36585cf56a None admin] RBAC: Authorizing `identity:create_grant(project_id=ad67761fec0a430181877e216e90e7d4, user_id=89e7df5170c841abb449f3b4a547ec4d, role_id=b253c1f3cd6a4197a85ca5f672852073)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:33.204509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c829caf-b250-41b6-b768-3d36585cf56a None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:33.291839 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 613/1232] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Sep 13 19:47:33 2022] PUT /identity/v3/projects/ad67761fec0a430181877e216e90e7d4/users/89e7df5170c841abb449f3b4a547ec4d/roles/b253c1f3cd6a4197a85ca5f672852073 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:47:35.383101 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19764640-35be-4302-aa9a-c30e6cab24d8 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:35.383636 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19764640-35be-4302-aa9a-c30e6cab24d8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:35.383636 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19764640-35be-4302-aa9a-c30e6cab24d8 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:35.384976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 620/1233] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:47:35.390236 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7d25c-b15d-4d4f-a115-14c189a20e8c None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:35.390666 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7d25c-b15d-4d4f-a115-14c189a20e8c None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:35.390796 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a7d25c-b15d-4d4f-a115-14c189a20e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:35.408711 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-b3a7d25c-b15d-4d4f-a115-14c189a20e8c None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:47:35.409918 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b3a7d25c-b15d-4d4f-a115-14c189a20e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:35.474449 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 614/1234] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:47:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:47:35.737779 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19764640-35be-4302-aa9a-c30e6cab24d8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:35.763213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:35.837252 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19764640-35be-4302-aa9a-c30e6cab24d8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:35.870695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13881ae-9e94-488e-a216-620626037179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:35.871312 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13881ae-9e94-488e-a216-620626037179 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:35.871591 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13881ae-9e94-488e-a216-620626037179 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:35.871861 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13881ae-9e94-488e-a216-620626037179 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:35.882166 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13881ae-9e94-488e-a216-620626037179 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:47:35.887061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-e13881ae-9e94-488e-a216-620626037179 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:47:35.887061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:35.887061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:35.887061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:35.887061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:35.887061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:35.887061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:35.887061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:35.887061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:35.887061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:35.887061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:35.887061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:35.887061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:47:35.887061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:47:35.887061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:47:35.887061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:47:35.888121 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:47:35.888121 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:47:35.888121 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:47:35.888121 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:47:35.888121 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:35.888121 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:35.888121 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:35.888121 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:35.888121 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:35.888121 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:35.888121 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:35.888121 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:35.888121 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:35.888121 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:35.888121 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:35.888121 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:35.889949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:35.889949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:35.889949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:35.889949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:35.889949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:47:35.889949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:47:35.889949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:47:35.889949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:47:35.889949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:47:35.889949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:47:35.889949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 13 19:47:35.889949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:47:35.889949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 621/1235] 10.222.0.59 () {56 vars in 1102 bytes} [Tue Sep 13 19:47:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:35.894294 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7d25c-b15d-4d4f-a115-14c189a20e8c None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:35.938874 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:35.989551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a7d25c-b15d-4d4f-a115-14c189a20e8c None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:36.021946 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c5370-bc54-45fa-a05e-0eec58fb773b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:36.022532 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c5370-bc54-45fa-a05e-0eec58fb773b None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:36.022808 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c5370-bc54-45fa-a05e-0eec58fb773b None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:36.023075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656c5370-bc54-45fa-a05e-0eec58fb773b None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:36.023723 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c5370-bc54-45fa-a05e-0eec58fb773b None admin] RBAC: Adding query filter params (name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:36.024020 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c5370-bc54-45fa-a05e-0eec58fb773b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:36.025360 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656c5370-bc54-45fa-a05e-0eec58fb773b None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:36.032832 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 615/1236] 10.222.0.59 () {56 vars in 1103 bytes} [Tue Sep 13 19:47:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:36.039215 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13881ae-9e94-488e-a216-620626037179 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:36.125263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:36.140925 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13881ae-9e94-488e-a216-620626037179 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:36.173594 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bfcae-8780-4d46-87d6-72e59537109a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:36.174227 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bfcae-8780-4d46-87d6-72e59537109a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:36.174503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bfcae-8780-4d46-87d6-72e59537109a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:36.174771 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4bfcae-8780-4d46-87d6-72e59537109a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:36.184222 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4bfcae-8780-4d46-87d6-72e59537109a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:36.185645 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4bfcae-8780-4d46-87d6-72e59537109a None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:36.199941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-6b4bfcae-8780-4d46-87d6-72e59537109a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:36.199941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:36.199941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:36.199941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:36.199941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:36.199941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:36.199941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:36.199941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:36.199941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:36.199941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:36.199941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:36.199941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:36.199941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:47:36.199941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:47:36.199941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:47:36.199941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:47:36.201073 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:36.201073 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:36.201073 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:36.201073 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:36.201073 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:36.201073 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:36.201073 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:36.201073 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:36.201073 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:36.201073 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:36.201073 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:36.201073 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:36.201073 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:36.201073 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:36.201073 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:36.201073 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:36.201073 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:47:36.202095 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:47:36.202095 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:36.202095 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:47:36.202095 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 622/1237] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:36.206893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c5370-bc54-45fa-a05e-0eec58fb773b None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:36.301906 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656c5370-bc54-45fa-a05e-0eec58fb773b None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:36.334088 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f1238-24d4-482b-b50a-9272f137359c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:36.334682 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f1238-24d4-482b-b50a-9272f137359c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:36.334957 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f1238-24d4-482b-b50a-9272f137359c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:36.335225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f1238-24d4-482b-b50a-9272f137359c None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:36.335848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f1238-24d4-482b-b50a-9272f137359c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:36.336141 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f1238-24d4-482b-b50a-9272f137359c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:36.337478 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f1238-24d4-482b-b50a-9272f137359c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:36.348592 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 616/1238] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:47:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:36.354351 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bfcae-8780-4d46-87d6-72e59537109a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:36.451709 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4bfcae-8780-4d46-87d6-72e59537109a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:36.458721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:36.485080 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b59c19-d2ce-4fac-a406-cbb1e388ecbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:36.485685 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b59c19-d2ce-4fac-a406-cbb1e388ecbb None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:36.485998 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b59c19-d2ce-4fac-a406-cbb1e388ecbb None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:36.486270 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b59c19-d2ce-4fac-a406-cbb1e388ecbb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:36.488849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:36.493753 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b59c19-d2ce-4fac-a406-cbb1e388ecbb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:36.495174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b59c19-d2ce-4fac-a406-cbb1e388ecbb None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:36.506581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-74b59c19-d2ce-4fac-a406-cbb1e388ecbb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:47:36.506581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:36.506581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:36.506581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:36.506581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:36.506581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:36.506581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:36.506581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:36.506581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:36.506581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:36.506581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:36.506581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:36.506581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:47:36.506581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:47:36.506581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:47:36.506581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:47:36.508522 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:36.508522 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:36.508522 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:47:36.508522 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:47:36.508522 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:47:36.508522 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:47:36.508522 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:36.508522 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:36.508522 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:36.508522 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:36.508522 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:36.508522 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:36.508522 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:36.508522 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:36.508522 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:36.508522 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:36.508522 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:36.508522 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:36.509839 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:36.509839 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:36.509839 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:47:36.509839 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:47:36.509839 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:47:36.509839 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:47:36.509839 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:47:36.509839 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:47:36.509839 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:47:36.509839 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:47:36.509839 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 623/1239] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:36.513804 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f1238-24d4-482b-b50a-9272f137359c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:36.611234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f1238-24d4-482b-b50a-9272f137359c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:36.643958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae6927-27f7-4973-a831-8cb8e0802853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:36.644553 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae6927-27f7-4973-a831-8cb8e0802853 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:36.644829 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae6927-27f7-4973-a831-8cb8e0802853 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:36.645133 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ae6927-27f7-4973-a831-8cb8e0802853 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:36.646373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae6927-27f7-4973-a831-8cb8e0802853 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:36.646674 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae6927-27f7-4973-a831-8cb8e0802853 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:36.648081 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ae6927-27f7-4973-a831-8cb8e0802853 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:36.666046 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 617/1240] 10.222.0.59 () {56 vars in 1143 bytes} [Tue Sep 13 19:47:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:47:36.671766 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b59c19-d2ce-4fac-a406-cbb1e388ecbb None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:36.771779 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b59c19-d2ce-4fac-a406-cbb1e388ecbb None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:36.803854 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815804f5-ae9b-4ff2-9547-7654d66d39f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:36.804440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815804f5-ae9b-4ff2-9547-7654d66d39f6 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:36.804759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815804f5-ae9b-4ff2-9547-7654d66d39f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:36.805028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815804f5-ae9b-4ff2-9547-7654d66d39f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:36.864969 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:36.871212 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815804f5-ae9b-4ff2-9547-7654d66d39f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:36.872643 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815804f5-ae9b-4ff2-9547-7654d66d39f6 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:36.968462 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 624/1241] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:47:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:47:36.974872 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae6927-27f7-4973-a831-8cb8e0802853 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:37.001938 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:37.073130 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ae6927-27f7-4973-a831-8cb8e0802853 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:37.106466 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252d1b0-13a6-47d6-a42e-a36b442fbb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:37.107089 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252d1b0-13a6-47d6-a42e-a36b442fbb40 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:37.107371 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252d1b0-13a6-47d6-a42e-a36b442fbb40 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:37.107690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5252d1b0-13a6-47d6-a42e-a36b442fbb40 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:37.118300 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252d1b0-13a6-47d6-a42e-a36b442fbb40 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:37.119668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5252d1b0-13a6-47d6-a42e-a36b442fbb40 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:37.134301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-5252d1b0-13a6-47d6-a42e-a36b442fbb40 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:37.134301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:37.134301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:37.134301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:37.134301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:37.134301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:37.134301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:37.134301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:37.134301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:37.134301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:37.134301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:37.134301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:37.134301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:47:37.134301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:47:37.134301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:47:37.134301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:47:37.138883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:37.138883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:37.138883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:37.138883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:37.138883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:37.138883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:37.138883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:37.138883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:37.138883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:37.138883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:37.138883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:37.138883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:37.138883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:37.138883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:37.138883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:37.138883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:37.138883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:47:37.140021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:47:37.140021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:37.140021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:47:37.140021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 618/1242] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:37.141305 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815804f5-ae9b-4ff2-9547-7654d66d39f6 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:37.232641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:37.238385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815804f5-ae9b-4ff2-9547-7654d66d39f6 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:37.271390 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188027f8-3b27-4834-aa49-c3705800ea95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:37.272002 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188027f8-3b27-4834-aa49-c3705800ea95 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:37.272367 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188027f8-3b27-4834-aa49-c3705800ea95 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:37.272654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188027f8-3b27-4834-aa49-c3705800ea95 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:37.273288 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188027f8-3b27-4834-aa49-c3705800ea95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:37.273590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188027f8-3b27-4834-aa49-c3705800ea95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:37.274989 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188027f8-3b27-4834-aa49-c3705800ea95 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:37.285776 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 625/1243] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:47:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:37.292024 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252d1b0-13a6-47d6-a42e-a36b442fbb40 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:37.370831 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:37.391712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5252d1b0-13a6-47d6-a42e-a36b442fbb40 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:37.425650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc3214-bd33-4c87-a895-e0f20c992d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:37.426304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc3214-bd33-4c87-a895-e0f20c992d38 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:37.426630 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc3214-bd33-4c87-a895-e0f20c992d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:37.426905 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffc3214-bd33-4c87-a895-e0f20c992d38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:37.433398 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc3214-bd33-4c87-a895-e0f20c992d38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:37.434864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffc3214-bd33-4c87-a895-e0f20c992d38 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:37.446028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-1ffc3214-bd33-4c87-a895-e0f20c992d38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:47:37.446028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:37.446028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:37.446028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:37.446028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:37.446028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:37.446028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:37.446028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:37.446028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:37.446028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:37.446028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:37.446028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:37.446028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:47:37.446028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:47:37.446028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:47:37.446919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:47:37.446919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:37.446919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:37.446919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:37.446919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:37.446919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:37.446919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:37.446919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:37.446919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:37.446919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:37.446919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:37.446919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:37.446919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:37.446919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:37.446919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:37.446919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:37.446919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:37.447938 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:47:37.447938 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:47:37.447938 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:47:37.447938 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:47:37.447938 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:47:37.447938 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:47:37.447938 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:47:37.447938 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:47:37.447938 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 619/1244] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:47:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:37.453005 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188027f8-3b27-4834-aa49-c3705800ea95 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:37.551114 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188027f8-3b27-4834-aa49-c3705800ea95 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:37.583653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b9afb-4c91-41f7-9061-595d49ca89fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:37.584246 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b9afb-4c91-41f7-9061-595d49ca89fe None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:37.584521 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b9afb-4c91-41f7-9061-595d49ca89fe None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:37.584788 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b9afb-4c91-41f7-9061-595d49ca89fe None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:37.585464 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b9afb-4c91-41f7-9061-595d49ca89fe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:37.585795 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b9afb-4c91-41f7-9061-595d49ca89fe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:37.587210 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b9afb-4c91-41f7-9061-595d49ca89fe None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:37.599332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 626/1245] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:47:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:37.605363 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc3214-bd33-4c87-a895-e0f20c992d38 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:37.703622 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffc3214-bd33-4c87-a895-e0f20c992d38 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:37.736313 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf62b17f-4c13-4c62-b695-e5194db553ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:37.736908 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62b17f-4c13-4c62-b695-e5194db553ba None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:37.737187 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62b17f-4c13-4c62-b695-e5194db553ba None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:37.737456 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf62b17f-4c13-4c62-b695-e5194db553ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:37.738192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62b17f-4c13-4c62-b695-e5194db553ba None admin] RBAC: Adding query filter params (role.id=b253c1f3cd6a4197a85ca5f672852073, scope.project.id=ad67761fec0a430181877e216e90e7d4, user.id=89e7df5170c841abb449f3b4a547ec4d) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:37.738498 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62b17f-4c13-4c62-b695-e5194db553ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:37.739928 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf62b17f-4c13-4c62-b695-e5194db553ba None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:37.745582 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 620/1246] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:47:37 2022] GET /identity/v3/role_assignments?user.id=89e7df5170c841abb449f3b4a547ec4d&scope.project.id=ad67761fec0a430181877e216e90e7d4&role.id=b253c1f3cd6a4197a85ca5f672852073 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:39.930278 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fb551-debb-41df-a849-62d3e4017209 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:39.930769 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fb551-debb-41df-a849-62d3e4017209 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:39.930929 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fb551-debb-41df-a849-62d3e4017209 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:39.932139 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 627/1247] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:47:39.937266 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbaf4c-65c0-48a3-ab13-81ce61e563ca None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:39.937768 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbaf4c-65c0-48a3-ab13-81ce61e563ca None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:39.937890 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fbaf4c-65c0-48a3-ab13-81ce61e563ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:39.944551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:39.956737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-81fbaf4c-65c0-48a3-ab13-81ce61e563ca None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:47:39.958613 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-81fbaf4c-65c0-48a3-ab13-81ce61e563ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:40.025059 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 621/1248] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:47:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 13 19:47:40.291482 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fb551-debb-41df-a849-62d3e4017209 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:40.310068 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:40.391678 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fb551-debb-41df-a849-62d3e4017209 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:40.425852 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f72fef-eb5a-462a-a666-9070663c198a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:40.426991 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f72fef-eb5a-462a-a666-9070663c198a None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:40.427270 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f72fef-eb5a-462a-a666-9070663c198a None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:40.427575 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f72fef-eb5a-462a-a666-9070663c198a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:40.437326 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f72fef-eb5a-462a-a666-9070663c198a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:47:40.442778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-87f72fef-eb5a-462a-a666-9070663c198a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:47:40.442778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:40.442778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:40.442778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:40.442778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:40.442778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:40.442778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:40.442778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:40.442778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:40.442778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:40.442778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:40.442778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:40.442778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:47:40.442778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:47:40.442778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:47:40.442778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:47:40.443799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:47:40.443799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:47:40.443799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:47:40.443799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:47:40.443799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:40.443799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:40.443799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:40.443799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:40.443799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:40.443799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:40.443799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:40.443799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:40.443799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:40.443799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:40.443799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:40.443799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:40.444828 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:40.444828 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:40.444828 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:40.444828 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:40.444828 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:47:40.444828 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:47:40.444828 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:47:40.444828 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:47:40.444828 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:47:40.444828 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:47:40.444828 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:47:40.444828 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:47:40.444828 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 628/1249] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:47:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:40.449905 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbaf4c-65c0-48a3-ab13-81ce61e563ca None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:40.547787 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fbaf4c-65c0-48a3-ab13-81ce61e563ca None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:40.577942 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:40.582720 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71a75b-2c74-48f5-bb05-837319d42bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:40.583314 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71a75b-2c74-48f5-bb05-837319d42bd6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:40.583586 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71a75b-2c74-48f5-bb05-837319d42bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:40.583852 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b71a75b-2c74-48f5-bb05-837319d42bd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:40.584496 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71a75b-2c74-48f5-bb05-837319d42bd6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:40.584792 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71a75b-2c74-48f5-bb05-837319d42bd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:40.586178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b71a75b-2c74-48f5-bb05-837319d42bd6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:40.594139 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 622/1250] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:47:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:40.600126 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f72fef-eb5a-462a-a666-9070663c198a None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:40.675036 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:40.697849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f72fef-eb5a-462a-a666-9070663c198a None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:40.730345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473e61d-de60-4a2d-bbee-1a93b2c64c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:40.730949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473e61d-de60-4a2d-bbee-1a93b2c64c81 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:40.731223 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473e61d-de60-4a2d-bbee-1a93b2c64c81 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:40.731490 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d473e61d-de60-4a2d-bbee-1a93b2c64c81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:40.743543 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473e61d-de60-4a2d-bbee-1a93b2c64c81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:40.744989 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d473e61d-de60-4a2d-bbee-1a93b2c64c81 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:40.758994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-d473e61d-de60-4a2d-bbee-1a93b2c64c81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:40.758994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:40.758994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:40.758994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:40.758994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:40.758994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:40.758994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:40.758994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:40.758994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:40.758994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:40.758994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:40.758994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:40.758994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:47:40.758994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:47:40.758994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:47:40.758994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:47:40.761156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:40.761156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:40.761156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:40.761156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:40.761156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:40.761156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:40.761156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:40.761156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:40.761156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:40.761156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:40.761156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:40.761156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:40.761156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:40.761156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:40.761156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:40.761156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:40.761156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:47:40.762399 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:47:40.762399 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:40.762399 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:47:40.762399 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 629/1251] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:40.765907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71a75b-2c74-48f5-bb05-837319d42bd6 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:40.862721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b71a75b-2c74-48f5-bb05-837319d42bd6 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:40.899126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125cfd63-38b2-43af-bf31-e5d320ddf85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:40.899735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cfd63-38b2-43af-bf31-e5d320ddf85e None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:40.900016 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cfd63-38b2-43af-bf31-e5d320ddf85e None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:40.900290 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125cfd63-38b2-43af-bf31-e5d320ddf85e None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:40.900924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125cfd63-38b2-43af-bf31-e5d320ddf85e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:40.901253 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125cfd63-38b2-43af-bf31-e5d320ddf85e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:40.902641 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125cfd63-38b2-43af-bf31-e5d320ddf85e None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:40.914892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 623/1252] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:47:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:47:40.920603 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473e61d-de60-4a2d-bbee-1a93b2c64c81 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:41.018137 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d473e61d-de60-4a2d-bbee-1a93b2c64c81 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:41.043562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:41.052062 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03f82e-ec52-4131-bbb3-0bde16210f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:41.052676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03f82e-ec52-4131-bbb3-0bde16210f02 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:41.052952 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03f82e-ec52-4131-bbb3-0bde16210f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:41.053218 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03f82e-ec52-4131-bbb3-0bde16210f02 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:41.060469 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03f82e-ec52-4131-bbb3-0bde16210f02 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:41.061958 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03f82e-ec52-4131-bbb3-0bde16210f02 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:41.072909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-dd03f82e-ec52-4131-bbb3-0bde16210f02 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:47:41.072909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:41.072909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:41.072909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:41.072909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:41.072909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:41.072909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:41.072909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:41.072909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:41.072909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:41.072909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:41.072909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:41.072909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:47:41.072909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:47:41.072909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:47:41.072909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:47:41.074091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:41.074091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:41.074091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:47:41.074091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:47:41.074091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:47:41.074091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:47:41.074091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:41.074091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:41.074091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:41.074091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:41.074091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:41.074091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:41.074091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:41.074091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:41.074091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:41.074091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:41.074091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:41.074091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:41.075345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:41.075345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:41.075345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:47:41.075345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:47:41.075345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:47:41.075345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:47:41.075345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:47:41.075345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:47:41.075345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:47:41.075345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:47:41.075345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 630/1253] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:41.080156 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125cfd63-38b2-43af-bf31-e5d320ddf85e None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:41.137188 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:41.180089 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125cfd63-38b2-43af-bf31-e5d320ddf85e None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:41.213620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc4072-8fdc-4447-b35b-5742a4fcdedd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:41.214250 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc4072-8fdc-4447-b35b-5742a4fcdedd None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:41.214532 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc4072-8fdc-4447-b35b-5742a4fcdedd None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:41.214804 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bc4072-8fdc-4447-b35b-5742a4fcdedd None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:41.215525 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc4072-8fdc-4447-b35b-5742a4fcdedd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:41.215853 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc4072-8fdc-4447-b35b-5742a4fcdedd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:41.217325 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bc4072-8fdc-4447-b35b-5742a4fcdedd None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:41.235945 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 624/1254] 10.222.0.59 () {56 vars in 1143 bytes} [Tue Sep 13 19:47:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:41.241707 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03f82e-ec52-4131-bbb3-0bde16210f02 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:41.339266 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03f82e-ec52-4131-bbb3-0bde16210f02 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:41.371633 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da695c3-a699-4331-8a8e-0f59b53b6d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:41.372223 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da695c3-a699-4331-8a8e-0f59b53b6d32 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:41.372497 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da695c3-a699-4331-8a8e-0f59b53b6d32 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:41.372766 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da695c3-a699-4331-8a8e-0f59b53b6d32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:41.426815 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:41.439376 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da695c3-a699-4331-8a8e-0f59b53b6d32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:41.440800 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da695c3-a699-4331-8a8e-0f59b53b6d32 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:41.536452 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 631/1255] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:47:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:47:41.542277 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc4072-8fdc-4447-b35b-5742a4fcdedd None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:41.639637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bc4072-8fdc-4447-b35b-5742a4fcdedd None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:41.653078 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:41.673465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ed484-1375-4f5b-87f8-73685c720919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:41.674114 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ed484-1375-4f5b-87f8-73685c720919 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:41.674389 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ed484-1375-4f5b-87f8-73685c720919 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:41.674653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ed484-1375-4f5b-87f8-73685c720919 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:41.689787 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ed484-1375-4f5b-87f8-73685c720919 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:41.689787 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ed484-1375-4f5b-87f8-73685c720919 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:41.700245 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-161ed484-1375-4f5b-87f8-73685c720919 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:41.700245 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:41.700245 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:41.700245 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:41.700245 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:41.700245 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:41.700245 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:41.700245 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:41.700245 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:41.700245 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:41.700245 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:41.700245 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:41.700245 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:47:41.700245 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:47:41.700245 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:47:41.700245 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:47:41.701445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:41.701445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:41.701445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:41.701445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:41.701445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:41.701445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:41.701445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:41.701445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:41.701445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:41.701445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:41.701445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:41.701445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:41.701445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:41.701445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:41.701445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:41.701445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:41.701445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:47:41.702654 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:47:41.702654 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:41.702654 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:47:41.702654 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 625/1256] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:41.707266 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da695c3-a699-4331-8a8e-0f59b53b6d32 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:41.793569 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:41.805846 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da695c3-a699-4331-8a8e-0f59b53b6d32 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:41.839346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc93a0-4d9f-46e3-9d3a-62bd45c0eddc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:41.839946 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc93a0-4d9f-46e3-9d3a-62bd45c0eddc None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:41.840227 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc93a0-4d9f-46e3-9d3a-62bd45c0eddc None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:41.840502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cbc93a0-4d9f-46e3-9d3a-62bd45c0eddc None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:41.841148 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc93a0-4d9f-46e3-9d3a-62bd45c0eddc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:41.841453 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc93a0-4d9f-46e3-9d3a-62bd45c0eddc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:41.842852 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cbc93a0-4d9f-46e3-9d3a-62bd45c0eddc None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:41.853729 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 632/1257] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:47:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:41.859577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ed484-1375-4f5b-87f8-73685c720919 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:41.960800 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ed484-1375-4f5b-87f8-73685c720919 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:41.993057 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5372c-47c0-415f-9547-cb4f4a287413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:41.993668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5372c-47c0-415f-9547-cb4f4a287413 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:41.993975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5372c-47c0-415f-9547-cb4f4a287413 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:41.994244 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5372c-47c0-415f-9547-cb4f4a287413 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:42.000632 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5372c-47c0-415f-9547-cb4f4a287413 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:42.002104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5372c-47c0-415f-9547-cb4f4a287413 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:42.014762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-56e5372c-47c0-415f-9547-cb4f4a287413 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:47:42.014762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:42.014762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:42.014762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:42.014762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:42.014762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:42.014762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:42.014762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:42.014762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:42.014762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:42.014762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:42.014762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:42.014762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:47:42.014762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:47:42.014762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:47:42.018072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:47:42.018072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:42.018072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:42.018072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:42.018072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:42.018072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:42.018072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:42.018072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:42.018072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:42.018072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:42.018072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:42.018072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:42.018072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:42.018072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:42.018072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:42.018072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:42.018072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:42.019225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:47:42.019225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:47:42.019225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:47:42.019225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:47:42.019225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:47:42.019225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:47:42.019225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:47:42.019225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:47:42.019225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 626/1258] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:47:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:42.022179 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc93a0-4d9f-46e3-9d3a-62bd45c0eddc None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:42.123267 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cbc93a0-4d9f-46e3-9d3a-62bd45c0eddc None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:42.156254 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e797cd19-40f7-4961-b063-5616f5a18d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:42.156841 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797cd19-40f7-4961-b063-5616f5a18d55 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:42.157115 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797cd19-40f7-4961-b063-5616f5a18d55 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:42.157421 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e797cd19-40f7-4961-b063-5616f5a18d55 None admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:42.158131 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797cd19-40f7-4961-b063-5616f5a18d55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:42.158430 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797cd19-40f7-4961-b063-5616f5a18d55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:42.159841 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e797cd19-40f7-4961-b063-5616f5a18d55 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:42.171460 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 633/1259] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:47:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:42.178441 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5372c-47c0-415f-9547-cb4f4a287413 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:42.204583 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:42.276005 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5372c-47c0-415f-9547-cb4f4a287413 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:42.308927 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4109bfbe-8dc9-4ce5-b22c-23bd903d244f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:42.309519 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109bfbe-8dc9-4ce5-b22c-23bd903d244f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:42.309826 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109bfbe-8dc9-4ce5-b22c-23bd903d244f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:42.310101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4109bfbe-8dc9-4ce5-b22c-23bd903d244f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:42.310814 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4109bfbe-8dc9-4ce5-b22c-23bd903d244f None admin] RBAC: Adding query filter params (role.id=cd02ef2043de492a8bff6c165485f255, scope.project.id=ad67761fec0a430181877e216e90e7d4, user.id=89e7df5170c841abb449f3b4a547ec4d) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:42.311126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4109bfbe-8dc9-4ce5-b22c-23bd903d244f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:42.312603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4109bfbe-8dc9-4ce5-b22c-23bd903d244f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:42.317779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 627/1260] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:47:42 2022] GET /identity/v3/role_assignments?user.id=89e7df5170c841abb449f3b4a547ec4d&scope.project.id=ad67761fec0a430181877e216e90e7d4&role.id=cd02ef2043de492a8bff6c165485f255 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:44.447389 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029df64-01a1-4ed3-99a1-698d97e207bb None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:44.447927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029df64-01a1-4ed3-99a1-698d97e207bb None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:44.447927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5029df64-01a1-4ed3-99a1-698d97e207bb None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:44.449325 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 634/1261] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:47:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:47:44.454434 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e6be8-aed0-420b-8c89-ce064218a6bc None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:44.454826 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e6be8-aed0-420b-8c89-ce064218a6bc None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:44.454989 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883e6be8-aed0-420b-8c89-ce064218a6bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:44.472852 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-883e6be8-aed0-420b-8c89-ce064218a6bc None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:47:44.474596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-883e6be8-aed0-420b-8c89-ce064218a6bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:44.541616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 628/1262] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:47:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:47:44.808869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029df64-01a1-4ed3-99a1-698d97e207bb None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:44.819692 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:44.912453 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5029df64-01a1-4ed3-99a1-698d97e207bb None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:44.945391 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fce241-4632-4c8d-9460-b0ed003ecb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:44.946036 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fce241-4632-4c8d-9460-b0ed003ecb2f None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:44.946315 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fce241-4632-4c8d-9460-b0ed003ecb2f None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:44.946588 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fce241-4632-4c8d-9460-b0ed003ecb2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:44.956629 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fce241-4632-4c8d-9460-b0ed003ecb2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:47:44.962090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-20fce241-4632-4c8d-9460-b0ed003ecb2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:47:44.962090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:44.962090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:44.962090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:44.962090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:44.962090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:44.962090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:44.962090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:44.962090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:44.962090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:44.962090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:44.962090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:44.962090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:47:44.962090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:47:44.962090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:47:44.962090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:47:44.963192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:47:44.963192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:47:44.963192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:47:44.963192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:47:44.963192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:44.963192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:44.963192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:44.963192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:44.963192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:44.963192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:44.963192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:44.963192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:44.963192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:44.963192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:44.963192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:44.963192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:44.964486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:44.964486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:44.964486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:44.964486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:44.964486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:47:44.964486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:47:44.964486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:47:44.964486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:47:44.964486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:47:44.964486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:47:44.964486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:47:44.964486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:47:44.964486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 635/1263] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:47:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:44.969307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e6be8-aed0-420b-8c89-ce064218a6bc None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:44.987546 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:45.064047 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883e6be8-aed0-420b-8c89-ce064218a6bc None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:45.096129 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a710064-493a-4028-8011-2efe05790c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:45.096725 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a710064-493a-4028-8011-2efe05790c7c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:45.097002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a710064-493a-4028-8011-2efe05790c7c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:45.097274 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a710064-493a-4028-8011-2efe05790c7c None admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:45.097956 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a710064-493a-4028-8011-2efe05790c7c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:45.098831 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a710064-493a-4028-8011-2efe05790c7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:45.100238 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a710064-493a-4028-8011-2efe05790c7c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:45.107968 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 629/1264] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:47:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:45.113660 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fce241-4632-4c8d-9460-b0ed003ecb2f None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:45.181060 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:45.213881 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fce241-4632-4c8d-9460-b0ed003ecb2f None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:45.246589 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0b5b9-441b-40e4-9d5e-aa79533f8930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:45.247211 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0b5b9-441b-40e4-9d5e-aa79533f8930 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:45.247484 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0b5b9-441b-40e4-9d5e-aa79533f8930 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:45.247749 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e0b5b9-441b-40e4-9d5e-aa79533f8930 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:45.258780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0b5b9-441b-40e4-9d5e-aa79533f8930 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:45.260206 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e0b5b9-441b-40e4-9d5e-aa79533f8930 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:45.274984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-88e0b5b9-441b-40e4-9d5e-aa79533f8930 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:45.274984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:45.274984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:45.274984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:45.274984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:45.274984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:45.274984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:45.274984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:45.274984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:45.274984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:45.274984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:45.274984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:45.274984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:47:45.274984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:47:45.274984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:47:45.274984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:47:45.276144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:45.276144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:45.276144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:45.276144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:45.276144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:45.276144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:45.276144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:45.276144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:45.276144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:45.276144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:45.276144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:45.276144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:45.276144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:45.276144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:45.276144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:45.276144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:45.276144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:47:45.277278 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:47:45.277278 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:45.277278 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:47:45.277278 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 636/1265] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:47:45.282132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a710064-493a-4028-8011-2efe05790c7c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:45.362087 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:45.382263 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a710064-493a-4028-8011-2efe05790c7c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:45.415022 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec0430-a62d-4a3e-b6a0-7c87a3733fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:45.415626 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec0430-a62d-4a3e-b6a0-7c87a3733fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:45.415909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec0430-a62d-4a3e-b6a0-7c87a3733fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:45.416186 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acec0430-a62d-4a3e-b6a0-7c87a3733fd2 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:45.416813 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec0430-a62d-4a3e-b6a0-7c87a3733fd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:45.417116 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec0430-a62d-4a3e-b6a0-7c87a3733fd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:45.418504 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acec0430-a62d-4a3e-b6a0-7c87a3733fd2 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:45.430482 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 630/1266] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:45.436580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0b5b9-441b-40e4-9d5e-aa79533f8930 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:45.537331 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e0b5b9-441b-40e4-9d5e-aa79533f8930 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:45.556951 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:45.571733 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dedfe-f494-4816-b473-8732d3dca8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:45.572350 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dedfe-f494-4816-b473-8732d3dca8f1 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:45.572625 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dedfe-f494-4816-b473-8732d3dca8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:45.572893 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1dedfe-f494-4816-b473-8732d3dca8f1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:45.580325 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1dedfe-f494-4816-b473-8732d3dca8f1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:45.581862 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1dedfe-f494-4816-b473-8732d3dca8f1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:45.593889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-6b1dedfe-f494-4816-b473-8732d3dca8f1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:47:45.593889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:45.593889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:45.593889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:45.593889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:45.593889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:45.593889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:45.593889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:45.593889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:45.593889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:45.593889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:45.593889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:45.593889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:47:45.593889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:47:45.593889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:47:45.593889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:47:45.595056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:45.595056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:45.595056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:47:45.595056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:47:45.595056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:47:45.595056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:47:45.595056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:45.595056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:45.595056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:45.595056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:45.595056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:45.595056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:45.595056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:45.595056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:45.595056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:45.595056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:45.595056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:45.595056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:45.596173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:45.596173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:45.596173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:47:45.596173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:47:45.596173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:47:45.596173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:47:45.596173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:47:45.596173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:47:45.596173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:47:45.596173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:47:45.596173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 637/1267] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:45.601811 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec0430-a62d-4a3e-b6a0-7c87a3733fd2 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:45.698908 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acec0430-a62d-4a3e-b6a0-7c87a3733fd2 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:45.734202 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa11b12-4d50-468b-a0bc-76c82e0ba065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:45.734825 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa11b12-4d50-468b-a0bc-76c82e0ba065 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:45.735101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa11b12-4d50-468b-a0bc-76c82e0ba065 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:45.735369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa11b12-4d50-468b-a0bc-76c82e0ba065 None admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:45.736113 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa11b12-4d50-468b-a0bc-76c82e0ba065 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:45.736415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa11b12-4d50-468b-a0bc-76c82e0ba065 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:45.737869 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa11b12-4d50-468b-a0bc-76c82e0ba065 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:45.746434 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:45.755433 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 631/1268] 10.222.0.59 () {56 vars in 1143 bytes} [Tue Sep 13 19:47:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:45.761796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dedfe-f494-4816-b473-8732d3dca8f1 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:45.862293 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1dedfe-f494-4816-b473-8732d3dca8f1 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:45.898463 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5dc34-3e12-4136-94cb-0fda1c2aee8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:45.899087 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5dc34-3e12-4136-94cb-0fda1c2aee8c None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:45.899407 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5dc34-3e12-4136-94cb-0fda1c2aee8c None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:45.901335 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f5dc34-3e12-4136-94cb-0fda1c2aee8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:45.910502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f5dc34-3e12-4136-94cb-0fda1c2aee8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:45.911936 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f5dc34-3e12-4136-94cb-0fda1c2aee8c None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:45.925814 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-97f5dc34-3e12-4136-94cb-0fda1c2aee8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:45.925814 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:45.925814 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:45.925814 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:45.925814 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:45.925814 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:45.925814 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:45.925814 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:45.925814 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:45.925814 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:45.925814 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:45.925814 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:45.925814 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:47:45.925814 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:47:45.925814 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:47:45.925814 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:47:45.927537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:45.927537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:45.927537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:45.927537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:45.927537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:45.927537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:45.927537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:45.927537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:45.927537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:45.927537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:45.927537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:45.927537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:45.927537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:45.927537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:45.927537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:45.927537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:45.927537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:47:45.928471 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:47:45.928471 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:45.928471 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:47:45.928471 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 638/1269] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:45.933194 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa11b12-4d50-468b-a0bc-76c82e0ba065 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:46.031985 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa11b12-4d50-468b-a0bc-76c82e0ba065 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:46.065749 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c790e-425f-4790-88e4-3f4a38ea53e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:46.066347 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c790e-425f-4790-88e4-3f4a38ea53e0 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:46.066657 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c790e-425f-4790-88e4-3f4a38ea53e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:46.066953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c790e-425f-4790-88e4-3f4a38ea53e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:46.067579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c790e-425f-4790-88e4-3f4a38ea53e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:46.067877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c790e-425f-4790-88e4-3f4a38ea53e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:46.069237 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c790e-425f-4790-88e4-3f4a38ea53e0 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:46.080292 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 632/1270] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:47:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:46.086133 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5dc34-3e12-4136-94cb-0fda1c2aee8c None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:46.117840 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:46.183836 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f5dc34-3e12-4136-94cb-0fda1c2aee8c None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:46.216451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9820039-eb0b-4cd9-8ff9-aafd509da5ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:46.217059 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9820039-eb0b-4cd9-8ff9-aafd509da5ac None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:46.217333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9820039-eb0b-4cd9-8ff9-aafd509da5ac None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:46.217599 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9820039-eb0b-4cd9-8ff9-aafd509da5ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:46.224590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9820039-eb0b-4cd9-8ff9-aafd509da5ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:46.228652 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9820039-eb0b-4cd9-8ff9-aafd509da5ac None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:46.237648 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-f9820039-eb0b-4cd9-8ff9-aafd509da5ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:47:46.237648 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:46.237648 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:46.237648 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:46.237648 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:46.237648 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:46.237648 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:46.237648 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:46.237648 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:46.237648 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:46.237648 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:46.237648 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:46.237648 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:47:46.237648 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:47:46.237648 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:47:46.241742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:47:46.241742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:46.241742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:46.241742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:46.241742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:46.241742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:46.241742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:46.241742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:46.241742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:46.241742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:46.241742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:46.241742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:46.241742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:46.241742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:46.241742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:46.241742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:46.241742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:46.242920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:47:46.242920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:47:46.242920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:47:46.242920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:47:46.242920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:47:46.242920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:47:46.242920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:47:46.242920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:47:46.242920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 639/1271] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:47:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:46.245452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c790e-425f-4790-88e4-3f4a38ea53e0 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:46.303424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:46.343684 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c790e-425f-4790-88e4-3f4a38ea53e0 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:46.377246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6750bb-0aa7-43a0-8d63-4d3c380f97c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:46.377887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6750bb-0aa7-43a0-8d63-4d3c380f97c7 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:46.378174 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6750bb-0aa7-43a0-8d63-4d3c380f97c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:46.378446 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6750bb-0aa7-43a0-8d63-4d3c380f97c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:46.379164 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6750bb-0aa7-43a0-8d63-4d3c380f97c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:46.379468 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6750bb-0aa7-43a0-8d63-4d3c380f97c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:46.380887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6750bb-0aa7-43a0-8d63-4d3c380f97c7 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:46.393615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 633/1272] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:47:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:46.399919 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9820039-eb0b-4cd9-8ff9-aafd509da5ac None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:46.489667 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:46.498474 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9820039-eb0b-4cd9-8ff9-aafd509da5ac None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:46.530641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca3812-1b9f-4736-8947-84392b9f9fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:46.531305 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca3812-1b9f-4736-8947-84392b9f9fc1 None admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:46.531579 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca3812-1b9f-4736-8947-84392b9f9fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:46.531848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca3812-1b9f-4736-8947-84392b9f9fc1 None admin] PATH_INFO: `/v3/projects/ad67761fec0a430181877e216e90e7d4/users/89e7df5170c841abb449f3b4a547ec4d/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:46.533681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca3812-1b9f-4736-8947-84392b9f9fc1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ad67761fec0a430181877e216e90e7d4, user_id=89e7df5170c841abb449f3b4a547ec4d, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:46.535112 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca3812-1b9f-4736-8947-84392b9f9fc1 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:46.594169 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 640/1273] 10.222.0.59 () {58 vars in 1439 bytes} [Tue Sep 13 19:47:46 2022] PUT /identity/v3/projects/ad67761fec0a430181877e216e90e7d4/users/89e7df5170c841abb449f3b4a547ec4d/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:47:48.725412 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dd00c-bd38-4a78-9f61-604c8917fac3 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:48.726040 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dd00c-bd38-4a78-9f61-604c8917fac3 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:48.726040 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dd00c-bd38-4a78-9f61-604c8917fac3 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:48.727518 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 634/1274] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:47:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:47:48.733026 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1227a3-860a-4fb8-ac7f-f0b81ddad47e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:48.733525 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1227a3-860a-4fb8-ac7f-f0b81ddad47e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:48.733615 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1227a3-860a-4fb8-ac7f-f0b81ddad47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:48.753476 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ce1227a3-860a-4fb8-ac7f-f0b81ddad47e None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:47:48.754727 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ce1227a3-860a-4fb8-ac7f-f0b81ddad47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:48.828297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 641/1275] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:47:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:47:49.099600 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18dd00c-bd38-4a78-9f61-604c8917fac3 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:49.200775 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18dd00c-bd38-4a78-9f61-604c8917fac3 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:49.217893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:49.234307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43512b75-a93b-4476-93d3-731e16075c91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:49.234922 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43512b75-a93b-4476-93d3-731e16075c91 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:49.235197 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43512b75-a93b-4476-93d3-731e16075c91 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:49.235489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43512b75-a93b-4476-93d3-731e16075c91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:49.245915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43512b75-a93b-4476-93d3-731e16075c91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 13 19:47:49.250669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-43512b75-a93b-4476-93d3-731e16075c91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:47:49.250669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:49.250669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:49.250669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:49.250669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:49.250669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:49.250669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:49.250669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:49.250669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:49.250669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:49.250669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:49.250669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:49.250669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 13 19:47:49.250669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 13 19:47:49.250669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 13 19:47:49.250669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 13 19:47:49.251841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 13 19:47:49.251841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 13 19:47:49.251841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 13 19:47:49.251841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 13 19:47:49.251841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:49.251841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:49.251841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:49.251841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:49.251841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:49.251841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:49.251841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:49.251841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:49.251841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:49.251841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:49.251841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:49.251841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:49.253121 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:49.253121 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:49.253121 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:49.253121 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:49.253121 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 13 19:47:49.253121 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 13 19:47:49.253121 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 13 19:47:49.253121 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 13 19:47:49.253121 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 13 19:47:49.253121 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 13 19:47:49.253121 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 13 19:47:49.253121 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:47:49.253121 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 635/1276] 10.222.0.59 () {56 vars in 1096 bytes} [Tue Sep 13 19:47:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:49.257981 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1227a3-860a-4fb8-ac7f-f0b81ddad47e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:49.337296 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:49.355573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1227a3-860a-4fb8-ac7f-f0b81ddad47e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:49.388931 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc4295-167e-40bf-99b1-34b933c3fd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:49.389578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc4295-167e-40bf-99b1-34b933c3fd01 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:49.389883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc4295-167e-40bf-99b1-34b933c3fd01 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:49.390155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccc4295-167e-40bf-99b1-34b933c3fd01 None admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:49.390809 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc4295-167e-40bf-99b1-34b933c3fd01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:49.391107 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc4295-167e-40bf-99b1-34b933c3fd01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:49.392460 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccc4295-167e-40bf-99b1-34b933c3fd01 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:49.400788 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 642/1277] 10.222.0.59 () {56 vars in 1099 bytes} [Tue Sep 13 19:47:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:49.406618 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43512b75-a93b-4476-93d3-731e16075c91 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:49.504151 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43512b75-a93b-4476-93d3-731e16075c91 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:49.539681 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2299d75-9552-41ec-9296-9e049ef70b4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:49.540304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2299d75-9552-41ec-9296-9e049ef70b4c None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:49.540586 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2299d75-9552-41ec-9296-9e049ef70b4c None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:49.540861 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2299d75-9552-41ec-9296-9e049ef70b4c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:49.550813 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2299d75-9552-41ec-9296-9e049ef70b4c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:49.552283 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2299d75-9552-41ec-9296-9e049ef70b4c None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:49.566595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-a2299d75-9552-41ec-9296-9e049ef70b4c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:49.566595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:49.566595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:49.566595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:49.566595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:49.566595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:49.566595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:49.566595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:49.566595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:49.566595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:49.566595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:49.566595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:49.566595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:47:49.566595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:47:49.566595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:47:49.566595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:47:49.567737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:49.567737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:49.567737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:49.567737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:49.567737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:49.567737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:49.567737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:49.567737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:49.567737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:49.567737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:49.567737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:49.567737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:49.567737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:49.567737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:49.567737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:49.567737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:49.567737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:47:49.568676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:47:49.568676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:49.568676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:47:49.568676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 636/1278] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:49.573675 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc4295-167e-40bf-99b1-34b933c3fd01 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:49.671732 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccc4295-167e-40bf-99b1-34b933c3fd01 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:49.703757 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e730af-43f0-4d8f-96cd-545df8db2808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:49.704344 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e730af-43f0-4d8f-96cd-545df8db2808 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:49.704616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e730af-43f0-4d8f-96cd-545df8db2808 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:49.704881 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e730af-43f0-4d8f-96cd-545df8db2808 None admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:49.705504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e730af-43f0-4d8f-96cd-545df8db2808 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:49.705831 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e730af-43f0-4d8f-96cd-545df8db2808 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:49.707842 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e730af-43f0-4d8f-96cd-545df8db2808 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:49.719226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 643/1279] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:49.724998 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2299d75-9552-41ec-9296-9e049ef70b4c None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:49.756911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:49.823571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2299d75-9552-41ec-9296-9e049ef70b4c None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:49.856815 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592522b2-e841-46f8-b084-e9097fc05157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:49.857431 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592522b2-e841-46f8-b084-e9097fc05157 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:49.857733 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592522b2-e841-46f8-b084-e9097fc05157 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:49.858012 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592522b2-e841-46f8-b084-e9097fc05157 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:49.865460 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592522b2-e841-46f8-b084-e9097fc05157 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:49.867013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592522b2-e841-46f8-b084-e9097fc05157 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:49.877889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-592522b2-e841-46f8-b084-e9097fc05157 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:47:49.877889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:49.877889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:49.877889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:49.877889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:49.877889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:49.877889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:49.877889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:49.877889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:49.877889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:49.877889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:49.877889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:49.877889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 13 19:47:49.877889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 13 19:47:49.877889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 13 19:47:49.877889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 13 19:47:49.879616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:49.879616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:49.879616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 13 19:47:49.879616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:47:49.879616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 13 19:47:49.879616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 13 19:47:49.879616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:49.879616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:49.879616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:49.879616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:49.879616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:49.879616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:49.879616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:49.879616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:49.879616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:49.879616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:49.879616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:49.879616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:49.881005 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:49.881005 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:49.881005 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 13 19:47:49.881005 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 13 19:47:49.881005 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 13 19:47:49.881005 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 13 19:47:49.881005 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 13 19:47:49.881005 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 13 19:47:49.881005 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 13 19:47:49.881005 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:47:49.881005 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 637/1280] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 13 19:47:49.885577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e730af-43f0-4d8f-96cd-545df8db2808 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:49.890134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:49.983607 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e730af-43f0-4d8f-96cd-545df8db2808 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:50.016409 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424a3ed-aa6b-4d62-9c8e-77829f921cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:50.016993 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a3ed-aa6b-4d62-9c8e-77829f921cde None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:50.017272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a3ed-aa6b-4d62-9c8e-77829f921cde None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:50.017543 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6424a3ed-aa6b-4d62-9c8e-77829f921cde None admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:50.018282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424a3ed-aa6b-4d62-9c8e-77829f921cde None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:50.018584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424a3ed-aa6b-4d62-9c8e-77829f921cde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:50.020615 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6424a3ed-aa6b-4d62-9c8e-77829f921cde None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:50.037135 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 644/1281] 10.222.0.59 () {56 vars in 1143 bytes} [Tue Sep 13 19:47:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:50.042765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592522b2-e841-46f8-b084-e9097fc05157 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:50.132350 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:50.141761 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592522b2-e841-46f8-b084-e9097fc05157 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:50.173538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858071f5-3a91-447d-a053-601dbaa065ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:50.174175 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858071f5-3a91-447d-a053-601dbaa065ff None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:50.174454 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858071f5-3a91-447d-a053-601dbaa065ff None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:50.174722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858071f5-3a91-447d-a053-601dbaa065ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:50.241738 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858071f5-3a91-447d-a053-601dbaa065ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:50.243103 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858071f5-3a91-447d-a053-601dbaa065ff None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:50.328867 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:50.338613 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 638/1282] 10.222.0.59 () {58 vars in 1282 bytes} [Tue Sep 13 19:47:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 13 19:47:50.344599 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424a3ed-aa6b-4d62-9c8e-77829f921cde None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:50.405133 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:50.442589 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6424a3ed-aa6b-4d62-9c8e-77829f921cde None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:50.475072 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e611d8-0fd5-420a-8bcd-71cc7b42cda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:50.475683 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e611d8-0fd5-420a-8bcd-71cc7b42cda5 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:50.475959 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e611d8-0fd5-420a-8bcd-71cc7b42cda5 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:50.476227 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e611d8-0fd5-420a-8bcd-71cc7b42cda5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:50.485907 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e611d8-0fd5-420a-8bcd-71cc7b42cda5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:50.487364 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e611d8-0fd5-420a-8bcd-71cc7b42cda5 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:50.502880 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-27e611d8-0fd5-420a-8bcd-71cc7b42cda5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:50.502880 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:50.502880 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:50.502880 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:50.502880 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:50.502880 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:50.502880 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:50.502880 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:50.502880 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:50.502880 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:50.502880 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:50.502880 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:50.502880 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 13 19:47:50.502880 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 13 19:47:50.502880 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 13 19:47:50.502880 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 13 19:47:50.504061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:50.504061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:50.504061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:50.504061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:50.504061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:50.504061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:50.504061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:50.504061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:50.504061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:50.504061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:50.504061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:50.504061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:50.504061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:50.504061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:50.504061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:50.504061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:50.504061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 13 19:47:50.505053 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 13 19:47:50.505053 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 13 19:47:50.505053 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:47:50.505053 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 645/1283] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:47:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:50.509825 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858071f5-3a91-447d-a053-601dbaa065ff None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:50.605401 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858071f5-3a91-447d-a053-601dbaa065ff None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:50.638646 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3152c-b1c7-4a8a-baff-cbc53abdb38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:50.639249 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3152c-b1c7-4a8a-baff-cbc53abdb38f None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:50.639527 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3152c-b1c7-4a8a-baff-cbc53abdb38f None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:50.639797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef3152c-b1c7-4a8a-baff-cbc53abdb38f None admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:50.640428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3152c-b1c7-4a8a-baff-cbc53abdb38f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:50.640727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3152c-b1c7-4a8a-baff-cbc53abdb38f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:50.642145 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef3152c-b1c7-4a8a-baff-cbc53abdb38f None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:50.653314 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 639/1284] 10.222.0.59 () {56 vars in 1109 bytes} [Tue Sep 13 19:47:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:50.658874 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e611d8-0fd5-420a-8bcd-71cc7b42cda5 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:50.757748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e611d8-0fd5-420a-8bcd-71cc7b42cda5 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:50.770983 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:50.790463 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394b11c-8844-4875-b8e8-83e0e33e1089 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:50.791066 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394b11c-8844-4875-b8e8-83e0e33e1089 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:50.791340 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394b11c-8844-4875-b8e8-83e0e33e1089 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:50.791606 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6394b11c-8844-4875-b8e8-83e0e33e1089 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:50.797903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394b11c-8844-4875-b8e8-83e0e33e1089 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:50.799321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6394b11c-8844-4875-b8e8-83e0e33e1089 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:50.810820 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application [None req-6394b11c-8844-4875-b8e8-83e0e33e1089 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:47:50.810820 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:50.810820 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:50.810820 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:50.810820 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:50.810820 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:50.810820 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:50.810820 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:50.810820 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:50.810820 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:50.810820 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:50.810820 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:50.810820 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 13 19:47:50.810820 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 13 19:47:50.810820 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 13 19:47:50.812182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 13 19:47:50.812182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:50.812182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:50.812182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:50.812182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:50.812182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:50.812182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:50.812182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:50.812182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:50.812182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:50.812182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:50.812182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:50.812182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:50.812182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:50.812182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:50.812182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:50.812182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:50.813419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 13 19:47:50.813419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 13 19:47:50.813419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 13 19:47:50.813419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 13 19:47:50.813419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 13 19:47:50.813419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 13 19:47:50.813419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 13 19:47:50.813419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: ERROR keystone.server.flask.application Sep 13 19:47:50.813419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 646/1285] 10.222.0.59 () {56 vars in 1111 bytes} [Tue Sep 13 19:47:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:50.817844 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3152c-b1c7-4a8a-baff-cbc53abdb38f None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:50.869238 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:50.919058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef3152c-b1c7-4a8a-baff-cbc53abdb38f None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:50.951985 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a70e5-bb37-4bf5-bd3d-0e5f20e8d719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:50.952588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a70e5-bb37-4bf5-bd3d-0e5f20e8d719 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:50.953010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a70e5-bb37-4bf5-bd3d-0e5f20e8d719 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:50.953224 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a70e5-bb37-4bf5-bd3d-0e5f20e8d719 None admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:50.953960 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a70e5-bb37-4bf5-bd3d-0e5f20e8d719 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:50.954261 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a70e5-bb37-4bf5-bd3d-0e5f20e8d719 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:50.955716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a70e5-bb37-4bf5-bd3d-0e5f20e8d719 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:50.968960 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 640/1286] 10.222.0.59 () {56 vars in 1148 bytes} [Tue Sep 13 19:47:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:50.975772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394b11c-8844-4875-b8e8-83e0e33e1089 None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:51.073985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6394b11c-8844-4875-b8e8-83e0e33e1089 None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:51.107205 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3683fe7b-f63a-418e-ba75-57961e202eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:51.107790 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683fe7b-f63a-418e-ba75-57961e202eac None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:51.108066 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683fe7b-f63a-418e-ba75-57961e202eac None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:51.108333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3683fe7b-f63a-418e-ba75-57961e202eac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:51.109041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683fe7b-f63a-418e-ba75-57961e202eac None admin] RBAC: Adding query filter params (role.id=cd02ef2043de492a8bff6c165485f255, scope.project.id=ad67761fec0a430181877e216e90e7d4, user.id=89e7df5170c841abb449f3b4a547ec4d) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:51.109343 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683fe7b-f63a-418e-ba75-57961e202eac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:51.110783 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3683fe7b-f63a-418e-ba75-57961e202eac None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:51.116498 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 647/1287] 10.222.0.59 () {56 vars in 1374 bytes} [Tue Sep 13 19:47:50 2022] GET /identity/v3/role_assignments?user.id=89e7df5170c841abb449f3b4a547ec4d&scope.project.id=ad67761fec0a430181877e216e90e7d4&role.id=cd02ef2043de492a8bff6c165485f255 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:53.281057 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a5431-a360-4e3b-99c2-8f2e3576ce86 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:53.281585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a5431-a360-4e3b-99c2-8f2e3576ce86 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:53.281681 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a5431-a360-4e3b-99c2-8f2e3576ce86 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:53.283118 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 641/1288] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:47:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:47:53.288483 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5053ece-6702-4a30-b8eb-0b4695bcf743 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:53.288914 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5053ece-6702-4a30-b8eb-0b4695bcf743 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:53.289031 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5053ece-6702-4a30-b8eb-0b4695bcf743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:53.307240 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d5053ece-6702-4a30-b8eb-0b4695bcf743 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:47:53.308412 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d5053ece-6702-4a30-b8eb-0b4695bcf743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:53.337326 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:53.373094 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 648/1289] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:47:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:47:53.644313 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a5431-a360-4e3b-99c2-8f2e3576ce86 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:53.743750 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a5431-a360-4e3b-99c2-8f2e3576ce86 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:53.754056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:53.776602 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1648f-6a72-47dd-a23c-c46a320c7475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:53.777225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1648f-6a72-47dd-a23c-c46a320c7475 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:53.777533 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1648f-6a72-47dd-a23c-c46a320c7475 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:53.777925 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac1648f-6a72-47dd-a23c-c46a320c7475 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:53.778504 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1648f-6a72-47dd-a23c-c46a320c7475 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:53.779853 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac1648f-6a72-47dd-a23c-c46a320c7475 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:53.789001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-8ac1648f-6a72-47dd-a23c-c46a320c7475 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:47:53.789001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:53.789001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:47:53.789001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:47:53.789001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:47:53.789001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:47:53.789001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:47:53.789001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:47:53.789001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:47:53.789001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:47:53.789001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:47:53.789001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:47:53.789001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:53.789001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:53.789001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:53.789001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:53.789001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:53.790317 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:53.790317 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:53.790317 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:53.790317 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:53.790317 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:53.790317 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:53.790317 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:47:53.790317 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:47:53.790317 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:47:53.790317 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:47:53.790317 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:53.790317 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:53.790317 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:53.790317 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:53.790317 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:53.790317 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:53.791498 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:53.791498 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:53.791498 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:53.791498 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:53.791498 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:53.791498 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:53.791498 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:53.791498 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:53.791498 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:53.791498 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:53.791498 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:47:53.791498 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:47:53.791498 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:47:53.791498 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:47:53.791498 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 642/1290] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Sep 13 19:47:53 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:53.796247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5053ece-6702-4a30-b8eb-0b4695bcf743 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:53.901205 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5053ece-6702-4a30-b8eb-0b4695bcf743 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:53.934385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d18797-2018-49c4-984b-3cc0845907ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:53.934973 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d18797-2018-49c4-984b-3cc0845907ea None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:53.935247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d18797-2018-49c4-984b-3cc0845907ea None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:53.935562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d18797-2018-49c4-984b-3cc0845907ea None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:53.936171 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d18797-2018-49c4-984b-3cc0845907ea None admin] RBAC: Adding query filter params (name=placement) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:53.936466 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d18797-2018-49c4-984b-3cc0845907ea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:53.937867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d18797-2018-49c4-984b-3cc0845907ea None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:53.942494 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 649/1291] 10.222.0.59 () {56 vars in 1116 bytes} [Tue Sep 13 19:47:53 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:53.948297 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1648f-6a72-47dd-a23c-c46a320c7475 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:54.046669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac1648f-6a72-47dd-a23c-c46a320c7475 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:54.081790 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b46017-a8d6-457c-87ae-cf15add53cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:54.084428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b46017-a8d6-457c-87ae-cf15add53cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:54.084428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b46017-a8d6-457c-87ae-cf15add53cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:54.084428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b46017-a8d6-457c-87ae-cf15add53cf6 None admin] PATH_INFO: `/v3/services` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:54.084428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b46017-a8d6-457c-87ae-cf15add53cf6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:54.084428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b46017-a8d6-457c-87ae-cf15add53cf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:54.085720 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b46017-a8d6-457c-87ae-cf15add53cf6 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:54.090043 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 643/1292] 10.222.0.59 () {56 vars in 1116 bytes} [Tue Sep 13 19:47:53 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:56.206886 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da760dfe-721b-494e-91c8-b6cf38a7fdc1 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:56.207411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da760dfe-721b-494e-91c8-b6cf38a7fdc1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:56.207411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da760dfe-721b-494e-91c8-b6cf38a7fdc1 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:56.208690 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 650/1293] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:47:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:47:56.213981 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809c2d4-3634-48f1-a83c-31a89194b80f None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:56.214410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809c2d4-3634-48f1-a83c-31a89194b80f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:56.214513 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e809c2d4-3634-48f1-a83c-31a89194b80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:56.232292 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e809c2d4-3634-48f1-a83c-31a89194b80f None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:47:56.233473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e809c2d4-3634-48f1-a83c-31a89194b80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:56.263426 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:56.299671 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 644/1294] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:47:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:47:56.583656 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da760dfe-721b-494e-91c8-b6cf38a7fdc1 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:56.614932 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:56.682222 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da760dfe-721b-494e-91c8-b6cf38a7fdc1 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:56.715420 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71d2a5-0e36-4dfd-afa6-fd5555285204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:56.716013 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71d2a5-0e36-4dfd-afa6-fd5555285204 None admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:56.716292 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71d2a5-0e36-4dfd-afa6-fd5555285204 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:56.716563 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71d2a5-0e36-4dfd-afa6-fd5555285204 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:56.717214 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71d2a5-0e36-4dfd-afa6-fd5555285204 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:56.718608 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d71d2a5-0e36-4dfd-afa6-fd5555285204 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:56.816551 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 651/1295] 10.222.0.59 () {60 vars in 1141 bytes} [Tue Sep 13 19:47:56 2022] POST /identity/v3/services => generated 246 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:47:58.939908 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633a54a-a503-4e12-b9d0-b09eae57aa90 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:58.940511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633a54a-a503-4e12-b9d0-b09eae57aa90 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:58.940511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633a54a-a503-4e12-b9d0-b09eae57aa90 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:58.942346 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 645/1296] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:47:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:47:58.947550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c18a0-cc1f-41c2-a5f1-bf827d225374 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:58.947981 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c18a0-cc1f-41c2-a5f1-bf827d225374 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:58.948114 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077c18a0-cc1f-41c2-a5f1-bf827d225374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:58.971117 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-077c18a0-cc1f-41c2-a5f1-bf827d225374 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:47:58.974687 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-077c18a0-cc1f-41c2-a5f1-bf827d225374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:47:59.043531 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 652/1297] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:47:58 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:47:59.314019 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633a54a-a503-4e12-b9d0-b09eae57aa90 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:59.414506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633a54a-a503-4e12-b9d0-b09eae57aa90 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:59.448904 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7dfe8-92f8-45a6-9dc4-db6736a002d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:59.449574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7dfe8-92f8-45a6-9dc4-db6736a002d3 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:59.449892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7dfe8-92f8-45a6-9dc4-db6736a002d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:59.450177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b7dfe8-92f8-45a6-9dc4-db6736a002d3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:59.450753 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7dfe8-92f8-45a6-9dc4-db6736a002d3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:59.452109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b7dfe8-92f8-45a6-9dc4-db6736a002d3 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:59.460913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-07b7dfe8-92f8-45a6-9dc4-db6736a002d3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:47:59.460913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:59.460913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:47:59.460913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:47:59.460913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:47:59.460913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:47:59.460913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:47:59.460913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:47:59.460913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:47:59.460913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:47:59.460913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:47:59.460913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:47:59.460913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:47:59.460913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:47:59.460913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:47:59.460913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:47:59.460913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:47:59.462246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:47:59.462246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:47:59.462246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:47:59.462246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:47:59.462246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:47:59.462246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:47:59.462246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:47:59.462246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:47:59.462246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:47:59.462246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:47:59.462246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:47:59.462246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:47:59.462246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:47:59.462246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:47:59.462246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:47:59.462246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:47:59.463373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:47:59.463373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:47:59.463373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:47:59.463373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:47:59.463373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:47:59.463373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:47:59.463373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:47:59.463373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:47:59.463373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:47:59.463373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:47:59.463373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:47:59.463373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:47:59.463373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:47:59.463373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:47:59.463373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 646/1298] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Sep 13 19:47:59 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:47:59.468288 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c18a0-cc1f-41c2-a5f1-bf827d225374 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:59.486816 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:59.566768 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077c18a0-cc1f-41c2-a5f1-bf827d225374 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:59.600019 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fc1b2-87f8-497e-85ca-fa35c74bcdab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:59.600628 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fc1b2-87f8-497e-85ca-fa35c74bcdab None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:59.600908 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fc1b2-87f8-497e-85ca-fa35c74bcdab None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:59.601177 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0fc1b2-87f8-497e-85ca-fa35c74bcdab None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:59.601824 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fc1b2-87f8-497e-85ca-fa35c74bcdab None admin] RBAC: Adding query filter params (name=placement) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:59.602128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fc1b2-87f8-497e-85ca-fa35c74bcdab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:59.603488 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0fc1b2-87f8-497e-85ca-fa35c74bcdab None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:59.608472 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 653/1299] 10.222.0.59 () {56 vars in 1116 bytes} [Tue Sep 13 19:47:59 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:47:59.615083 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7dfe8-92f8-45a6-9dc4-db6736a002d3 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:59.646048 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:59.711720 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b7dfe8-92f8-45a6-9dc4-db6736a002d3 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:59.746229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b0a955-54aa-4160-b5e6-6b581698d7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:59.746837 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0a955-54aa-4160-b5e6-6b581698d7df None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:59.747117 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0a955-54aa-4160-b5e6-6b581698d7df None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:59.747386 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b0a955-54aa-4160-b5e6-6b581698d7df None admin] PATH_INFO: `/v3/endpoints` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:59.748080 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0a955-54aa-4160-b5e6-6b581698d7df None admin] RBAC: Adding query filter params (interface=public, service_id=9ad50d911d5a415dafac7a5a27f382da, region_id=RegionOne) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:47:59.748384 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0a955-54aa-4160-b5e6-6b581698d7df None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:59.749759 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b0a955-54aa-4160-b5e6-6b581698d7df None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:59.754709 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 647/1300] 10.222.0.59 () {56 vars in 1251 bytes} [Tue Sep 13 19:47:59 2022] GET /identity/v3/endpoints?service_id=9ad50d911d5a415dafac7a5a27f382da&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 19:47:59.760601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fc1b2-87f8-497e-85ca-fa35c74bcdab None admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:47:59.840663 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:47:59.858654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0fc1b2-87f8-497e-85ca-fa35c74bcdab None admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:47:59.893391 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecd20f9-6e1e-4945-b2ff-059a7820ecad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:47:59.894022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd20f9-6e1e-4945-b2ff-059a7820ecad None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:47:59.894787 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd20f9-6e1e-4945-b2ff-059a7820ecad None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:47:59.895093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecd20f9-6e1e-4945-b2ff-059a7820ecad None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:47:59.895697 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd20f9-6e1e-4945-b2ff-059a7820ecad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:47:59.897074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecd20f9-6e1e-4945-b2ff-059a7820ecad None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:47:59.903909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 654/1301] 10.222.0.59 () {56 vars in 1087 bytes} [Tue Sep 13 19:47:59 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:48:02.013417 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81b049-5c71-4d4c-8799-b074791b9eca None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:02.014028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81b049-5c71-4d4c-8799-b074791b9eca None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:02.014028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb81b049-5c71-4d4c-8799-b074791b9eca None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:02.015326 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 648/1302] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:48:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:48:02.021038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ae9b1-9cd3-4213-be7f-e09f94eeb5c7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:02.021445 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ae9b1-9cd3-4213-be7f-e09f94eeb5c7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:02.032488 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ae9b1-9cd3-4213-be7f-e09f94eeb5c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:02.039092 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3e5ae9b1-9cd3-4213-be7f-e09f94eeb5c7 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:48:02.040253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3e5ae9b1-9cd3-4213-be7f-e09f94eeb5c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:48:02.105772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 655/1303] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:48:02 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 13 19:48:02.374016 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81b049-5c71-4d4c-8799-b074791b9eca None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:02.468859 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:02.475484 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb81b049-5c71-4d4c-8799-b074791b9eca None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:02.508538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a47ea-f585-47a4-be09-123107bbdd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:02.509164 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a47ea-f585-47a4-be09-123107bbdd42 None admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:02.509444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a47ea-f585-47a4-be09-123107bbdd42 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:02.509745 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2a47ea-f585-47a4-be09-123107bbdd42 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:02.510332 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a47ea-f585-47a4-be09-123107bbdd42 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:02.511683 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2a47ea-f585-47a4-be09-123107bbdd42 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:02.521142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application [None req-7c2a47ea-f585-47a4-be09-123107bbdd42 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:48:02.521142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:48:02.521142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 13 19:48:02.521142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 13 19:48:02.521142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 13 19:48:02.521142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 13 19:48:02.521142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 13 19:48:02.521142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:48:02.521142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:48:02.521142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:48:02.521142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 13 19:48:02.521142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:48:02.521142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 13 19:48:02.521142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 13 19:48:02.521142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 13 19:48:02.521142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 13 19:48:02.521142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 13 19:48:02.526628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 13 19:48:02.526628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 13 19:48:02.526628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 13 19:48:02.526628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 13 19:48:02.526628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 13 19:48:02.526628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 13 19:48:02.526628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 13 19:48:02.526628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 13 19:48:02.526628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 13 19:48:02.526628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 13 19:48:02.526628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 13 19:48:02.526628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 13 19:48:02.526628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 13 19:48:02.526628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 13 19:48:02.526628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 13 19:48:02.526628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.get_or_create( Sep 13 19:48:02.527512 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 13 19:48:02.527512 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application with Lock( Sep 13 19:48:02.527512 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 13 19:48:02.527512 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self._enter() Sep 13 19:48:02.527512 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 13 19:48:02.527512 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 13 19:48:02.527512 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 13 19:48:02.527512 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application return self.creator() Sep 13 19:48:02.527512 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 13 19:48:02.527512 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application created_value = creator( Sep 13 19:48:02.527512 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 13 19:48:02.527512 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 13 19:48:02.527512 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 13 19:48:02.527512 dv-cinder-828807-6-smb devstack@keystone.service[81555]: ERROR keystone.server.flask.application Sep 13 19:48:02.527512 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 649/1304] 10.222.0.59 () {56 vars in 1117 bytes} [Tue Sep 13 19:48:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 13 19:48:02.528419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ae9b1-9cd3-4213-be7f-e09f94eeb5c7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:02.602458 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:02.624177 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ae9b1-9cd3-4213-be7f-e09f94eeb5c7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:02.658276 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89e4528-ec04-4da2-8373-e515676f5844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:02.658862 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e4528-ec04-4da2-8373-e515676f5844 None admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:02.659136 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e4528-ec04-4da2-8373-e515676f5844 None admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:02.659403 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89e4528-ec04-4da2-8373-e515676f5844 None admin] PATH_INFO: `/v3/services` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:02.660488 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e4528-ec04-4da2-8373-e515676f5844 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:48:02.661079 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e4528-ec04-4da2-8373-e515676f5844 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:02.662460 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89e4528-ec04-4da2-8373-e515676f5844 None admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:02.667582 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 656/1305] 10.222.0.59 () {56 vars in 1116 bytes} [Tue Sep 13 19:48:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:48:02.673588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a47ea-f585-47a4-be09-123107bbdd42 None admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:48:02.772244 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2a47ea-f585-47a4-be09-123107bbdd42 None admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:48:02.805035 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5ad6b8-acd4-4401-b206-c678a308ee44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:48:02.805631 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ad6b8-acd4-4401-b206-c678a308ee44 None admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:48:02.805936 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ad6b8-acd4-4401-b206-c678a308ee44 None admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:48:02.806206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5ad6b8-acd4-4401-b206-c678a308ee44 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:48:02.806867 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ad6b8-acd4-4401-b206-c678a308ee44 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:48:02.808221 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5ad6b8-acd4-4401-b206-c678a308ee44 None admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:48:02.908420 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 650/1306] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 19:48:02 2022] POST /identity/v3/endpoints => generated 331 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:48:12.664585 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=30 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:48:12.903664 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:34.137476 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be32d0-f337-4e39-8e4a-861f11155643 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:34.138657 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be32d0-f337-4e39-8e4a-861f11155643 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:34.138657 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61be32d0-f337-4e39-8e4a-861f11155643 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:34.145110 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525550e-283a-4472-89c1-aabb1a147d4b None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:34.145554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525550e-283a-4472-89c1-aabb1a147d4b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:34.145662 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a525550e-283a-4472-89c1-aabb1a147d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:34.150613 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 657/1307] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:53:34 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:34.240808 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-a525550e-283a-4472-89c1-aabb1a147d4b None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:34.242095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a525550e-283a-4472-89c1-aabb1a147d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:34.371416 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 651/1308] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:34.661723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c551887-ee17-4f73-af7f-7a350ba66e89 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:34.662052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c551887-ee17-4f73-af7f-7a350ba66e89 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:34.662851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c551887-ee17-4f73-af7f-7a350ba66e89 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:34.664530 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 658/1309] 10.222.0.59 () {54 vars in 965 bytes} [Tue Sep 13 19:53:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:34.670292 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50079958-dba9-4910-8aca-ee537638f459 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:34.670698 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50079958-dba9-4910-8aca-ee537638f459 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:34.671042 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50079958-dba9-4910-8aca-ee537638f459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:34.759184 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-50079958-dba9-4910-8aca-ee537638f459 None None] MFA Rules not processed for user `b86b85c457d84ac99359ac93add704d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:34.760550 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-50079958-dba9-4910-8aca-ee537638f459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:34.783109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:34.841136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 652/1310] 10.222.0.59 () {58 vars in 1062 bytes} [Tue Sep 13 19:53:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:34.850471 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c551887-ee17-4f73-af7f-7a350ba66e89 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:34.852523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4c551887-ee17-4f73-af7f-7a350ba66e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:34.983897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c551887-ee17-4f73-af7f-7a350ba66e89 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:35.069491 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0234d9-31e8-4d21-99c3-fcc4a31b0d37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:35.070044 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0234d9-31e8-4d21-99c3-fcc4a31b0d37 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:35.070317 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0234d9-31e8-4d21-99c3-fcc4a31b0d37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:35.070582 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0234d9-31e8-4d21-99c3-fcc4a31b0d37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:35.072258 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fd0234d9-31e8-4d21-99c3-fcc4a31b0d37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:35.133356 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:35.189813 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0234d9-31e8-4d21-99c3-fcc4a31b0d37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:35.191243 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0234d9-31e8-4d21-99c3-fcc4a31b0d37 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:35.212717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 659/1311] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:53:37.697407 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a005e-29c7-4a15-9821-4172ff552f03 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:37.697837 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a005e-29c7-4a15-9821-4172ff552f03 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:37.698039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22a005e-29c7-4a15-9821-4172ff552f03 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:37.699425 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 653/1312] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:37.704939 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef9edc-57e1-46b6-a4ed-afb6b0bac6f9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:37.705398 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef9edc-57e1-46b6-a4ed-afb6b0bac6f9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:37.705599 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bef9edc-57e1-46b6-a4ed-afb6b0bac6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:37.777481 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9bef9edc-57e1-46b6-a4ed-afb6b0bac6f9 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:37.779248 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9bef9edc-57e1-46b6-a4ed-afb6b0bac6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:37.873072 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 660/1313] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:38.154464 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a005e-29c7-4a15-9821-4172ff552f03 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:38.156016 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a22a005e-29c7-4a15-9821-4172ff552f03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:38.258067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22a005e-29c7-4a15-9821-4172ff552f03 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:38.328501 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:38.330771 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaae31f2-8581-4e96-aa48-56d68658da1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:38.331370 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae31f2-8581-4e96-aa48-56d68658da1e service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:38.331650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae31f2-8581-4e96-aa48-56d68658da1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:38.331923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaae31f2-8581-4e96-aa48-56d68658da1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:38.333499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-aaae31f2-8581-4e96-aa48-56d68658da1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:38.441334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae31f2-8581-4e96-aa48-56d68658da1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:38.442720 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaae31f2-8581-4e96-aa48-56d68658da1e service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:38.460932 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 654/1314] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:53:41.067202 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58ef05-1001-4cc4-b0ba-1ece9c98514d None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:41.067736 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58ef05-1001-4cc4-b0ba-1ece9c98514d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:41.067736 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58ef05-1001-4cc4-b0ba-1ece9c98514d None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:41.069115 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 661/1315] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:53:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:41.074235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ebac0-4484-45d1-8cda-93c6b15b4675 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:41.074680 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ebac0-4484-45d1-8cda-93c6b15b4675 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:41.074778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ebac0-4484-45d1-8cda-93c6b15b4675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:41.141556 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-756ebac0-4484-45d1-8cda-93c6b15b4675 None None] MFA Rules not processed for user `65d1c5d78251465898ee3d921a10e221`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:41.142849 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-756ebac0-4484-45d1-8cda-93c6b15b4675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:41.194227 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:41.238097 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 655/1316] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:53:41 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:41.517331 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58ef05-1001-4cc4-b0ba-1ece9c98514d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:41.518962 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ce58ef05-1001-4cc4-b0ba-1ece9c98514d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:41.529148 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:41.620873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58ef05-1001-4cc4-b0ba-1ece9c98514d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:41.691910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaa7016-14e1-498b-83c8-1f89bdf65f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:41.692502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa7016-14e1-498b-83c8-1f89bdf65f95 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:41.692777 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa7016-14e1-498b-83c8-1f89bdf65f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:41.693043 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaa7016-14e1-498b-83c8-1f89bdf65f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:41.694622 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ffaa7016-14e1-498b-83c8-1f89bdf65f95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:41.755506 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:41.801767 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa7016-14e1-498b-83c8-1f89bdf65f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:41.803141 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaa7016-14e1-498b-83c8-1f89bdf65f95 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:41.822335 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 662/1317] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:41 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:53:44.764653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cc934-ba53-4224-9c70-aa818139329e None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:44.765194 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cc934-ba53-4224-9c70-aa818139329e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:44.765194 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101cc934-ba53-4224-9c70-aa818139329e None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:44.766594 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 656/1318] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:53:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:44.771838 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd3916-87ec-4b2d-83dd-8378461f35f4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:44.772216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd3916-87ec-4b2d-83dd-8378461f35f4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:44.772392 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efd3916-87ec-4b2d-83dd-8378461f35f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:44.836029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1efd3916-87ec-4b2d-83dd-8378461f35f4 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:44.837214 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1efd3916-87ec-4b2d-83dd-8378461f35f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:44.931796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 663/1319] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:53:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:45.216816 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101cc934-ba53-4224-9c70-aa818139329e None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:45.218366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-101cc934-ba53-4224-9c70-aa818139329e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:45.318948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101cc934-ba53-4224-9c70-aa818139329e None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:45.391429 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b546fa7-41e7-4270-bc20-e574cc84c180 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:45.392029 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b546fa7-41e7-4270-bc20-e574cc84c180 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:45.392313 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b546fa7-41e7-4270-bc20-e574cc84c180 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:45.392584 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b546fa7-41e7-4270-bc20-e574cc84c180 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:45.394165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9b546fa7-41e7-4270-bc20-e574cc84c180 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:45.400874 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:45.501812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b546fa7-41e7-4270-bc20-e574cc84c180 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:45.503232 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b546fa7-41e7-4270-bc20-e574cc84c180 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:45.520879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 657/1320] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:53:48.602539 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d78d0-b4a3-42b1-843c-f4bce859dfff None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:48.603086 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d78d0-b4a3-42b1-843c-f4bce859dfff None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:48.603086 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868d78d0-b4a3-42b1-843c-f4bce859dfff None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:48.604423 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 664/1321] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:53:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:48.610081 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fb58d-1075-49b3-a08d-0e84b68028a0 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:48.615336 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fb58d-1075-49b3-a08d-0e84b68028a0 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:48.615336 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fb58d-1075-49b3-a08d-0e84b68028a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:48.677146 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-d16fb58d-1075-49b3-a08d-0e84b68028a0 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:48.678389 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d16fb58d-1075-49b3-a08d-0e84b68028a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:48.738631 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:48.777370 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 658/1322] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:53:49.061856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d78d0-b4a3-42b1-843c-f4bce859dfff None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:49.063444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-868d78d0-b4a3-42b1-843c-f4bce859dfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:49.084214 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:49.166153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868d78d0-b4a3-42b1-843c-f4bce859dfff None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:49.238700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dcfd5a-dcb2-4632-a2d0-2b676b93fb06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:49.239315 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcfd5a-dcb2-4632-a2d0-2b676b93fb06 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:49.239594 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcfd5a-dcb2-4632-a2d0-2b676b93fb06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:49.239862 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dcfd5a-dcb2-4632-a2d0-2b676b93fb06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:49.241433 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d5dcfd5a-dcb2-4632-a2d0-2b676b93fb06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:49.311647 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:49.349659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcfd5a-dcb2-4632-a2d0-2b676b93fb06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:49.351124 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dcfd5a-dcb2-4632-a2d0-2b676b93fb06 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:49.369420 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 665/1323] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:53:51.608489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc25ac-2430-4d6b-bcc4-1c6c6432a981 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:51.609046 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc25ac-2430-4d6b-bcc4-1c6c6432a981 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:51.609046 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00bc25ac-2430-4d6b-bcc4-1c6c6432a981 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:51.610442 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 659/1324] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:53:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:51.615908 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a394e-af7c-4f1a-adaf-76c8712f8491 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:51.616386 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a394e-af7c-4f1a-adaf-76c8712f8491 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:51.616505 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a394e-af7c-4f1a-adaf-76c8712f8491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:51.689627 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-cd3a394e-af7c-4f1a-adaf-76c8712f8491 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:51.690881 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cd3a394e-af7c-4f1a-adaf-76c8712f8491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:51.786904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 666/1325] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:53:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:52.069857 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc25ac-2430-4d6b-bcc4-1c6c6432a981 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:52.071493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-00bc25ac-2430-4d6b-bcc4-1c6c6432a981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:52.177241 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00bc25ac-2430-4d6b-bcc4-1c6c6432a981 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:52.253197 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f10b42-9300-496b-a267-218f8bd7ed4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:52.253837 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f10b42-9300-496b-a267-218f8bd7ed4c service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:52.254118 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f10b42-9300-496b-a267-218f8bd7ed4c service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:52.254391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f10b42-9300-496b-a267-218f8bd7ed4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:52.255961 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-81f10b42-9300-496b-a267-218f8bd7ed4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:52.273982 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:52.367868 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f10b42-9300-496b-a267-218f8bd7ed4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:52.369307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81f10b42-9300-496b-a267-218f8bd7ed4c service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:52.387856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 660/1326] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:53:54.596677 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4ea3b-42c9-4380-a715-79f09ab54d25 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:54.597222 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4ea3b-42c9-4380-a715-79f09ab54d25 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:54.597222 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad4ea3b-42c9-4380-a715-79f09ab54d25 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:54.598581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 667/1327] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:53:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:54.603880 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e09839-3670-47c7-a2a4-f1d97be33693 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:54.604308 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e09839-3670-47c7-a2a4-f1d97be33693 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:54.604420 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e09839-3670-47c7-a2a4-f1d97be33693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:54.672660 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e6e09839-3670-47c7-a2a4-f1d97be33693 None None] MFA Rules not processed for user `65d1c5d78251465898ee3d921a10e221`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:54.673803 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e6e09839-3670-47c7-a2a4-f1d97be33693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:54.738712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:54.770875 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 661/1328] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:53:54 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:55.052752 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4ea3b-42c9-4380-a715-79f09ab54d25 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:55.054389 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0ad4ea3b-42c9-4380-a715-79f09ab54d25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:55.087318 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:55.163761 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad4ea3b-42c9-4380-a715-79f09ab54d25 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:55.238963 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa429dd8-c3cb-4198-8571-f743115fc74c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:55.239569 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa429dd8-c3cb-4198-8571-f743115fc74c service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:55.239845 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa429dd8-c3cb-4198-8571-f743115fc74c service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:55.240115 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa429dd8-c3cb-4198-8571-f743115fc74c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:55.241747 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-aa429dd8-c3cb-4198-8571-f743115fc74c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:55.320569 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:55.351438 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa429dd8-c3cb-4198-8571-f743115fc74c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:55.353028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa429dd8-c3cb-4198-8571-f743115fc74c service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:55.372569 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 668/1329] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:55 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:53:57.916719 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56144a68-1b61-439a-9529-a73cf00a3c58 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:57.917206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56144a68-1b61-439a-9529-a73cf00a3c58 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:57.917303 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56144a68-1b61-439a-9529-a73cf00a3c58 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:57.918652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 662/1330] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:53:57.924705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa36d84-018d-4638-accb-07b001a41c5d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:57.925123 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa36d84-018d-4638-accb-07b001a41c5d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:57.925251 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa36d84-018d-4638-accb-07b001a41c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:57.990414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2fa36d84-018d-4638-accb-07b001a41c5d None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:53:57.991586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2fa36d84-018d-4638-accb-07b001a41c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:58.083770 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 669/1331] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:53:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:53:58.364026 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56144a68-1b61-439a-9529-a73cf00a3c58 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:53:58.365576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-56144a68-1b61-439a-9529-a73cf00a3c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:58.467110 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56144a68-1b61-439a-9529-a73cf00a3c58 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:53:58.541215 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6955c3-ca73-468c-b7f4-f6ba5db2ee20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:53:58.541847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6955c3-ca73-468c-b7f4-f6ba5db2ee20 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:53:58.542128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6955c3-ca73-468c-b7f4-f6ba5db2ee20 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:53:58.542397 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6955c3-ca73-468c-b7f4-f6ba5db2ee20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:53:58.544112 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2a6955c3-ca73-468c-b7f4-f6ba5db2ee20 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:53:58.570387 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:53:58.652049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6955c3-ca73-468c-b7f4-f6ba5db2ee20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:53:58.653381 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6955c3-ca73-468c-b7f4-f6ba5db2ee20 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:53:58.671896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 663/1332] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:53:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:00.834729 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d6995-dcc0-4463-a6d4-c5afb747a0f9 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:00.835308 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d6995-dcc0-4463-a6d4-c5afb747a0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:00.835308 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7d6995-dcc0-4463-a6d4-c5afb747a0f9 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:00.836608 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 670/1333] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:54:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:00.841854 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d7550-b6f4-42bf-863c-45ebfb56c84a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:00.842278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d7550-b6f4-42bf-863c-45ebfb56c84a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:00.842967 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d7550-b6f4-42bf-863c-45ebfb56c84a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:00.907996 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-610d7550-b6f4-42bf-863c-45ebfb56c84a None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:00.909219 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-610d7550-b6f4-42bf-863c-45ebfb56c84a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:00.987948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:01.011598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 664/1334] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:54:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:01.295960 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d6995-dcc0-4463-a6d4-c5afb747a0f9 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:01.297483 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8d7d6995-dcc0-4463-a6d4-c5afb747a0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:01.336740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:01.398612 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7d6995-dcc0-4463-a6d4-c5afb747a0f9 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:01.469904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254d5eb-7e36-4987-83bf-da84b1ac17a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:01.470518 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254d5eb-7e36-4987-83bf-da84b1ac17a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:01.470793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254d5eb-7e36-4987-83bf-da84b1ac17a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:01.471065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254d5eb-7e36-4987-83bf-da84b1ac17a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:01.472629 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5254d5eb-7e36-4987-83bf-da84b1ac17a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:01.554540 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:01.579718 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254d5eb-7e36-4987-83bf-da84b1ac17a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:01.581137 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254d5eb-7e36-4987-83bf-da84b1ac17a6 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:01.600136 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 671/1335] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:04.333615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41d101-c8dc-473f-a1b8-f40aee208cd8 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:04.334260 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41d101-c8dc-473f-a1b8-f40aee208cd8 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:04.334260 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be41d101-c8dc-473f-a1b8-f40aee208cd8 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:04.335536 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 665/1336] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:54:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:04.340682 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b19781-c119-4654-89f5-5756a7a2e8d7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:04.341109 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b19781-c119-4654-89f5-5756a7a2e8d7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:04.341359 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b19781-c119-4654-89f5-5756a7a2e8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:04.406630 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b0b19781-c119-4654-89f5-5756a7a2e8d7 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:04.407822 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b0b19781-c119-4654-89f5-5756a7a2e8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:04.503235 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 672/1337] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:54:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:04.787120 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41d101-c8dc-473f-a1b8-f40aee208cd8 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:04.788653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-be41d101-c8dc-473f-a1b8-f40aee208cd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:04.890642 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be41d101-c8dc-473f-a1b8-f40aee208cd8 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:04.962735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d25ebe1-02ca-485e-b467-6d79f89ddbd5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:04.963366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25ebe1-02ca-485e-b467-6d79f89ddbd5 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:04.963642 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25ebe1-02ca-485e-b467-6d79f89ddbd5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:04.963910 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d25ebe1-02ca-485e-b467-6d79f89ddbd5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:04.965476 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1d25ebe1-02ca-485e-b467-6d79f89ddbd5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:05.001477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:05.073306 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25ebe1-02ca-485e-b467-6d79f89ddbd5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:05.074755 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d25ebe1-02ca-485e-b467-6d79f89ddbd5 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:05.093619 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 666/1338] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:04 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:09.283376 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7ce8c-c315-4860-9a1d-721fe36041d6 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:09.283920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7ce8c-c315-4860-9a1d-721fe36041d6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:09.283920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f7ce8c-c315-4860-9a1d-721fe36041d6 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:09.285257 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 673/1339] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:54:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:54:09.290499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff377bc9-602e-47f7-ba17-c8abec5f5dd5 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:09.291034 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff377bc9-602e-47f7-ba17-c8abec5f5dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:09.291165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff377bc9-602e-47f7-ba17-c8abec5f5dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:09.356313 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-ff377bc9-602e-47f7-ba17-c8abec5f5dd5 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:09.357516 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ff377bc9-602e-47f7-ba17-c8abec5f5dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:09.443865 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:09.459906 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 667/1340] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:54:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:09.744730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7ce8c-c315-4860-9a1d-721fe36041d6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:09.746330 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-18f7ce8c-c315-4860-9a1d-721fe36041d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:09.795134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:09.850169 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f7ce8c-c315-4860-9a1d-721fe36041d6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:09.926353 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57028119-a77d-411d-ac9b-43819fde25b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:09.926954 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57028119-a77d-411d-ac9b-43819fde25b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:09.927229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57028119-a77d-411d-ac9b-43819fde25b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:09.927499 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57028119-a77d-411d-ac9b-43819fde25b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:09.929058 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-57028119-a77d-411d-ac9b-43819fde25b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:10.023102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:10.039177 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57028119-a77d-411d-ac9b-43819fde25b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:10.040816 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57028119-a77d-411d-ac9b-43819fde25b9 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:10.062032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 674/1341] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:13.136877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f2347-f615-4580-a8c4-9193f9d8a82a None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:13.137438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f2347-f615-4580-a8c4-9193f9d8a82a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:13.137438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8f2347-f615-4580-a8c4-9193f9d8a82a None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:13.138820 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 668/1342] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:54:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:13.144874 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e17991-bb8f-43a7-bd80-e64f1a0e6f05 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:13.145291 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e17991-bb8f-43a7-bd80-e64f1a0e6f05 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:13.145491 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e17991-bb8f-43a7-bd80-e64f1a0e6f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:13.213598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-51e17991-bb8f-43a7-bd80-e64f1a0e6f05 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:13.214870 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-51e17991-bb8f-43a7-bd80-e64f1a0e6f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:13.315655 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 675/1343] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:54:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:13.600370 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f2347-f615-4580-a8c4-9193f9d8a82a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:13.601913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1b8f2347-f615-4580-a8c4-9193f9d8a82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:13.708353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8f2347-f615-4580-a8c4-9193f9d8a82a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:13.786062 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdb712-feb1-4229-849e-f1af0e9afa48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:13.786675 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdb712-feb1-4229-849e-f1af0e9afa48 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:13.786952 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdb712-feb1-4229-849e-f1af0e9afa48 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:13.787225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdb712-feb1-4229-849e-f1af0e9afa48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:13.788794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f3fdb712-feb1-4229-849e-f1af0e9afa48 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:13.832066 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:13.914409 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fdb712-feb1-4229-849e-f1af0e9afa48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:13.915879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fdb712-feb1-4229-849e-f1af0e9afa48 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:13.940252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 669/1344] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:13 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:18.232147 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a069033-c6bc-42d7-b49b-9b6ffa07440d None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:18.232658 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a069033-c6bc-42d7-b49b-9b6ffa07440d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:18.232755 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a069033-c6bc-42d7-b49b-9b6ffa07440d None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:18.234428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 676/1345] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:18.240514 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84c1d6-49e6-4e9c-a044-da0b9c131f08 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:18.240970 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84c1d6-49e6-4e9c-a044-da0b9c131f08 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:18.241063 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b84c1d6-49e6-4e9c-a044-da0b9c131f08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:18.311137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-5b84c1d6-49e6-4e9c-a044-da0b9c131f08 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:18.312396 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5b84c1d6-49e6-4e9c-a044-da0b9c131f08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:18.412729 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:18.415179 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 670/1346] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:18.700595 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a069033-c6bc-42d7-b49b-9b6ffa07440d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:18.702163 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0a069033-c6bc-42d7-b49b-9b6ffa07440d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:18.759504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:18.804559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a069033-c6bc-42d7-b49b-9b6ffa07440d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:18.877237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c0075b-e539-4591-9dd2-5729ce1da6d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:18.877867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0075b-e539-4591-9dd2-5729ce1da6d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:18.878144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0075b-e539-4591-9dd2-5729ce1da6d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:18.878408 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c0075b-e539-4591-9dd2-5729ce1da6d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:18.879969 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e4c0075b-e539-4591-9dd2-5729ce1da6d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:18.982426 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:18.986142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0075b-e539-4591-9dd2-5729ce1da6d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:18.987556 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c0075b-e539-4591-9dd2-5729ce1da6d6 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:19.005862 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 677/1347] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:23.924701 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc5fc5-c425-47d6-9872-f9df4ad34965 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:23.925240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc5fc5-c425-47d6-9872-f9df4ad34965 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:23.925240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bc5fc5-c425-47d6-9872-f9df4ad34965 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:23.927057 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 671/1348] 10.222.0.59 () {54 vars in 921 bytes} [Tue Sep 13 19:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:23.935793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44185fe1-9d0e-445d-9b05-549a9f9095d2 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:23.936251 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44185fe1-9d0e-445d-9b05-549a9f9095d2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:23.936744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44185fe1-9d0e-445d-9b05-549a9f9095d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:24.066831 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-44185fe1-9d0e-445d-9b05-549a9f9095d2 None None] MFA Rules not processed for user `89e7df5170c841abb449f3b4a547ec4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:24.068264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-44185fe1-9d0e-445d-9b05-549a9f9095d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:24.214328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 678/1349] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Sep 13 19:54:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:54:28.209635 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2a834-bb03-436d-890d-6c377fb78411 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:28.210216 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2a834-bb03-436d-890d-6c377fb78411 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:28.210216 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e2a834-bb03-436d-890d-6c377fb78411 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:28.211724 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 672/1350] 10.222.0.59 () {54 vars in 921 bytes} [Tue Sep 13 19:54:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:28.219733 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb03e3-2653-4ffb-9c27-2dccf769a658 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:28.220161 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb03e3-2653-4ffb-9c27-2dccf769a658 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:28.220384 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb03e3-2653-4ffb-9c27-2dccf769a658 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:28.275324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:28.299676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-29fb03e3-2653-4ffb-9c27-2dccf769a658 None None] MFA Rules not processed for user `89e7df5170c841abb449f3b4a547ec4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:28.300959 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-29fb03e3-2653-4ffb-9c27-2dccf769a658 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:28.411159 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 679/1351] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Sep 13 19:54:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:29.792907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2737b9a-5a76-45dc-b7ed-99a70ca48d06 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:29.793441 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2737b9a-5a76-45dc-b7ed-99a70ca48d06 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:29.793441 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2737b9a-5a76-45dc-b7ed-99a70ca48d06 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:29.794829 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 673/1352] 10.222.0.59 () {54 vars in 921 bytes} [Tue Sep 13 19:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:29.799918 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78699a68-6215-4469-8136-3b7ae49db9b6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:29.800324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78699a68-6215-4469-8136-3b7ae49db9b6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:29.800494 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78699a68-6215-4469-8136-3b7ae49db9b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:29.881843 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-78699a68-6215-4469-8136-3b7ae49db9b6 None None] MFA Rules not processed for user `89e7df5170c841abb449f3b4a547ec4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:29.883007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-78699a68-6215-4469-8136-3b7ae49db9b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:29.927394 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:29.992881 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 680/1353] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Sep 13 19:54:29 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:33.546545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47193e-904b-4d2e-ae26-84859e3b20a3 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:33.547944 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47193e-904b-4d2e-ae26-84859e3b20a3 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:33.548377 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc47193e-904b-4d2e-ae26-84859e3b20a3 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:33.549933 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 674/1354] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:54:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:33.555713 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ae88b-3af0-4f84-910a-2572ec015034 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:33.556220 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ae88b-3af0-4f84-910a-2572ec015034 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:33.556390 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ae88b-3af0-4f84-910a-2572ec015034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:33.638024 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0b8ae88b-3af0-4f84-910a-2572ec015034 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:33.639585 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0b8ae88b-3af0-4f84-910a-2572ec015034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:33.771172 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 681/1355] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:34.068543 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2756b50-260f-4983-b7d2-ce30690c80a8 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:34.069623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2756b50-260f-4983-b7d2-ce30690c80a8 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:34.070191 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2756b50-260f-4983-b7d2-ce30690c80a8 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:34.072463 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 675/1356] 10.222.0.59 () {54 vars in 962 bytes} [Tue Sep 13 19:54:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:34.080952 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eec849-3c9f-49da-9075-dd063aaa0c4d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:34.083298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eec849-3c9f-49da-9075-dd063aaa0c4d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:34.083298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eec849-3c9f-49da-9075-dd063aaa0c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:34.108357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:34.171458 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-42eec849-3c9f-49da-9075-dd063aaa0c4d None None] MFA Rules not processed for user `3919b24291f54df99a9da0f5d3164ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:34.173289 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-42eec849-3c9f-49da-9075-dd063aaa0c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:34.294236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 682/1357] 10.222.0.59 () {58 vars in 1059 bytes} [Tue Sep 13 19:54:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:54:34.301987 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2756b50-260f-4983-b7d2-ce30690c80a8 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:34.303557 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c2756b50-260f-4983-b7d2-ce30690c80a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:34.460939 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2756b50-260f-4983-b7d2-ce30690c80a8 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:34.585771 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:34.629171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babe8a3-e0c3-44d7-aaa7-712dfed548fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:34.629938 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babe8a3-e0c3-44d7-aaa7-712dfed548fd service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:34.630288 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babe8a3-e0c3-44d7-aaa7-712dfed548fd service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:34.630633 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babe8a3-e0c3-44d7-aaa7-712dfed548fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:34.632290 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3babe8a3-e0c3-44d7-aaa7-712dfed548fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:34.737256 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3babe8a3-e0c3-44d7-aaa7-712dfed548fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:34.738983 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3babe8a3-e0c3-44d7-aaa7-712dfed548fd service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:34.760040 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 676/1358] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:37.152694 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42936df-bce9-4712-be71-023454ac01f0 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:37.153349 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42936df-bce9-4712-be71-023454ac01f0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:37.153349 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42936df-bce9-4712-be71-023454ac01f0 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:37.160300 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e45c9f-a692-4f2d-a35e-5b1837f273d5 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:37.160916 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e45c9f-a692-4f2d-a35e-5b1837f273d5 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:37.160916 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e45c9f-a692-4f2d-a35e-5b1837f273d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:37.167369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 683/1359] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:54:37 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:37.230622 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-a8e45c9f-a692-4f2d-a35e-5b1837f273d5 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:37.231824 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a8e45c9f-a692-4f2d-a35e-5b1837f273d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:37.274793 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:37.334721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 677/1360] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:54:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:54:37.626747 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42936df-bce9-4712-be71-023454ac01f0 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:37.628335 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d42936df-bce9-4712-be71-023454ac01f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:37.698385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:37.803171 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42936df-bce9-4712-be71-023454ac01f0 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:37.926995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa62db7-a6c9-4fa1-b989-f8a7d2a7d403 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:37.927608 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa62db7-a6c9-4fa1-b989-f8a7d2a7d403 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:37.927896 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa62db7-a6c9-4fa1-b989-f8a7d2a7d403 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:37.928170 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa62db7-a6c9-4fa1-b989-f8a7d2a7d403 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:37.929810 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-baa62db7-a6c9-4fa1-b989-f8a7d2a7d403 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:37.952948 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:38.023499 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa62db7-a6c9-4fa1-b989-f8a7d2a7d403 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:38.025019 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa62db7-a6c9-4fa1-b989-f8a7d2a7d403 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:38.042981 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 684/1361] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:40.620074 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67888398-aabe-49d6-ad61-3987e69d656f None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:40.620629 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67888398-aabe-49d6-ad61-3987e69d656f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:40.620629 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67888398-aabe-49d6-ad61-3987e69d656f None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:40.621993 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 678/1362] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:54:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:40.627867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13c9ce-3c21-407f-9876-9def24d9c0af None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:40.628280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13c9ce-3c21-407f-9876-9def24d9c0af None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:40.628448 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac13c9ce-3c21-407f-9876-9def24d9c0af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:40.696742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ac13c9ce-3c21-407f-9876-9def24d9c0af None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:40.697957 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ac13c9ce-3c21-407f-9876-9def24d9c0af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:40.795979 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:40.806013 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 685/1363] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:54:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:41.088133 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43ba3b-e6da-4187-99f7-78dec09663a8 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:41.088320 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43ba3b-e6da-4187-99f7-78dec09663a8 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:41.088601 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a43ba3b-e6da-4187-99f7-78dec09663a8 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:41.090198 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 679/1364] 10.222.0.59 () {54 vars in 962 bytes} [Tue Sep 13 19:54:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:41.096114 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8558588-9cd2-4804-843f-3ea0042c94c6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:41.096426 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8558588-9cd2-4804-843f-3ea0042c94c6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:41.096701 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8558588-9cd2-4804-843f-3ea0042c94c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:41.178566 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a8558588-9cd2-4804-843f-3ea0042c94c6 None None] MFA Rules not processed for user `3919b24291f54df99a9da0f5d3164ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:41.179690 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a8558588-9cd2-4804-843f-3ea0042c94c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:41.302705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 686/1365] 10.222.0.59 () {58 vars in 1059 bytes} [Tue Sep 13 19:54:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:41.310885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43ba3b-e6da-4187-99f7-78dec09663a8 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:41.312452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1a43ba3b-e6da-4187-99f7-78dec09663a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:41.466495 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a43ba3b-e6da-4187-99f7-78dec09663a8 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:41.490865 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:41.592072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5906ec0f-662c-44e5-a551-a13a8a0e5582 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:41.592800 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906ec0f-662c-44e5-a551-a13a8a0e5582 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:41.593143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906ec0f-662c-44e5-a551-a13a8a0e5582 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:41.593487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5906ec0f-662c-44e5-a551-a13a8a0e5582 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:41.595228 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5906ec0f-662c-44e5-a551-a13a8a0e5582 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:41.697278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906ec0f-662c-44e5-a551-a13a8a0e5582 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:41.699037 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5906ec0f-662c-44e5-a551-a13a8a0e5582 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:41.719099 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 680/1366] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:41.747193 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d3053-5274-48fc-a5e9-6bc0b252a4d0 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:41.747193 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d3053-5274-48fc-a5e9-6bc0b252a4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:41.747193 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d3053-5274-48fc-a5e9-6bc0b252a4d0 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:41.750865 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 687/1367] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:54:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:41.754413 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41b19a-3078-4f38-a15c-5fe1f67ebf54 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:41.754708 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41b19a-3078-4f38-a15c-5fe1f67ebf54 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:41.754990 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41b19a-3078-4f38-a15c-5fe1f67ebf54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:41.786767 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:41.822940 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-ae41b19a-3078-4f38-a15c-5fe1f67ebf54 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:41.824453 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ae41b19a-3078-4f38-a15c-5fe1f67ebf54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:41.944469 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 681/1368] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:42.272952 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc873d0-f5db-43ee-ac0c-a72f812cb105 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:42.272952 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc873d0-f5db-43ee-ac0c-a72f812cb105 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:42.273453 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc873d0-f5db-43ee-ac0c-a72f812cb105 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:42.277499 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 688/1369] 10.222.0.59 () {54 vars in 964 bytes} [Tue Sep 13 19:54:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:42.279520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d623bda-ccfc-4ca5-b0b8-5c050b67e7fd None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:42.279914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d623bda-ccfc-4ca5-b0b8-5c050b67e7fd None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:42.280291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d623bda-ccfc-4ca5-b0b8-5c050b67e7fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:42.360511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-6d623bda-ccfc-4ca5-b0b8-5c050b67e7fd None None] MFA Rules not processed for user `fbdff73734304485ac9884d6b44ea73c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:42.361907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6d623bda-ccfc-4ca5-b0b8-5c050b67e7fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:42.410922 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:42.446780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 682/1370] 10.222.0.59 () {58 vars in 1061 bytes} [Tue Sep 13 19:54:42 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:42.455335 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc873d0-f5db-43ee-ac0c-a72f812cb105 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:42.457003 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6bc873d0-f5db-43ee-ac0c-a72f812cb105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:42.512979 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:42.568850 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc873d0-f5db-43ee-ac0c-a72f812cb105 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:42.649831 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba72975-5e06-4f92-bcfd-6f1c904a6cdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:42.650441 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba72975-5e06-4f92-bcfd-6f1c904a6cdd service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:42.650721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba72975-5e06-4f92-bcfd-6f1c904a6cdd service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:42.650992 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba72975-5e06-4f92-bcfd-6f1c904a6cdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:42.652617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bba72975-5e06-4f92-bcfd-6f1c904a6cdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:42.759268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:42.772534 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba72975-5e06-4f92-bcfd-6f1c904a6cdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:42.773965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba72975-5e06-4f92-bcfd-6f1c904a6cdd service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:42.793469 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 689/1371] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:44.088397 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40818ef9-f75b-49b9-a9a4-a2000b029e9e None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:44.088929 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40818ef9-f75b-49b9-a9a4-a2000b029e9e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:44.088929 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40818ef9-f75b-49b9-a9a4-a2000b029e9e None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:44.090518 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 683/1372] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:44.095855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a9e8c-d90d-4b96-99d2-b5ca4e746ccc None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:44.096308 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a9e8c-d90d-4b96-99d2-b5ca4e746ccc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:44.096392 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a9e8c-d90d-4b96-99d2-b5ca4e746ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:44.161674 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-eb8a9e8c-d90d-4b96-99d2-b5ca4e746ccc None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:44.162903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-eb8a9e8c-d90d-4b96-99d2-b5ca4e746ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:44.259887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 690/1373] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:44.551368 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40818ef9-f75b-49b9-a9a4-a2000b029e9e None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:44.552890 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-40818ef9-f75b-49b9-a9a4-a2000b029e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:44.706279 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40818ef9-f75b-49b9-a9a4-a2000b029e9e None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:44.760087 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:44.825518 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901134a5-6156-4df3-82fc-4703bb80f4a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:44.827121 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901134a5-6156-4df3-82fc-4703bb80f4a5 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:44.827395 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901134a5-6156-4df3-82fc-4703bb80f4a5 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:44.827665 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901134a5-6156-4df3-82fc-4703bb80f4a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:44.829757 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-901134a5-6156-4df3-82fc-4703bb80f4a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:44.930025 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901134a5-6156-4df3-82fc-4703bb80f4a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:44.931620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901134a5-6156-4df3-82fc-4703bb80f4a5 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:44.950419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 684/1374] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:47.259237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb692a-b910-4afa-82ea-558f420358d1 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:47.259796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb692a-b910-4afa-82ea-558f420358d1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:47.259796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bb692a-b910-4afa-82ea-558f420358d1 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:47.261275 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 691/1375] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:47.266898 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989073d-f653-456b-94c3-c8ab572ff7ff None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:47.267334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989073d-f653-456b-94c3-c8ab572ff7ff None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:47.267506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e989073d-f653-456b-94c3-c8ab572ff7ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:47.335045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e989073d-f653-456b-94c3-c8ab572ff7ff None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:47.336422 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e989073d-f653-456b-94c3-c8ab572ff7ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:47.343728 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:47.438199 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 685/1376] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:47.728108 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb692a-b910-4afa-82ea-558f420358d1 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:47.729764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b1bb692a-b910-4afa-82ea-558f420358d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:47.794342 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:47.884858 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bb692a-b910-4afa-82ea-558f420358d1 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:48.005502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359996d2-060b-46b0-86fb-73759a09acd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:48.006389 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359996d2-060b-46b0-86fb-73759a09acd2 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:48.006766 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359996d2-060b-46b0-86fb-73759a09acd2 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:48.007141 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359996d2-060b-46b0-86fb-73759a09acd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:48.008861 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-359996d2-060b-46b0-86fb-73759a09acd2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:48.030925 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:48.105786 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359996d2-060b-46b0-86fb-73759a09acd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:48.107516 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359996d2-060b-46b0-86fb-73759a09acd2 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:48.127283 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 692/1377] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:50.450198 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aef6f5-d872-4cc6-b266-8ca264d4d901 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:50.451143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aef6f5-d872-4cc6-b266-8ca264d4d901 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:50.451143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aef6f5-d872-4cc6-b266-8ca264d4d901 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:50.458670 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028c610-080f-4a06-a58b-409b17664360 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:50.459378 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028c610-080f-4a06-a58b-409b17664360 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:50.459378 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028c610-080f-4a06-a58b-409b17664360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:50.461919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 686/1378] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:54:50 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:50.562284 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4028c610-080f-4a06-a58b-409b17664360 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:50.563505 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4028c610-080f-4a06-a58b-409b17664360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:50.667675 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:50.675059 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 693/1379] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:50.977942 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aef6f5-d872-4cc6-b266-8ca264d4d901 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:50.979480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b0aef6f5-d872-4cc6-b266-8ca264d4d901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:51.137113 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:51.150140 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aef6f5-d872-4cc6-b266-8ca264d4d901 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:51.268015 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a96e4-64c4-45a1-8861-00b5d3b6e862 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:51.268627 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a96e4-64c4-45a1-8861-00b5d3b6e862 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:51.268911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a96e4-64c4-45a1-8861-00b5d3b6e862 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:51.269189 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a96e4-64c4-45a1-8861-00b5d3b6e862 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:51.270834 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e76a96e4-64c4-45a1-8861-00b5d3b6e862 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:51.369682 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76a96e4-64c4-45a1-8861-00b5d3b6e862 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:51.371795 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76a96e4-64c4-45a1-8861-00b5d3b6e862 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:51.385016 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:51.393654 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 687/1380] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:53.895985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462e1f8-dd13-464f-82ef-7b0711ffc934 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:53.896404 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462e1f8-dd13-464f-82ef-7b0711ffc934 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:53.896501 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462e1f8-dd13-464f-82ef-7b0711ffc934 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:53.897924 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 694/1381] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:53.903463 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0ae4e-ad3a-4e1d-96ff-750565b41131 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:53.904024 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0ae4e-ad3a-4e1d-96ff-750565b41131 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:53.904024 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f0ae4e-ad3a-4e1d-96ff-750565b41131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:53.970706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-73f0ae4e-ad3a-4e1d-96ff-750565b41131 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:53.971916 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-73f0ae4e-ad3a-4e1d-96ff-750565b41131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:54.081117 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 688/1382] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:54:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:54.394446 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462e1f8-dd13-464f-82ef-7b0711ffc934 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:54.396017 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0462e1f8-dd13-464f-82ef-7b0711ffc934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:54.563455 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0462e1f8-dd13-464f-82ef-7b0711ffc934 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:54.637203 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:54.684895 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222de8af-8193-468a-b0c5-c428d407792a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:54.685504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222de8af-8193-468a-b0c5-c428d407792a service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:54.685820 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222de8af-8193-468a-b0c5-c428d407792a service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:54.686093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222de8af-8193-468a-b0c5-c428d407792a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:54.687676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-222de8af-8193-468a-b0c5-c428d407792a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:54.787964 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222de8af-8193-468a-b0c5-c428d407792a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:54.789837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222de8af-8193-468a-b0c5-c428d407792a service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:54.809600 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 695/1383] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:57.239052 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0b2e2-c81d-4904-82f8-1db8c2aa4fea None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:57.239599 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0b2e2-c81d-4904-82f8-1db8c2aa4fea None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:57.239709 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc0b2e2-c81d-4904-82f8-1db8c2aa4fea None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:57.241046 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 689/1384] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:54:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:57.246350 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb621c-1d8a-4fbe-b5d0-c7a2aa7287c9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:57.246764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb621c-1d8a-4fbe-b5d0-c7a2aa7287c9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:57.246971 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddb621c-1d8a-4fbe-b5d0-c7a2aa7287c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:57.313189 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2ddb621c-1d8a-4fbe-b5d0-c7a2aa7287c9 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:57.314405 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2ddb621c-1d8a-4fbe-b5d0-c7a2aa7287c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:57.347458 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:57.413546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 696/1385] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:54:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:57.701096 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0b2e2-c81d-4904-82f8-1db8c2aa4fea None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:57.702680 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-cbc0b2e2-c81d-4904-82f8-1db8c2aa4fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:57.782365 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:57.853381 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc0b2e2-c81d-4904-82f8-1db8c2aa4fea None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:57.980294 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58843045-0d2e-4835-b6ca-7666a8c4bd5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:57.980834 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58843045-0d2e-4835-b6ca-7666a8c4bd5f service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:57.981233 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58843045-0d2e-4835-b6ca-7666a8c4bd5f service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:57.981516 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58843045-0d2e-4835-b6ca-7666a8c4bd5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:57.983134 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-58843045-0d2e-4835-b6ca-7666a8c4bd5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:58.023718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:58.075310 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58843045-0d2e-4835-b6ca-7666a8c4bd5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:58.076917 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58843045-0d2e-4835-b6ca-7666a8c4bd5f service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:58.095325 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 690/1386] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:54:58.305302 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359ee01-8fac-49fc-abe2-81ffb42f7c2c None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:58.305892 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359ee01-8fac-49fc-abe2-81ffb42f7c2c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:58.306048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359ee01-8fac-49fc-abe2-81ffb42f7c2c None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:58.307539 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 697/1387] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:58.313580 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40386f72-0eaa-4ee5-8852-346cb96b5481 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:58.314120 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40386f72-0eaa-4ee5-8852-346cb96b5481 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:58.314246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40386f72-0eaa-4ee5-8852-346cb96b5481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:58.389624 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-40386f72-0eaa-4ee5-8852-346cb96b5481 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:58.390925 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-40386f72-0eaa-4ee5-8852-346cb96b5481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:58.493392 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 691/1388] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:58.794521 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf1849-327b-407e-9780-e050a81896d3 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:58.794808 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf1849-327b-407e-9780-e050a81896d3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:58.795087 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdf1849-327b-407e-9780-e050a81896d3 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:58.796464 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 698/1389] 10.222.0.59 () {54 vars in 966 bytes} [Tue Sep 13 19:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:54:58.802423 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469507e-b6d7-41d3-bbf2-c039b859052f None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:58.802714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469507e-b6d7-41d3-bbf2-c039b859052f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:58.803012 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d469507e-b6d7-41d3-bbf2-c039b859052f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:58.818844 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:58.881088 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-d469507e-b6d7-41d3-bbf2-c039b859052f None None] MFA Rules not processed for user `44093d63c1aa45b781d2ce30239ed598`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:54:58.882660 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d469507e-b6d7-41d3-bbf2-c039b859052f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:58.960217 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 692/1390] 10.222.0.59 () {58 vars in 1063 bytes} [Tue Sep 13 19:54:58 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:54:58.969335 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf1849-327b-407e-9780-e050a81896d3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:54:58.971529 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1cdf1849-327b-407e-9780-e050a81896d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:59.077127 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdf1849-327b-407e-9780-e050a81896d3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:54:59.139207 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:54:59.154556 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765c4fe-b4d9-40d2-9cb0-ced6e98a70bb service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44093d63c1aa45b781d2ce30239ed598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:54:59.163536 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765c4fe-b4d9-40d2-9cb0-ced6e98a70bb service glance] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:54:59.163536 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765c4fe-b4d9-40d2-9cb0-ced6e98a70bb service glance] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:54:59.163536 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765c4fe-b4d9-40d2-9cb0-ced6e98a70bb service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:54:59.163536 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0765c4fe-b4d9-40d2-9cb0-ced6e98a70bb service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:54:59.265863 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765c4fe-b4d9-40d2-9cb0-ced6e98a70bb service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:54:59.267853 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765c4fe-b4d9-40d2-9cb0-ced6e98a70bb service glance] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:54:59.285949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 699/1391] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:54:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:00.140128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a5cf9-8b8f-40c5-bf0c-b5d338ea35e9 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:00.140642 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a5cf9-8b8f-40c5-bf0c-b5d338ea35e9 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:00.140760 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a5cf9-8b8f-40c5-bf0c-b5d338ea35e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:00.208549 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-b44a5cf9-8b8f-40c5-bf0c-b5d338ea35e9 None None] MFA Rules not processed for user `9fd7a80714874e73bf64dfa392632391`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:00.209785 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b44a5cf9-8b8f-40c5-bf0c-b5d338ea35e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:00.266597 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:00.302416 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 693/1392] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Sep 13 19:55:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:00.343587 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ade33-e883-4413-868e-5a7d3fc60130 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:00.344077 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ade33-e883-4413-868e-5a7d3fc60130 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:00.344175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9ade33-e883-4413-868e-5a7d3fc60130 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:00.345459 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 700/1393] 10.222.0.59 () {54 vars in 943 bytes} [Tue Sep 13 19:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:55:00.352352 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d4ead-e169-4c16-877a-d79bf60f12a0 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:00.352644 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d4ead-e169-4c16-877a-d79bf60f12a0 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:00.352923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5d4ead-e169-4c16-877a-d79bf60f12a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:00.381960 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21447291-9d9c-4ab2-8017-ed6b4d7b98f8 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:00.382263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21447291-9d9c-4ab2-8017-ed6b4d7b98f8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:00.382533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21447291-9d9c-4ab2-8017-ed6b4d7b98f8 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:00.383868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 701/1394] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:55:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:55:00.388876 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc2e42-a106-403e-951a-42f87df4568a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:00.389150 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc2e42-a106-403e-951a-42f87df4568a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:00.389429 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddc2e42-a106-403e-951a-42f87df4568a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:00.433889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-0e5d4ead-e169-4c16-877a-d79bf60f12a0 None None] MFA Rules not processed for user `c00e78bf5e5c4db29c47dce1e87f3f5a`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:00.435109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0e5d4ead-e169-4c16-877a-d79bf60f12a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:00.457115 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1ddc2e42-a106-403e-951a-42f87df4568a None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:00.461671 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1ddc2e42-a106-403e-951a-42f87df4568a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:00.501323 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:00.544858 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 694/1395] 10.222.0.59 () {58 vars in 1040 bytes} [Tue Sep 13 19:55:00 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:00.554271 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d4ead-e169-4c16-877a-d79bf60f12a0 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:00.558331 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 702/1396] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:55:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:55:00.563721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5d4ead-e169-4c16-877a-d79bf60f12a0 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:00.589867 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:00.669320 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8cd5b5-4729-4351-8186-cdba34097c8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00e78bf5e5c4db29c47dce1e87f3f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:00.669967 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cd5b5-4729-4351-8186-cdba34097c8e service swift] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:00.670251 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cd5b5-4729-4351-8186-cdba34097c8e service swift] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:00.670524 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8cd5b5-4729-4351-8186-cdba34097c8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:00.672136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3a8cd5b5-4729-4351-8186-cdba34097c8e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:00.755798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8cd5b5-4729-4351-8186-cdba34097c8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:00.757668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8cd5b5-4729-4351-8186-cdba34097c8e service swift] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:00.765639 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 695/1397] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Sep 13 19:55:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 19:55:00.847544 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc2e42-a106-403e-951a-42f87df4568a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:00.848838 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1ddc2e42-a106-403e-951a-42f87df4568a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:00.962694 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddc2e42-a106-403e-951a-42f87df4568a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:01.018980 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:01.078583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426df1f-d5be-473d-bb0d-855a08a7ba90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:01.079173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426df1f-d5be-473d-bb0d-855a08a7ba90 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:01.079449 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426df1f-d5be-473d-bb0d-855a08a7ba90 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:01.079714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426df1f-d5be-473d-bb0d-855a08a7ba90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:01.082064 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d426df1f-d5be-473d-bb0d-855a08a7ba90 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:01.170763 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426df1f-d5be-473d-bb0d-855a08a7ba90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:01.172271 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d426df1f-d5be-473d-bb0d-855a08a7ba90 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:01.193246 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 703/1398] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:03.536405 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c4688-0061-4c8f-8055-bcb9ba9bf476 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:03.537010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c4688-0061-4c8f-8055-bcb9ba9bf476 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:03.537010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539c4688-0061-4c8f-8055-bcb9ba9bf476 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:03.538332 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 696/1399] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:55:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:55:03.543554 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2949c-f6f7-4621-bfae-2c5f1b0946cd None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:03.544010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2949c-f6f7-4621-bfae-2c5f1b0946cd None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:03.544117 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2949c-f6f7-4621-bfae-2c5f1b0946cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:03.616994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-74d2949c-f6f7-4621-bfae-2c5f1b0946cd None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:03.618291 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-74d2949c-f6f7-4621-bfae-2c5f1b0946cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:03.637678 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:03.729822 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 704/1400] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:55:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:04.024650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c4688-0061-4c8f-8055-bcb9ba9bf476 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:04.026197 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-539c4688-0061-4c8f-8055-bcb9ba9bf476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:04.092269 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:04.184290 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539c4688-0061-4c8f-8055-bcb9ba9bf476 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:04.320221 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d22ab-f2eb-40a1-9833-0f9d011c3064 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:04.320870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d22ab-f2eb-40a1-9833-0f9d011c3064 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:04.321152 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d22ab-f2eb-40a1-9833-0f9d011c3064 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:04.321424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d22ab-f2eb-40a1-9833-0f9d011c3064 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:04.323042 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0e1d22ab-f2eb-40a1-9833-0f9d011c3064 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:04.344270 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:04.426097 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d22ab-f2eb-40a1-9833-0f9d011c3064 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:04.427721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1d22ab-f2eb-40a1-9833-0f9d011c3064 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:04.449875 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 697/1401] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:06.817255 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae571a67-5bec-4f93-a114-358220343696 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:06.817864 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae571a67-5bec-4f93-a114-358220343696 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:06.817864 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae571a67-5bec-4f93-a114-358220343696 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:06.819130 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 705/1402] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:55:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:55:06.824414 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcac6e-4176-483b-8abc-aef74340f9a2 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:06.824860 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcac6e-4176-483b-8abc-aef74340f9a2 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:06.824958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27dcac6e-4176-483b-8abc-aef74340f9a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:06.893977 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-27dcac6e-4176-483b-8abc-aef74340f9a2 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:06.895188 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-27dcac6e-4176-483b-8abc-aef74340f9a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:07.009849 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:07.018633 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 698/1403] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:55:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:07.351700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae571a67-5bec-4f93-a114-358220343696 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:07.353212 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ae571a67-5bec-4f93-a114-358220343696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:07.546530 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:07.548613 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae571a67-5bec-4f93-a114-358220343696 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:07.676262 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c13b676-efb5-4d99-a88e-e4104059e0c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:07.676800 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13b676-efb5-4d99-a88e-e4104059e0c1 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:07.677081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13b676-efb5-4d99-a88e-e4104059e0c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:07.677350 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c13b676-efb5-4d99-a88e-e4104059e0c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:07.678957 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7c13b676-efb5-4d99-a88e-e4104059e0c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:07.781169 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13b676-efb5-4d99-a88e-e4104059e0c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:07.782817 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c13b676-efb5-4d99-a88e-e4104059e0c1 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:07.805821 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 706/1404] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:10.126263 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63344e-981f-4698-b00e-2906d66e314a None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:10.126801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63344e-981f-4698-b00e-2906d66e314a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:10.126801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63344e-981f-4698-b00e-2906d66e314a None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:10.128143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 699/1405] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:55:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:55:10.133644 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1526597-2817-4cef-8502-9603cdc6c67a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:10.134124 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1526597-2817-4cef-8502-9603cdc6c67a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:10.138512 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1526597-2817-4cef-8502-9603cdc6c67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:10.139211 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:10.209471 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f1526597-2817-4cef-8502-9603cdc6c67a None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:10.210736 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f1526597-2817-4cef-8502-9603cdc6c67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:10.314965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 707/1406] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:55:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:10.603112 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63344e-981f-4698-b00e-2906d66e314a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:10.604634 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bc63344e-981f-4698-b00e-2906d66e314a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:10.768901 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63344e-981f-4698-b00e-2906d66e314a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:10.849166 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:10.905323 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2452c37a-72f1-473d-be7e-8e42d187f86a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:10.905970 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452c37a-72f1-473d-be7e-8e42d187f86a service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:10.906256 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452c37a-72f1-473d-be7e-8e42d187f86a service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:10.906532 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2452c37a-72f1-473d-be7e-8e42d187f86a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:10.908133 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2452c37a-72f1-473d-be7e-8e42d187f86a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:11.014743 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452c37a-72f1-473d-be7e-8e42d187f86a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:11.016350 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2452c37a-72f1-473d-be7e-8e42d187f86a service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:11.036261 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 700/1407] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:20.313199 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=64 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:21.032987 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=64 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:25.280157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a9615-ab51-4397-99ce-28039c50332b None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:25.280729 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a9615-ab51-4397-99ce-28039c50332b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:25.280729 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a9615-ab51-4397-99ce-28039c50332b None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:25.282083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 708/1408] 10.222.0.59 () {54 vars in 918 bytes} [Tue Sep 13 19:55:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:55:25.287307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f7949-e2f0-42db-a10f-52e5001e88c1 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:25.287767 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f7949-e2f0-42db-a10f-52e5001e88c1 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:25.287874 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603f7949-e2f0-42db-a10f-52e5001e88c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:25.363128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-603f7949-e2f0-42db-a10f-52e5001e88c1 None None] MFA Rules not processed for user `89e7df5170c841abb449f3b4a547ec4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:25.364325 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-603f7949-e2f0-42db-a10f-52e5001e88c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:25.472119 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 701/1409] 10.222.0.59 () {58 vars in 1015 bytes} [Tue Sep 13 19:55:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:25.487789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772457c9-0de4-4859-913e-614a5f447162 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:25.488101 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772457c9-0de4-4859-913e-614a5f447162 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:25.488369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772457c9-0de4-4859-913e-614a5f447162 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:25.489721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 709/1410] 10.222.0.59 () {54 vars in 918 bytes} [Tue Sep 13 19:55:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:55:25.494890 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87fc50-5c95-48e6-9b99-cc159ff67b25 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:25.503742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87fc50-5c95-48e6-9b99-cc159ff67b25 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:25.503742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87fc50-5c95-48e6-9b99-cc159ff67b25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:25.568239 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:25.571093 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-0c87fc50-5c95-48e6-9b99-cc159ff67b25 None None] MFA Rules not processed for user `3919b24291f54df99a9da0f5d3164ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:25.572300 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0c87fc50-5c95-48e6-9b99-cc159ff67b25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:25.685611 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 702/1411] 10.222.0.59 () {58 vars in 1015 bytes} [Tue Sep 13 19:55:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:28.260459 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16668049-da77-4ece-8739-14cea877b6d9 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:28.261034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16668049-da77-4ece-8739-14cea877b6d9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:28.261034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16668049-da77-4ece-8739-14cea877b6d9 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:28.262358 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 710/1412] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:55:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:55:28.267694 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef3724-19be-443c-82c2-b4896a088653 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:28.268115 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef3724-19be-443c-82c2-b4896a088653 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:28.268281 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef3724-19be-443c-82c2-b4896a088653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:28.333557 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-f6ef3724-19be-443c-82c2-b4896a088653 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:28.334772 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f6ef3724-19be-443c-82c2-b4896a088653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:28.389547 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:28.430953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 703/1413] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:55:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 19:55:28.717821 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16668049-da77-4ece-8739-14cea877b6d9 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:28.719322 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-16668049-da77-4ece-8739-14cea877b6d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:28.867470 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16668049-da77-4ece-8739-14cea877b6d9 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:28.939427 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:28.978957 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33510a7a-6923-4369-b547-a5852559ef82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:28.979493 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33510a7a-6923-4369-b547-a5852559ef82 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:28.979765 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33510a7a-6923-4369-b547-a5852559ef82 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:28.980033 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33510a7a-6923-4369-b547-a5852559ef82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:28.981628 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-33510a7a-6923-4369-b547-a5852559ef82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:29.070455 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33510a7a-6923-4369-b547-a5852559ef82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:29.072037 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33510a7a-6923-4369-b547-a5852559ef82 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:29.089285 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 711/1414] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:30.220220 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20f1b0-66e2-4c29-90fd-2185e18f0812 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:30.220744 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20f1b0-66e2-4c29-90fd-2185e18f0812 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:30.220744 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e20f1b0-66e2-4c29-90fd-2185e18f0812 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:30.222629 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 704/1415] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:55:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:55:30.228925 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f2af2-e252-4b5a-b1e4-be5718f63fa0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:30.229352 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f2af2-e252-4b5a-b1e4-be5718f63fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:30.229458 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f2af2-e252-4b5a-b1e4-be5718f63fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:30.304217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6c4f2af2-e252-4b5a-b1e4-be5718f63fa0 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:30.308017 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6c4f2af2-e252-4b5a-b1e4-be5718f63fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:30.332191 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:30.401091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 712/1416] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:55:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:30.552128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20f1b0-66e2-4c29-90fd-2185e18f0812 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:30.553637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3e20f1b0-66e2-4c29-90fd-2185e18f0812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:30.697473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e20f1b0-66e2-4c29-90fd-2185e18f0812 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:30.738025 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:30.809823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b31418f-5fd0-4569-be47-8135fa964862 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:30.810362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31418f-5fd0-4569-be47-8135fa964862 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:30.810639 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31418f-5fd0-4569-be47-8135fa964862 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:30.810909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b31418f-5fd0-4569-be47-8135fa964862 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:30.812476 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9b31418f-5fd0-4569-be47-8135fa964862 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:30.901138 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31418f-5fd0-4569-be47-8135fa964862 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:30.902755 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b31418f-5fd0-4569-be47-8135fa964862 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:30.920221 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 705/1417] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:32.042523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39fe1d-dfa0-4d00-8b57-b18a0bfba95d None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:32.043060 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39fe1d-dfa0-4d00-8b57-b18a0bfba95d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:32.043060 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c39fe1d-dfa0-4d00-8b57-b18a0bfba95d None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:32.044379 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 713/1418] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:55:32.050956 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843180ae-29dc-4ae1-9a56-47e6f366d85e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:32.051422 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843180ae-29dc-4ae1-9a56-47e6f366d85e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:32.051526 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843180ae-29dc-4ae1-9a56-47e6f366d85e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:32.104670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:32.126542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-843180ae-29dc-4ae1-9a56-47e6f366d85e None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:32.127791 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-843180ae-29dc-4ae1-9a56-47e6f366d85e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:32.222947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 706/1419] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:32.374685 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39fe1d-dfa0-4d00-8b57-b18a0bfba95d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:32.376153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7c39fe1d-dfa0-4d00-8b57-b18a0bfba95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:32.520773 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c39fe1d-dfa0-4d00-8b57-b18a0bfba95d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:32.532592 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:32.631269 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000a68a-3238-4bea-9769-15e27985830c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:32.631793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000a68a-3238-4bea-9769-15e27985830c service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:32.632069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000a68a-3238-4bea-9769-15e27985830c service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:32.632337 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000a68a-3238-4bea-9769-15e27985830c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:32.633920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2000a68a-3238-4bea-9769-15e27985830c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:32.720084 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000a68a-3238-4bea-9769-15e27985830c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:32.722193 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000a68a-3238-4bea-9769-15e27985830c service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:32.739662 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 714/1420] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:33.847356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2972b7-91f3-4887-a1e1-658b8e44e279 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:33.847931 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2972b7-91f3-4887-a1e1-658b8e44e279 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:33.847931 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2972b7-91f3-4887-a1e1-658b8e44e279 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:33.849273 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 707/1421] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:55:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:55:33.855461 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91729947-f849-4dd7-b416-74db1d106ddc None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:33.855915 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91729947-f849-4dd7-b416-74db1d106ddc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:33.856020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91729947-f849-4dd7-b416-74db1d106ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:33.876096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:33.932794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-91729947-f849-4dd7-b416-74db1d106ddc None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:33.934032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-91729947-f849-4dd7-b416-74db1d106ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:34.030294 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 715/1422] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:55:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:34.180312 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2972b7-91f3-4887-a1e1-658b8e44e279 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:34.181845 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3e2972b7-91f3-4887-a1e1-658b8e44e279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:34.292056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:34.326422 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2972b7-91f3-4887-a1e1-658b8e44e279 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:34.437443 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc2c19-d516-43fe-8eb4-c65c72070ee2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:34.438081 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc2c19-d516-43fe-8eb4-c65c72070ee2 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:34.438361 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc2c19-d516-43fe-8eb4-c65c72070ee2 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:34.438631 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc2c19-d516-43fe-8eb4-c65c72070ee2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:34.440195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4afc2c19-d516-43fe-8eb4-c65c72070ee2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:34.516575 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:34.529714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc2c19-d516-43fe-8eb4-c65c72070ee2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:34.531328 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afc2c19-d516-43fe-8eb4-c65c72070ee2 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:34.548909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 708/1423] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:35.659664 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b655ef-e0e9-4c1b-b78d-b221be7032a5 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:35.660218 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b655ef-e0e9-4c1b-b78d-b221be7032a5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:35.660218 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b655ef-e0e9-4c1b-b78d-b221be7032a5 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:35.661451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 716/1424] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:55:35.667727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf58572-3f17-4cb3-b425-36020c9dc187 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:35.668191 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf58572-3f17-4cb3-b425-36020c9dc187 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:35.668288 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf58572-3f17-4cb3-b425-36020c9dc187 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:35.744697 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-edf58572-3f17-4cb3-b425-36020c9dc187 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:35.745925 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-edf58572-3f17-4cb3-b425-36020c9dc187 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:35.843396 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 709/1425] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:35.997340 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b655ef-e0e9-4c1b-b78d-b221be7032a5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:35.998917 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-19b655ef-e0e9-4c1b-b78d-b221be7032a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:36.082285 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:36.144936 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b655ef-e0e9-4c1b-b78d-b221be7032a5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:36.259444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309e793-64a9-4d24-a792-0bd2d8a62dce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:36.259967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309e793-64a9-4d24-a792-0bd2d8a62dce service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:36.260252 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309e793-64a9-4d24-a792-0bd2d8a62dce service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:36.260518 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309e793-64a9-4d24-a792-0bd2d8a62dce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:36.262128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4309e793-64a9-4d24-a792-0bd2d8a62dce service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:36.310027 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:36.351293 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309e793-64a9-4d24-a792-0bd2d8a62dce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:36.352897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309e793-64a9-4d24-a792-0bd2d8a62dce service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:36.370936 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 717/1426] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:37.473821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ad3cf-2ac6-4296-861c-2210f7655012 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:37.474400 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ad3cf-2ac6-4296-861c-2210f7655012 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:37.474400 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ad3cf-2ac6-4296-861c-2210f7655012 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:37.475760 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 710/1427] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:55:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:55:37.482171 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae69797-7d9f-429a-90eb-a567028a980d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:37.482615 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae69797-7d9f-429a-90eb-a567028a980d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:37.482722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae69797-7d9f-429a-90eb-a567028a980d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:37.558775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9ae69797-7d9f-429a-90eb-a567028a980d None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:37.559961 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9ae69797-7d9f-429a-90eb-a567028a980d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:37.654780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 718/1428] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:37.804732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ad3cf-2ac6-4296-861c-2210f7655012 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:37.806329 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-819ad3cf-2ac6-4296-861c-2210f7655012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:37.855246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:37.952195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ad3cf-2ac6-4296-861c-2210f7655012 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:38.064249 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8756583-010c-4a25-b18f-13a3bf84eac3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:38.064779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8756583-010c-4a25-b18f-13a3bf84eac3 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:38.065058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8756583-010c-4a25-b18f-13a3bf84eac3 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:38.065357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8756583-010c-4a25-b18f-13a3bf84eac3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:38.066964 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c8756583-010c-4a25-b18f-13a3bf84eac3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:38.073762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:38.155545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8756583-010c-4a25-b18f-13a3bf84eac3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:38.157145 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8756583-010c-4a25-b18f-13a3bf84eac3 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:38.175320 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 711/1429] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:39.292037 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448ce04-2ca7-4be0-8519-9b93d5b1977c None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:39.292618 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448ce04-2ca7-4be0-8519-9b93d5b1977c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:39.292618 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448ce04-2ca7-4be0-8519-9b93d5b1977c None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:39.294021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 719/1430] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:55:39.300922 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2001b0-d7eb-4403-9173-cee6662c0a3b None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:39.301368 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2001b0-d7eb-4403-9173-cee6662c0a3b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:39.301472 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2001b0-d7eb-4403-9173-cee6662c0a3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:39.376730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-bd2001b0-d7eb-4403-9173-cee6662c0a3b None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:39.377989 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bd2001b0-d7eb-4403-9173-cee6662c0a3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:39.444410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:39.474342 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 712/1431] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:55:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:39.627134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448ce04-2ca7-4be0-8519-9b93d5b1977c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:39.628592 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8448ce04-2ca7-4be0-8519-9b93d5b1977c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:39.646212 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:39.773973 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448ce04-2ca7-4be0-8519-9b93d5b1977c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:39.862029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:39.887967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460b92e-d6f8-448e-acbd-a2ef57e1b356 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:39.888498 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460b92e-d6f8-448e-acbd-a2ef57e1b356 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:39.888772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460b92e-d6f8-448e-acbd-a2ef57e1b356 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:39.889039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460b92e-d6f8-448e-acbd-a2ef57e1b356 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:39.890655 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f460b92e-d6f8-448e-acbd-a2ef57e1b356 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:39.978921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460b92e-d6f8-448e-acbd-a2ef57e1b356 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:39.980511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460b92e-d6f8-448e-acbd-a2ef57e1b356 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:39.998658 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 720/1432] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:41.080932 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e2c09-0351-4bfb-96a4-6cb9bf378678 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:41.082017 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e2c09-0351-4bfb-96a4-6cb9bf378678 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:41.082017 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429e2c09-0351-4bfb-96a4-6cb9bf378678 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:41.083343 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 713/1433] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:55:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:55:41.089494 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408078e-1985-4469-a826-6804746c20fb None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:41.089947 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408078e-1985-4469-a826-6804746c20fb None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:41.090058 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a408078e-1985-4469-a826-6804746c20fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:41.166249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a408078e-1985-4469-a826-6804746c20fb None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:41.167396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a408078e-1985-4469-a826-6804746c20fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:41.207973 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:41.260486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 721/1434] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:55:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:41.410948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e2c09-0351-4bfb-96a4-6cb9bf378678 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:41.412465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-429e2c09-0351-4bfb-96a4-6cb9bf378678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:41.671820 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429e2c09-0351-4bfb-96a4-6cb9bf378678 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:41.725573 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:41.782070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d11a9-72de-483e-a7a0-e327244eb3a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:41.782450 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d11a9-72de-483e-a7a0-e327244eb3a6 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:41.782728 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d11a9-72de-483e-a7a0-e327244eb3a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:41.783016 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d11a9-72de-483e-a7a0-e327244eb3a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:41.785121 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3a9d11a9-72de-483e-a7a0-e327244eb3a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:41.872546 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d11a9-72de-483e-a7a0-e327244eb3a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:41.874136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d11a9-72de-483e-a7a0-e327244eb3a6 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:41.891948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 714/1435] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:42.997114 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b9b69-efe3-40f8-a2f2-a39af895c14a None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:42.997724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b9b69-efe3-40f8-a2f2-a39af895c14a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:42.997724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9b9b69-efe3-40f8-a2f2-a39af895c14a None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:42.999036 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 722/1436] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:55:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:55:43.005728 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3629a-cef5-49c1-8c21-f5fc2f6d6097 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:43.006185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3629a-cef5-49c1-8c21-f5fc2f6d6097 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:43.006295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f3629a-cef5-49c1-8c21-f5fc2f6d6097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:43.081837 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-69f3629a-cef5-49c1-8c21-f5fc2f6d6097 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:43.083042 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-69f3629a-cef5-49c1-8c21-f5fc2f6d6097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:43.085045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:43.180960 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 715/1437] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:55:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:43.328346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b9b69-efe3-40f8-a2f2-a39af895c14a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:43.329891 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8a9b9b69-efe3-40f8-a2f2-a39af895c14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:43.473076 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9b9b69-efe3-40f8-a2f2-a39af895c14a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:43.500269 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:43.585425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1e63c-d360-42d9-b335-e3ace1235f40 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:43.586049 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1e63c-d360-42d9-b335-e3ace1235f40 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:43.586326 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1e63c-d360-42d9-b335-e3ace1235f40 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:43.586594 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1e63c-d360-42d9-b335-e3ace1235f40 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:43.588154 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-20a1e63c-d360-42d9-b335-e3ace1235f40 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:43.674724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1e63c-d360-42d9-b335-e3ace1235f40 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:43.676825 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1e63c-d360-42d9-b335-e3ace1235f40 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:43.694438 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 723/1438] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:45.743358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bf316-ef26-4ce5-8355-695bcbe41956 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:45.743912 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bf316-ef26-4ce5-8355-695bcbe41956 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:45.743912 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7bf316-ef26-4ce5-8355-695bcbe41956 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:45.745249 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 716/1439] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:55:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 19:55:45.750574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4254f-bc59-4c1d-9e23-b826e77af62a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:45.750997 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4254f-bc59-4c1d-9e23-b826e77af62a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:45.751122 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f4254f-bc59-4c1d-9e23-b826e77af62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:45.793299 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:45.820025 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-73f4254f-bc59-4c1d-9e23-b826e77af62a None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:45.821219 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-73f4254f-bc59-4c1d-9e23-b826e77af62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:45.915822 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 724/1440] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:55:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:46.201585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bf316-ef26-4ce5-8355-695bcbe41956 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:46.203162 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-df7bf316-ef26-4ce5-8355-695bcbe41956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:46.304806 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7bf316-ef26-4ce5-8355-695bcbe41956 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:46.336528 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:46.378426 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2a0932-301a-4f74-85df-da68766c3b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:46.378990 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a0932-301a-4f74-85df-da68766c3b91 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:46.379269 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a0932-301a-4f74-85df-da68766c3b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:46.379540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2a0932-301a-4f74-85df-da68766c3b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:46.381117 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5b2a0932-301a-4f74-85df-da68766c3b91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:46.491341 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a0932-301a-4f74-85df-da68766c3b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:46.492774 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2a0932-301a-4f74-85df-da68766c3b91 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:46.510477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 717/1441] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:48.783586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfc757-dc80-4e73-9f1f-d6da2ac731db None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:48.784178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfc757-dc80-4e73-9f1f-d6da2ac731db None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:48.784178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfc757-dc80-4e73-9f1f-d6da2ac731db None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:48.785580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 725/1442] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:55:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:55:48.791118 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02756a-dc30-4843-bacc-b2c8131d1564 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:48.791534 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02756a-dc30-4843-bacc-b2c8131d1564 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:48.791693 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e02756a-dc30-4843-bacc-b2c8131d1564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:48.857071 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-0e02756a-dc30-4843-bacc-b2c8131d1564 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:48.858294 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0e02756a-dc30-4843-bacc-b2c8131d1564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:48.871594 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:48.955945 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 718/1443] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:55:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:49.243684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfc757-dc80-4e73-9f1f-d6da2ac731db None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:49.245219 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2adfc757-dc80-4e73-9f1f-d6da2ac731db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:49.347740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfc757-dc80-4e73-9f1f-d6da2ac731db None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:49.360205 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:49.420716 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d1d315-cb62-4764-a40f-f9f3f7299479 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:49.421315 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1d315-cb62-4764-a40f-f9f3f7299479 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:49.421591 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1d315-cb62-4764-a40f-f9f3f7299479 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:49.421891 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d1d315-cb62-4764-a40f-f9f3f7299479 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:49.423470 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-77d1d315-cb62-4764-a40f-f9f3f7299479 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:49.531756 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1d315-cb62-4764-a40f-f9f3f7299479 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:49.533135 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d1d315-cb62-4764-a40f-f9f3f7299479 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:49.551436 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 726/1444] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:52.059249 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f04ad6-3ac9-4641-a74a-c00a86026738 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:52.059764 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f04ad6-3ac9-4641-a74a-c00a86026738 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:52.059764 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f04ad6-3ac9-4641-a74a-c00a86026738 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:52.061069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 719/1445] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:55:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:55:52.066790 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18aa4e3-0fe0-4d16-b34e-1154c3e9a94f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:52.067209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18aa4e3-0fe0-4d16-b34e-1154c3e9a94f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:52.067345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18aa4e3-0fe0-4d16-b34e-1154c3e9a94f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:52.114970 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:52.132981 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f18aa4e3-0fe0-4d16-b34e-1154c3e9a94f None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:52.134228 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f18aa4e3-0fe0-4d16-b34e-1154c3e9a94f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:52.230423 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 727/1446] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:55:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:52.514581 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f04ad6-3ac9-4641-a74a-c00a86026738 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:52.516092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a9f04ad6-3ac9-4641-a74a-c00a86026738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:52.619236 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f04ad6-3ac9-4641-a74a-c00a86026738 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:52.658960 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:52.692905 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e8e140-ab45-4e64-8f13-4d80b64a272b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:52.693502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8e140-ab45-4e64-8f13-4d80b64a272b service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:52.693805 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8e140-ab45-4e64-8f13-4d80b64a272b service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:52.694074 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e8e140-ab45-4e64-8f13-4d80b64a272b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:52.695638 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d2e8e140-ab45-4e64-8f13-4d80b64a272b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:52.802069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8e140-ab45-4e64-8f13-4d80b64a272b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:52.803428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e8e140-ab45-4e64-8f13-4d80b64a272b service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:52.821491 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 720/1447] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:55.083233 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3cd7e-ad87-4f14-a47d-d5219300961f None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:55.083803 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3cd7e-ad87-4f14-a47d-d5219300961f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:55.083803 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce3cd7e-ad87-4f14-a47d-d5219300961f None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:55.085135 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 728/1448] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:55:55.090386 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a31bc0-672c-4f40-9d16-440abd0b5d11 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:55.090788 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a31bc0-672c-4f40-9d16-440abd0b5d11 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:55.090935 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a31bc0-672c-4f40-9d16-440abd0b5d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:55.156102 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-b9a31bc0-672c-4f40-9d16-440abd0b5d11 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:55.157221 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b9a31bc0-672c-4f40-9d16-440abd0b5d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:55.178422 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:55.253652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 721/1449] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:55:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:55.539339 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3cd7e-ad87-4f14-a47d-d5219300961f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:55.540863 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7ce3cd7e-ad87-4f14-a47d-d5219300961f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:55.640302 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce3cd7e-ad87-4f14-a47d-d5219300961f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:55.660562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:55.712021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e29b3bc-8eb2-4a5c-a544-d1da3ac6e4c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:55.712611 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29b3bc-8eb2-4a5c-a544-d1da3ac6e4c5 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:55.712882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29b3bc-8eb2-4a5c-a544-d1da3ac6e4c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:55.713147 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e29b3bc-8eb2-4a5c-a544-d1da3ac6e4c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:55.714722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2e29b3bc-8eb2-4a5c-a544-d1da3ac6e4c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:55.825118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29b3bc-8eb2-4a5c-a544-d1da3ac6e4c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:55.826569 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e29b3bc-8eb2-4a5c-a544-d1da3ac6e4c5 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:55.845549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 729/1450] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:55:58.147333 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd2330-950b-488f-96ef-adac2eb9044a None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:58.147863 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd2330-950b-488f-96ef-adac2eb9044a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:58.147863 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cdd2330-950b-488f-96ef-adac2eb9044a None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:58.149162 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 722/1451] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:55:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:55:58.154508 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c16ee-4534-42ec-bb3f-c5b557b075ae None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:58.154920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c16ee-4534-42ec-bb3f-c5b557b075ae None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:58.155085 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6c16ee-4534-42ec-bb3f-c5b557b075ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:58.217371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:58.219972 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4c6c16ee-4534-42ec-bb3f-c5b557b075ae None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:55:58.221153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4c6c16ee-4534-42ec-bb3f-c5b557b075ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:58.317395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 730/1452] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:55:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:55:58.603159 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd2330-950b-488f-96ef-adac2eb9044a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:55:58.604718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1cdd2330-950b-488f-96ef-adac2eb9044a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:58.706859 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cdd2330-950b-488f-96ef-adac2eb9044a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:55:58.760923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:55:58.784739 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4a9422-4628-40cb-9a69-c49e79af7042 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:55:58.785342 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a9422-4628-40cb-9a69-c49e79af7042 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:55:58.785620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a9422-4628-40cb-9a69-c49e79af7042 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:55:58.785920 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4a9422-4628-40cb-9a69-c49e79af7042 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:55:58.787478 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bd4a9422-4628-40cb-9a69-c49e79af7042 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:55:58.895812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a9422-4628-40cb-9a69-c49e79af7042 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:55:58.897278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4a9422-4628-40cb-9a69-c49e79af7042 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:55:58.915423 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 723/1453] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:55:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:01.100844 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a395e-4652-4fbc-a096-ff3f3f7d13a0 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:01.101413 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a395e-4652-4fbc-a096-ff3f3f7d13a0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:01.101413 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a395e-4652-4fbc-a096-ff3f3f7d13a0 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:01.102827 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 731/1454] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:56:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:56:01.108047 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3eeafa-00c9-4721-9f29-983c51722938 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:01.108472 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3eeafa-00c9-4721-9f29-983c51722938 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:01.108583 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3eeafa-00c9-4721-9f29-983c51722938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:01.174500 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-6d3eeafa-00c9-4721-9f29-983c51722938 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:01.176145 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6d3eeafa-00c9-4721-9f29-983c51722938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:01.204024 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:01.271143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 724/1455] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:56:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:01.556759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a395e-4652-4fbc-a096-ff3f3f7d13a0 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:01.558293 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4f9a395e-4652-4fbc-a096-ff3f3f7d13a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:01.659996 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a395e-4652-4fbc-a096-ff3f3f7d13a0 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:01.687436 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:01.731850 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4203e1-65f9-466d-a203-adbefc323d56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:01.732452 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4203e1-65f9-466d-a203-adbefc323d56 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:01.732733 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4203e1-65f9-466d-a203-adbefc323d56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:01.733003 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4203e1-65f9-466d-a203-adbefc323d56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:01.734621 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fe4203e1-65f9-466d-a203-adbefc323d56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:01.842385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4203e1-65f9-466d-a203-adbefc323d56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:01.843751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4203e1-65f9-466d-a203-adbefc323d56 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:01.861800 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 732/1456] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:04.047213 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08108185-b992-40df-b185-479ffc2be77f None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:04.047742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08108185-b992-40df-b185-479ffc2be77f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:04.047742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08108185-b992-40df-b185-479ffc2be77f None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:04.049030 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 725/1457] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:56:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:56:04.054226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db486a1-b9cb-40de-b70a-e38f196075bc None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:04.054666 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db486a1-b9cb-40de-b70a-e38f196075bc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:04.054779 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db486a1-b9cb-40de-b70a-e38f196075bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:04.123440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7db486a1-b9cb-40de-b70a-e38f196075bc None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:04.124324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7db486a1-b9cb-40de-b70a-e38f196075bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:04.133592 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:04.222974 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 733/1458] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:56:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:04.505558 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08108185-b992-40df-b185-479ffc2be77f None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:04.507237 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-08108185-b992-40df-b185-479ffc2be77f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:04.610860 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08108185-b992-40df-b185-479ffc2be77f None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:04.666170 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:04.684917 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f2535c-d4d4-4e18-862d-d085f7b97bab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:04.685598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2535c-d4d4-4e18-862d-d085f7b97bab service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:04.685923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2535c-d4d4-4e18-862d-d085f7b97bab service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:04.686191 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f2535c-d4d4-4e18-862d-d085f7b97bab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:04.687783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a3f2535c-d4d4-4e18-862d-d085f7b97bab service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:04.794235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2535c-d4d4-4e18-862d-d085f7b97bab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:04.795561 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f2535c-d4d4-4e18-862d-d085f7b97bab service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:04.814058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 726/1459] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:07.001149 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c49ce-e87c-4a70-ad3c-fa0bb1f41f37 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:07.001774 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c49ce-e87c-4a70-ad3c-fa0bb1f41f37 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:07.001774 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2c49ce-e87c-4a70-ad3c-fa0bb1f41f37 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:07.003090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 734/1460] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:56:07.008518 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdb027-5181-4e9d-b640-9dc7390601c1 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:07.008951 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdb027-5181-4e9d-b640-9dc7390601c1 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:07.009058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdb027-5181-4e9d-b640-9dc7390601c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:07.073377 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-fffdb027-5181-4e9d-b640-9dc7390601c1 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:07.074592 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-fffdb027-5181-4e9d-b640-9dc7390601c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:07.113439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:07.170590 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 727/1461] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:56:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:07.451288 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c49ce-e87c-4a70-ad3c-fa0bb1f41f37 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:07.452802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3e2c49ce-e87c-4a70-ad3c-fa0bb1f41f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:07.555641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2c49ce-e87c-4a70-ad3c-fa0bb1f41f37 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:07.593342 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:07.628733 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577165b-4cff-439e-ab34-61a52bf9d6fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:07.629324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577165b-4cff-439e-ab34-61a52bf9d6fa service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:07.629624 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577165b-4cff-439e-ab34-61a52bf9d6fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:07.629933 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577165b-4cff-439e-ab34-61a52bf9d6fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:07.631569 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0577165b-4cff-439e-ab34-61a52bf9d6fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:07.735456 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577165b-4cff-439e-ab34-61a52bf9d6fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:07.736867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577165b-4cff-439e-ab34-61a52bf9d6fa service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:07.755205 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 735/1462] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:09.897582 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf491cb-67db-4412-815d-da87cb6811da None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:09.898039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf491cb-67db-4412-815d-da87cb6811da None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:09.898156 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf491cb-67db-4412-815d-da87cb6811da None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:09.899551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 728/1463] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:56:09.904959 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e4f6d-2bb3-4f83-86da-2520110df586 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:09.905398 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e4f6d-2bb3-4f83-86da-2520110df586 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:09.905509 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58e4f6d-2bb3-4f83-86da-2520110df586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:09.970665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d58e4f6d-2bb3-4f83-86da-2520110df586 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:09.971850 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d58e4f6d-2bb3-4f83-86da-2520110df586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:09.989759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:10.066271 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 736/1464] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:56:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:10.352555 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf491cb-67db-4412-815d-da87cb6811da None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:10.354143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3cf491cb-67db-4412-815d-da87cb6811da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:10.457809 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf491cb-67db-4412-815d-da87cb6811da None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:10.524617 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:10.531112 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e098b8-44bc-4baa-8238-599a4ac6cf38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:10.531841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e098b8-44bc-4baa-8238-599a4ac6cf38 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:10.532225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e098b8-44bc-4baa-8238-599a4ac6cf38 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:10.532501 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e098b8-44bc-4baa-8238-599a4ac6cf38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:10.534093 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-14e098b8-44bc-4baa-8238-599a4ac6cf38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:10.644336 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e098b8-44bc-4baa-8238-599a4ac6cf38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:10.645776 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e098b8-44bc-4baa-8238-599a4ac6cf38 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:10.664093 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 729/1465] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:12.806170 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0da78-047d-48a9-b03a-a717424e8a94 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:12.806746 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0da78-047d-48a9-b03a-a717424e8a94 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:12.806746 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0da78-047d-48a9-b03a-a717424e8a94 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:12.808057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 737/1466] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 19:56:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:56:12.813317 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c002cbd-5b79-4f86-90ec-17fc46818af7 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:12.813757 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c002cbd-5b79-4f86-90ec-17fc46818af7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:12.813911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c002cbd-5b79-4f86-90ec-17fc46818af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:12.880152 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-9c002cbd-5b79-4f86-90ec-17fc46818af7 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:12.881487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9c002cbd-5b79-4f86-90ec-17fc46818af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:12.930307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:12.978073 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 730/1467] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 19:56:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:13.264367 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0da78-047d-48a9-b03a-a717424e8a94 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:13.265913 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-18c0da78-047d-48a9-b03a-a717424e8a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:13.369573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0da78-047d-48a9-b03a-a717424e8a94 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:13.418176 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:13.443278 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed65df51-2aaa-4337-9e9a-5200fb21fa53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:13.443882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65df51-2aaa-4337-9e9a-5200fb21fa53 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:13.444160 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65df51-2aaa-4337-9e9a-5200fb21fa53 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:13.444429 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed65df51-2aaa-4337-9e9a-5200fb21fa53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:13.446051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ed65df51-2aaa-4337-9e9a-5200fb21fa53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:13.555378 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65df51-2aaa-4337-9e9a-5200fb21fa53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:13.556751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed65df51-2aaa-4337-9e9a-5200fb21fa53 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:13.574800 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 738/1468] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:22.976550 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=22 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:23.572613 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=66 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:33.416326 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86a0d5-748f-4d35-b966-334d4d9b7d05 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:33.416862 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86a0d5-748f-4d35-b966-334d4d9b7d05 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:33.416862 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86a0d5-748f-4d35-b966-334d4d9b7d05 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:33.418285 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 731/1469] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:56:33.423408 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bda17b-cfec-41f0-aab8-012aca56bf9d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:33.423821 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bda17b-cfec-41f0-aab8-012aca56bf9d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:33.423950 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bda17b-cfec-41f0-aab8-012aca56bf9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:33.488700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b8bda17b-cfec-41f0-aab8-012aca56bf9d None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:33.489927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b8bda17b-cfec-41f0-aab8-012aca56bf9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:33.584147 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 739/1470] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:56:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:33.878897 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f83f-421a-4093-8c7c-2752880c7235 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:33.879185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f83f-421a-4093-8c7c-2752880c7235 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:33.879465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b220f83f-421a-4093-8c7c-2752880c7235 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:33.880867 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 732/1471] 10.222.0.59 () {54 vars in 966 bytes} [Tue Sep 13 19:56:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:56:33.885956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08450ab3-af12-430c-9823-97b5ffb343de None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:33.886245 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08450ab3-af12-430c-9823-97b5ffb343de None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:33.886522 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08450ab3-af12-430c-9823-97b5ffb343de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:33.961161 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-08450ab3-af12-430c-9823-97b5ffb343de None None] MFA Rules not processed for user `44093d63c1aa45b781d2ce30239ed598`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:33.962375 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-08450ab3-af12-430c-9823-97b5ffb343de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:33.983229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:34.038646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 740/1472] 10.222.0.59 () {58 vars in 1063 bytes} [Tue Sep 13 19:56:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:34.046432 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220f83f-421a-4093-8c7c-2752880c7235 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:34.047994 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b220f83f-421a-4093-8c7c-2752880c7235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:34.150714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b220f83f-421a-4093-8c7c-2752880c7235 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:34.225236 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c98751-7e98-4068-9df8-1c45ea3ceb6e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44093d63c1aa45b781d2ce30239ed598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:34.225884 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c98751-7e98-4068-9df8-1c45ea3ceb6e service glance] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:34.226163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c98751-7e98-4068-9df8-1c45ea3ceb6e service glance] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:34.226438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c98751-7e98-4068-9df8-1c45ea3ceb6e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:34.228017 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-00c98751-7e98-4068-9df8-1c45ea3ceb6e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:34.281963 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:34.336495 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c98751-7e98-4068-9df8-1c45ea3ceb6e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:34.337969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c98751-7e98-4068-9df8-1c45ea3ceb6e service glance] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:34.356600 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 733/1473] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 19:56:36.572838 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d0515-f195-4724-aacf-2835222667d0 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:36.573479 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d0515-f195-4724-aacf-2835222667d0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:36.573479 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685d0515-f195-4724-aacf-2835222667d0 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:36.574803 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 741/1474] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:56:36.580292 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ccdf7-8c66-4ead-b51f-7e3b8e56614b None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:36.581281 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ccdf7-8c66-4ead-b51f-7e3b8e56614b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:36.581459 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ccdf7-8c66-4ead-b51f-7e3b8e56614b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:36.646526 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-cd2ccdf7-8c66-4ead-b51f-7e3b8e56614b None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:36.647721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-cd2ccdf7-8c66-4ead-b51f-7e3b8e56614b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:36.743450 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 734/1475] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:56:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:37.016911 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d0515-f195-4724-aacf-2835222667d0 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:37.018503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-685d0515-f195-4724-aacf-2835222667d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:37.140046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685d0515-f195-4724-aacf-2835222667d0 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:37.187672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:37.230580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98d3272-2227-41f0-b50e-0c5dbbd2d888 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:37.231177 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d3272-2227-41f0-b50e-0c5dbbd2d888 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:37.231455 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d3272-2227-41f0-b50e-0c5dbbd2d888 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:37.231723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98d3272-2227-41f0-b50e-0c5dbbd2d888 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:37.232356 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d3272-2227-41f0-b50e-0c5dbbd2d888 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:37.234651 dv-cinder-828807-6-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-a98d3272-2227-41f0-b50e-0c5dbbd2d888 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:56:37.234651 dv-cinder-828807-6-smb devstack@keystone.service[81554]: warnings.warn(msg) Sep 13 19:56:37.234651 dv-cinder-828807-6-smb devstack@keystone.service[81554]: Sep 13 19:56:37.236153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98d3272-2227-41f0-b50e-0c5dbbd2d888 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:37.255942 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 742/1476] 10.222.0.59 () {56 vars in 1108 bytes} [Tue Sep 13 19:56:37 2022] GET /identity/v3/projects => generated 2553 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:56:39.395005 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b57e41-906d-4d53-9693-647a916c39c0 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:39.395585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b57e41-906d-4d53-9693-647a916c39c0 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:39.395585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b57e41-906d-4d53-9693-647a916c39c0 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:39.396907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 735/1477] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:56:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:56:39.402352 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4e1e7-9999-4ddb-b684-286b4ff365c5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:39.402794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4e1e7-9999-4ddb-b684-286b4ff365c5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:39.402903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c4e1e7-9999-4ddb-b684-286b4ff365c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:39.467921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-64c4e1e7-9999-4ddb-b684-286b4ff365c5 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:39.473363 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-64c4e1e7-9999-4ddb-b684-286b4ff365c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:39.563505 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 743/1478] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:56:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:39.856898 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b57e41-906d-4d53-9693-647a916c39c0 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:39.858518 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-93b57e41-906d-4d53-9693-647a916c39c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:39.868626 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:40.010555 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b57e41-906d-4d53-9693-647a916c39c0 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:40.089375 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:40.121471 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc64dc6-e4aa-4e54-bf60-fc0f3c87f944 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:40.122109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc64dc6-e4aa-4e54-bf60-fc0f3c87f944 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:40.122384 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc64dc6-e4aa-4e54-bf60-fc0f3c87f944 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:40.122651 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc64dc6-e4aa-4e54-bf60-fc0f3c87f944 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:40.124212 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ebc64dc6-e4aa-4e54-bf60-fc0f3c87f944 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:40.214368 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc64dc6-e4aa-4e54-bf60-fc0f3c87f944 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:40.215961 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc64dc6-e4aa-4e54-bf60-fc0f3c87f944 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:40.234143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 736/1479] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:42.545916 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023ef00-c462-4cd6-a2ba-f04370d0aa48 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:42.546489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023ef00-c462-4cd6-a2ba-f04370d0aa48 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:42.546489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f023ef00-c462-4cd6-a2ba-f04370d0aa48 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:42.547834 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 744/1480] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:56:42.553137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d06741-8dd6-4adc-a33f-6da458f36136 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:42.554587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d06741-8dd6-4adc-a33f-6da458f36136 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:42.554587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d06741-8dd6-4adc-a33f-6da458f36136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:42.620497 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-86d06741-8dd6-4adc-a33f-6da458f36136 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:42.621744 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-86d06741-8dd6-4adc-a33f-6da458f36136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:42.667988 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:42.717357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 737/1481] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:56:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:43.007424 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023ef00-c462-4cd6-a2ba-f04370d0aa48 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:43.008967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f023ef00-c462-4cd6-a2ba-f04370d0aa48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:43.032767 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:43.119380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f023ef00-c462-4cd6-a2ba-f04370d0aa48 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:43.191274 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb8631-8aab-4b8d-a162-0045f472ab1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:43.191800 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb8631-8aab-4b8d-a162-0045f472ab1a service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:43.192073 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb8631-8aab-4b8d-a162-0045f472ab1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:43.192337 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb8631-8aab-4b8d-a162-0045f472ab1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:43.193914 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-eaeb8631-8aab-4b8d-a162-0045f472ab1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:43.266533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:43.301440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb8631-8aab-4b8d-a162-0045f472ab1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:43.302910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb8631-8aab-4b8d-a162-0045f472ab1a service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:43.321273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 745/1482] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:45.537758 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07940e01-429a-4ceb-b5d5-dea3b2adfab8 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:45.538329 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07940e01-429a-4ceb-b5d5-dea3b2adfab8 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:45.538329 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07940e01-429a-4ceb-b5d5-dea3b2adfab8 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:45.539702 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 738/1483] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:56:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:56:45.545045 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838756cc-3806-4aee-bac4-27ed67bd14e3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:45.548473 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838756cc-3806-4aee-bac4-27ed67bd14e3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:45.548473 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838756cc-3806-4aee-bac4-27ed67bd14e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:45.611166 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-838756cc-3806-4aee-bac4-27ed67bd14e3 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:45.613214 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-838756cc-3806-4aee-bac4-27ed67bd14e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:45.706757 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 746/1484] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:56:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:45.992031 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07940e01-429a-4ceb-b5d5-dea3b2adfab8 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:45.993562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-07940e01-429a-4ceb-b5d5-dea3b2adfab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:46.095596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07940e01-429a-4ceb-b5d5-dea3b2adfab8 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:46.168569 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:46.170141 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0109cb-c46e-4928-89ec-cc500bcee7f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:46.170729 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0109cb-c46e-4928-89ec-cc500bcee7f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:46.171006 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0109cb-c46e-4928-89ec-cc500bcee7f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:46.171276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0109cb-c46e-4928-89ec-cc500bcee7f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:46.172876 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-db0109cb-c46e-4928-89ec-cc500bcee7f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:46.282867 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0109cb-c46e-4928-89ec-cc500bcee7f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:46.284261 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0109cb-c46e-4928-89ec-cc500bcee7f1 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:46.302309 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 739/1485] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:48.529406 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08779484-f7a9-432f-abc8-ed6f78a73dd6 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:48.530006 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08779484-f7a9-432f-abc8-ed6f78a73dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:48.530006 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08779484-f7a9-432f-abc8-ed6f78a73dd6 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:48.531310 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 747/1486] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:56:48.537180 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aba25d-ecb9-41b8-8312-9608b6a58c19 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:48.537626 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aba25d-ecb9-41b8-8312-9608b6a58c19 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:48.537759 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3aba25d-ecb9-41b8-8312-9608b6a58c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:48.602569 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-f3aba25d-ecb9-41b8-8312-9608b6a58c19 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:48.603762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f3aba25d-ecb9-41b8-8312-9608b6a58c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:48.655796 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:48.698443 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 740/1487] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:56:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:48.984020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08779484-f7a9-432f-abc8-ed6f78a73dd6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:48.985574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-08779484-f7a9-432f-abc8-ed6f78a73dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:49.021271 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:49.086682 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08779484-f7a9-432f-abc8-ed6f78a73dd6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:49.160601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7d9bac-7df1-4ffc-8ccc-f6df1a0d3aa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:49.161196 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d9bac-7df1-4ffc-8ccc-f6df1a0d3aa1 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:49.161471 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d9bac-7df1-4ffc-8ccc-f6df1a0d3aa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:49.161761 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d9bac-7df1-4ffc-8ccc-f6df1a0d3aa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:49.163325 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ab7d9bac-7df1-4ffc-8ccc-f6df1a0d3aa1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:49.241965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:49.269940 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d9bac-7df1-4ffc-8ccc-f6df1a0d3aa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:49.271385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7d9bac-7df1-4ffc-8ccc-f6df1a0d3aa1 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:49.290099 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 748/1488] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:56:51.829037 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d4856-7b56-4688-98dc-aace42b85ce3 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:51.829447 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d4856-7b56-4688-98dc-aace42b85ce3 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:51.829640 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556d4856-7b56-4688-98dc-aace42b85ce3 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:51.831481 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 741/1489] 10.222.0.59 () {54 vars in 927 bytes} [Tue Sep 13 19:56:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:56:51.836740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51fd15-6b25-44ed-a865-8a958c2833d5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:51.837133 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51fd15-6b25-44ed-a865-8a958c2833d5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:51.837286 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51fd15-6b25-44ed-a865-8a958c2833d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:51.902792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9b51fd15-6b25-44ed-a865-8a958c2833d5 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:56:51.903989 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9b51fd15-6b25-44ed-a865-8a958c2833d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:51.998310 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 749/1490] 10.222.0.59 () {58 vars in 1024 bytes} [Tue Sep 13 19:56:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:56:52.291675 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d4856-7b56-4688-98dc-aace42b85ce3 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:56:52.293192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-556d4856-7b56-4688-98dc-aace42b85ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:52.394799 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556d4856-7b56-4688-98dc-aace42b85ce3 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:56:52.467566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a2c7de-0bcd-4ca8-b6e2-d37f29f05d6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:56:52.468168 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2c7de-0bcd-4ca8-b6e2-d37f29f05d6b service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:56:52.468446 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2c7de-0bcd-4ca8-b6e2-d37f29f05d6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:56:52.473770 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a2c7de-0bcd-4ca8-b6e2-d37f29f05d6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:56:52.473770 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d7a2c7de-0bcd-4ca8-b6e2-d37f29f05d6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:56:52.478866 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:56:52.578663 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2c7de-0bcd-4ca8-b6e2-d37f29f05d6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:56:52.580020 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a2c7de-0bcd-4ca8-b6e2-d37f29f05d6b service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:56:52.598125 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 742/1491] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:56:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:57:01.996698 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=82 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:57:02.595850 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=50 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:13.770700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7422b-a9d0-498e-9534-320f05acf683 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:13.771332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7422b-a9d0-498e-9534-320f05acf683 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:13.771332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b7422b-a9d0-498e-9534-320f05acf683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:13.846195 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-77b7422b-a9d0-498e-9534-320f05acf683 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:13.847398 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-77b7422b-a9d0-498e-9534-320f05acf683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:14.061442 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 750/1492] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 19:58:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:14.070355 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661a5bd-8bd7-4c89-b08c-d258d8e69d65 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:14.070831 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661a5bd-8bd7-4c89-b08c-d258d8e69d65 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:14.070935 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5661a5bd-8bd7-4c89-b08c-d258d8e69d65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:14.145445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-5661a5bd-8bd7-4c89-b08c-d258d8e69d65 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:14.146667 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5661a5bd-8bd7-4c89-b08c-d258d8e69d65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:14.244383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 743/1493] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 19:58:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:14.248961 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7422b-a9d0-498e-9534-320f05acf683 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:14.250147 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-77b7422b-a9d0-498e-9534-320f05acf683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:14.261665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b7422b-a9d0-498e-9534-320f05acf683 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:14.320804 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:14.352002 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a61ff8-18ef-4ccb-97f0-ca63ece2d685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:14.352592 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a61ff8-18ef-4ccb-97f0-ca63ece2d685 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:14.352866 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a61ff8-18ef-4ccb-97f0-ca63ece2d685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:14.353132 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a61ff8-18ef-4ccb-97f0-ca63ece2d685 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:14.353789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a61ff8-18ef-4ccb-97f0-ca63ece2d685 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 19:58:14.354087 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a61ff8-18ef-4ccb-97f0-ca63ece2d685 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:14.355084 dv-cinder-828807-6-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-54a61ff8-18ef-4ccb-97f0-ca63ece2d685 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:58:14.355084 dv-cinder-828807-6-smb devstack@keystone.service[81554]: warnings.warn(msg) Sep 13 19:58:14.355084 dv-cinder-828807-6-smb devstack@keystone.service[81554]: Sep 13 19:58:14.355951 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a61ff8-18ef-4ccb-97f0-ca63ece2d685 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:14.367780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 751/1494] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 19:58:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:58:14.375979 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661a5bd-8bd7-4c89-b08c-d258d8e69d65 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:14.385723 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5661a5bd-8bd7-4c89-b08c-d258d8e69d65 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:14.446004 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:14.478467 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71ec23-fa43-4577-997d-81332817ebdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:14.479313 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71ec23-fa43-4577-997d-81332817ebdd admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:14.479778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71ec23-fa43-4577-997d-81332817ebdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:14.480338 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a71ec23-fa43-4577-997d-81332817ebdd admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:14.480959 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71ec23-fa43-4577-997d-81332817ebdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:14.482702 dv-cinder-828807-6-smb devstack@keystone.service[81555]: WARNING py.warnings [None req-3a71ec23-fa43-4577-997d-81332817ebdd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:58:14.482702 dv-cinder-828807-6-smb devstack@keystone.service[81555]: warnings.warn(msg) Sep 13 19:58:14.482702 dv-cinder-828807-6-smb devstack@keystone.service[81555]: Sep 13 19:58:14.483886 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a71ec23-fa43-4577-997d-81332817ebdd admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:14.591983 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 744/1495] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 19:58:14 2022] POST /identity/v3/projects => generated 379 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:14.596093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a61ff8-18ef-4ccb-97f0-ca63ece2d685 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:14.598190 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-54a61ff8-18ef-4ccb-97f0-ca63ece2d685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:14.630762 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a61ff8-18ef-4ccb-97f0-ca63ece2d685 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:14.720219 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70291814-4016-4070-9107-239667ef22fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:14.720816 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70291814-4016-4070-9107-239667ef22fb admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:14.721101 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70291814-4016-4070-9107-239667ef22fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:14.721375 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70291814-4016-4070-9107-239667ef22fb admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:14.722050 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70291814-4016-4070-9107-239667ef22fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:14.723545 dv-cinder-828807-6-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-70291814-4016-4070-9107-239667ef22fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:58:14.723545 dv-cinder-828807-6-smb devstack@keystone.service[81554]: warnings.warn(msg) Sep 13 19:58:14.723545 dv-cinder-828807-6-smb devstack@keystone.service[81554]: Sep 13 19:58:14.724781 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70291814-4016-4070-9107-239667ef22fb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:14.851044 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 752/1496] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 19:58:14 2022] POST /identity/v3/users => generated 290 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 19:58:14.855057 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71ec23-fa43-4577-997d-81332817ebdd admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:14.856557 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3a71ec23-fa43-4577-997d-81332817ebdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:14.918040 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a71ec23-fa43-4577-997d-81332817ebdd admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:15.006274 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:15.016409 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fd25b-8aba-4427-89fa-e019e364fce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:15.017009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fd25b-8aba-4427-89fa-e019e364fce0 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:15.017284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fd25b-8aba-4427-89fa-e019e364fce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:15.021811 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fd25b-8aba-4427-89fa-e019e364fce0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:15.021811 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59fd25b-8aba-4427-89fa-e019e364fce0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:15.021811 dv-cinder-828807-6-smb devstack@keystone.service[81555]: WARNING py.warnings [None req-b59fd25b-8aba-4427-89fa-e019e364fce0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:58:15.021811 dv-cinder-828807-6-smb devstack@keystone.service[81555]: warnings.warn(msg) Sep 13 19:58:15.021811 dv-cinder-828807-6-smb devstack@keystone.service[81555]: Sep 13 19:58:15.021811 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59fd25b-8aba-4427-89fa-e019e364fce0 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:15.033565 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 745/1497] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:14 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 19:58:15.038298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70291814-4016-4070-9107-239667ef22fb admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:15.039800 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-70291814-4016-4070-9107-239667ef22fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:15.051179 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70291814-4016-4070-9107-239667ef22fb admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:15.075750 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:15.144771 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb39345-56f2-43ff-9a54-94de634122f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:15.145293 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb39345-56f2-43ff-9a54-94de634122f6 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:15.145564 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb39345-56f2-43ff-9a54-94de634122f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:15.145946 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb39345-56f2-43ff-9a54-94de634122f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:15.146586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb39345-56f2-43ff-9a54-94de634122f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:15.147592 dv-cinder-828807-6-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-afb39345-56f2-43ff-9a54-94de634122f6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:58:15.147592 dv-cinder-828807-6-smb devstack@keystone.service[81554]: warnings.warn(msg) Sep 13 19:58:15.147592 dv-cinder-828807-6-smb devstack@keystone.service[81554]: Sep 13 19:58:15.148496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb39345-56f2-43ff-9a54-94de634122f6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:15.160413 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 753/1498] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 19:58:15 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 19:58:15.164683 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fd25b-8aba-4427-89fa-e019e364fce0 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:15.166215 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b59fd25b-8aba-4427-89fa-e019e364fce0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:15.199812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fd25b-8aba-4427-89fa-e019e364fce0 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:15.292440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d63a6-351c-4510-8ba9-386ba44762cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:15.293088 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d63a6-351c-4510-8ba9-386ba44762cf admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:15.293362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d63a6-351c-4510-8ba9-386ba44762cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:15.293630 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d63a6-351c-4510-8ba9-386ba44762cf admin admin] PATH_INFO: `/v3/projects/254a7a5528c843fb8a7003e785dc36f8/users/65d88a5135014e46a03908630c5d3275/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:15.315845 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d63a6-351c-4510-8ba9-386ba44762cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=254a7a5528c843fb8a7003e785dc36f8, user_id=65d88a5135014e46a03908630c5d3275, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:15.317349 dv-cinder-828807-6-smb devstack@keystone.service[81555]: WARNING py.warnings [None req-f70d63a6-351c-4510-8ba9-386ba44762cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:58:15.317349 dv-cinder-828807-6-smb devstack@keystone.service[81555]: warnings.warn(msg) Sep 13 19:58:15.317349 dv-cinder-828807-6-smb devstack@keystone.service[81555]: Sep 13 19:58:15.319326 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d63a6-351c-4510-8ba9-386ba44762cf admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:15.405440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 746/1499] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 19:58:15 2022] PUT /identity/v3/projects/254a7a5528c843fb8a7003e785dc36f8/users/65d88a5135014e46a03908630c5d3275/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:15.417734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8a959-1e5f-44a0-bef4-b8eabeb3ec27 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:15.418048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8a959-1e5f-44a0-bef4-b8eabeb3ec27 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:15.418322 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8a959-1e5f-44a0-bef4-b8eabeb3ec27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:15.477305 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7eb8a959-1e5f-44a0-bef4-b8eabeb3ec27 None None] MFA Rules not processed for user `65d88a5135014e46a03908630c5d3275`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:15.478535 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7eb8a959-1e5f-44a0-bef4-b8eabeb3ec27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:15.555053 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 754/1500] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 19:58:15 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:15.574240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94943fb-00fe-48a6-8437-6c380b8c56ca None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:15.574553 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94943fb-00fe-48a6-8437-6c380b8c56ca None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:15.574831 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94943fb-00fe-48a6-8437-6c380b8c56ca None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:15.576163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 747/1501] 10.222.0.59 () {54 vars in 964 bytes} [Tue Sep 13 19:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:58:15.581011 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af1fab-2a2c-49b8-a6df-b076548b2633 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:15.581298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af1fab-2a2c-49b8-a6df-b076548b2633 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:15.581597 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af1fab-2a2c-49b8-a6df-b076548b2633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:15.613571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:15.656912 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e5af1fab-2a2c-49b8-a6df-b076548b2633 None None] MFA Rules not processed for user `fbdff73734304485ac9884d6b44ea73c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:15.658096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e5af1fab-2a2c-49b8-a6df-b076548b2633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:15.731656 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 755/1502] 10.222.0.59 () {58 vars in 1061 bytes} [Tue Sep 13 19:58:15 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:15.740190 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94943fb-00fe-48a6-8437-6c380b8c56ca None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:15.741770 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d94943fb-00fe-48a6-8437-6c380b8c56ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:15.790877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:15.846892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94943fb-00fe-48a6-8437-6c380b8c56ca None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:15.928446 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f2043-cddb-4872-8612-49ef524321e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:15.928983 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f2043-cddb-4872-8612-49ef524321e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:15.929265 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f2043-cddb-4872-8612-49ef524321e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:15.929539 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613f2043-cddb-4872-8612-49ef524321e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:15.931161 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-613f2043-cddb-4872-8612-49ef524321e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:16.028171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f2043-cddb-4872-8612-49ef524321e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:16.029592 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613f2043-cddb-4872-8612-49ef524321e2 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:16.032999 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:16.048035 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 748/1503] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:16.092835 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb7f1c-cbbb-436f-a856-c7e1f6e815e9 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:16.093283 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb7f1c-cbbb-436f-a856-c7e1f6e815e9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:16.093391 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbb7f1c-cbbb-436f-a856-c7e1f6e815e9 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:16.094689 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 756/1504] 10.222.0.59 () {52 vars in 830 bytes} [Tue Sep 13 19:58:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:58:16.098717 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f2043-cddb-4872-8612-49ef524321e2 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:16.099905 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-613f2043-cddb-4872-8612-49ef524321e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:16.199319 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613f2043-cddb-4872-8612-49ef524321e2 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:16.293280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309be88-e5b5-4683-9eea-2641c1891cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:16.293935 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309be88-e5b5-4683-9eea-2641c1891cc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:16.294220 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309be88-e5b5-4683-9eea-2641c1891cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:16.294494 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c309be88-e5b5-4683-9eea-2641c1891cc2 admin admin] PATH_INFO: `/v3/users/65d88a5135014e46a03908630c5d3275` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:16.307413 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309be88-e5b5-4683-9eea-2641c1891cc2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=65d88a5135014e46a03908630c5d3275)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:16.308433 dv-cinder-828807-6-smb devstack@keystone.service[81555]: WARNING py.warnings [None req-c309be88-e5b5-4683-9eea-2641c1891cc2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:58:16.308433 dv-cinder-828807-6-smb devstack@keystone.service[81555]: warnings.warn(msg) Sep 13 19:58:16.308433 dv-cinder-828807-6-smb devstack@keystone.service[81555]: Sep 13 19:58:16.309643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c309be88-e5b5-4683-9eea-2641c1891cc2 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:16.319355 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:16.475823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c309be88-e5b5-4683-9eea-2641c1891cc2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65d88a5135014e46a03908630c5d3275'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:16.533490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c309be88-e5b5-4683-9eea-2641c1891cc2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65d88a5135014e46a03908630c5d3275'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:16.560701 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c309be88-e5b5-4683-9eea-2641c1891cc2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65d88a5135014e46a03908630c5d3275'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:16.561156 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c309be88-e5b5-4683-9eea-2641c1891cc2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65d88a5135014e46a03908630c5d3275'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:16.574808 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c309be88-e5b5-4683-9eea-2641c1891cc2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65d88a5135014e46a03908630c5d3275'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:16.580783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 749/1505] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 19:58:16 2022] DELETE /identity/v3/users/65d88a5135014e46a03908630c5d3275 => generated 0 bytes in 483 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:16.585748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b662cd7-3f74-4556-a754-47335a708460 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:16.586064 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b662cd7-3f74-4556-a754-47335a708460 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:16.586339 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b662cd7-3f74-4556-a754-47335a708460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:16.643151 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8b662cd7-3f74-4556-a754-47335a708460 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:58:16.644948 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8b662cd7-3f74-4556-a754-47335a708460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:16.718613 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:16.730317 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 757/1506] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 19:58:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:58:16.739980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309be88-e5b5-4683-9eea-2641c1891cc2 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:16.741180 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c309be88-e5b5-4683-9eea-2641c1891cc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:16.840478 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c309be88-e5b5-4683-9eea-2641c1891cc2 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:16.895550 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:16.914749 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c4080-fceb-4983-8745-b8c250ac5caf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:16.915372 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c4080-fceb-4983-8745-b8c250ac5caf service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:16.915653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c4080-fceb-4983-8745-b8c250ac5caf service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:16.915927 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c4080-fceb-4983-8745-b8c250ac5caf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:16.917540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0d6c4080-fceb-4983-8745-b8c250ac5caf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:17.026855 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c4080-fceb-4983-8745-b8c250ac5caf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:17.028261 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c4080-fceb-4983-8745-b8c250ac5caf service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:17.046507 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 750/1507] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:58:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:58:17.877299 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b662cd7-3f74-4556-a754-47335a708460 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:58:17.879253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8b662cd7-3f74-4556-a754-47335a708460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:58:17.892345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b662cd7-3f74-4556-a754-47335a708460 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:58:17.990381 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebf2b88-201b-4f4a-b49a-f0017f41931c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:58:17.991037 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf2b88-201b-4f4a-b49a-f0017f41931c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:58:17.991339 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf2b88-201b-4f4a-b49a-f0017f41931c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:58:17.991607 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebf2b88-201b-4f4a-b49a-f0017f41931c admin admin] PATH_INFO: `/v3/projects/254a7a5528c843fb8a7003e785dc36f8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:58:18.001414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf2b88-201b-4f4a-b49a-f0017f41931c admin admin] RBAC: Authorizing `identity:delete_project(project_id=254a7a5528c843fb8a7003e785dc36f8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:58:18.002488 dv-cinder-828807-6-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-6ebf2b88-201b-4f4a-b49a-f0017f41931c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 19:58:18.002488 dv-cinder-828807-6-smb devstack@keystone.service[81554]: warnings.warn(msg) Sep 13 19:58:18.002488 dv-cinder-828807-6-smb devstack@keystone.service[81554]: Sep 13 19:58:18.004352 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebf2b88-201b-4f4a-b49a-f0017f41931c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:58:18.111821 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6ebf2b88-201b-4f4a-b49a-f0017f41931c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '254a7a5528c843fb8a7003e785dc36f8', 'request_id': 'req-6ebf2b88-201b-4f4a-b49a-f0017f41931c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:18.173076 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6ebf2b88-201b-4f4a-b49a-f0017f41931c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '254a7a5528c843fb8a7003e785dc36f8', 'request_id': 'req-6ebf2b88-201b-4f4a-b49a-f0017f41931c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:18.179870 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6ebf2b88-201b-4f4a-b49a-f0017f41931c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '254a7a5528c843fb8a7003e785dc36f8', 'request_id': 'req-6ebf2b88-201b-4f4a-b49a-f0017f41931c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:18.208813 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6ebf2b88-201b-4f4a-b49a-f0017f41931c admin admin] The token cache is being invalidate because project 254a7a5528c843fb8a7003e785dc36f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 19:58:18.209097 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6ebf2b88-201b-4f4a-b49a-f0017f41931c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:18.209517 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6ebf2b88-201b-4f4a-b49a-f0017f41931c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 19:58:18.210964 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 758/1508] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 19:58:17 2022] DELETE /identity/v3/projects/254a7a5528c843fb8a7003e785dc36f8 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 19:58:27.044273 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=62 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:58:28.207526 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:53.400488 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c71fc-3cb6-4022-b7ac-4e0aefb37e2b None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:53.401104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c71fc-3cb6-4022-b7ac-4e0aefb37e2b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:53.401104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8c71fc-3cb6-4022-b7ac-4e0aefb37e2b None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:53.402427 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 751/1509] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:59:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:59:53.407247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c943d-0b9b-4aaf-b124-619488e56196 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:53.407663 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c943d-0b9b-4aaf-b124-619488e56196 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:53.407786 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c943d-0b9b-4aaf-b124-619488e56196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:53.490266 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-df1c943d-0b9b-4aaf-b124-619488e56196 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:53.491457 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-df1c943d-0b9b-4aaf-b124-619488e56196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:53.593473 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 759/1510] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:53.746562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c71fc-3cb6-4022-b7ac-4e0aefb37e2b None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:53.748639 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ce8c71fc-3cb6-4022-b7ac-4e0aefb37e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:53.869402 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8c71fc-3cb6-4022-b7ac-4e0aefb37e2b None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:53.875054 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc309c0-aa54-4dbf-b982-a59ee9a52ebc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:53.875763 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc309c0-aa54-4dbf-b982-a59ee9a52ebc service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:53.875969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc309c0-aa54-4dbf-b982-a59ee9a52ebc service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:53.876242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc309c0-aa54-4dbf-b982-a59ee9a52ebc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:53.885222 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc309c0-aa54-4dbf-b982-a59ee9a52ebc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:53.886825 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc309c0-aa54-4dbf-b982-a59ee9a52ebc service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:53.896881 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 752/1511] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:54.979044 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d095638-d395-4803-b072-c5cca08572fd None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:54.979578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d095638-d395-4803-b072-c5cca08572fd None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:54.979578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d095638-d395-4803-b072-c5cca08572fd None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:54.980914 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 760/1512] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 19:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:59:54.987179 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55f8ba-fc1b-43e9-811c-b768b8904174 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:54.987627 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55f8ba-fc1b-43e9-811c-b768b8904174 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:54.987729 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55f8ba-fc1b-43e9-811c-b768b8904174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:55.008385 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-9d55f8ba-fc1b-43e9-811c-b768b8904174 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:55.009595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9d55f8ba-fc1b-43e9-811c-b768b8904174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:55.017465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 753/1513] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 19:59:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:55.168981 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d095638-d395-4803-b072-c5cca08572fd None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:55.183633 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d095638-d395-4803-b072-c5cca08572fd None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:55.189046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5602e767-04de-43af-8fd9-23846f1e2b1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:55.189636 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602e767-04de-43af-8fd9-23846f1e2b1c service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:55.189935 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602e767-04de-43af-8fd9-23846f1e2b1c service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:55.190734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5602e767-04de-43af-8fd9-23846f1e2b1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:55.199469 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602e767-04de-43af-8fd9-23846f1e2b1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:55.201116 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5602e767-04de-43af-8fd9-23846f1e2b1c service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:55.211538 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 761/1514] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 19:59:55.627486 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f46b50-11c9-4b8f-bb55-07e7d31cf57f None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:55.628448 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f46b50-11c9-4b8f-bb55-07e7d31cf57f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:55.628731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f46b50-11c9-4b8f-bb55-07e7d31cf57f None None] PATH_INFO: `/v3` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:55.630086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 754/1515] 10.222.0.62 () {54 vars in 925 bytes} [Tue Sep 13 19:59:55 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 19:59:55.636088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6438873-19c3-4e4f-9e01-ce21a423c457 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:55.636373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6438873-19c3-4e4f-9e01-ce21a423c457 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:55.636650 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6438873-19c3-4e4f-9e01-ce21a423c457 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:55.695071 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b6438873-19c3-4e4f-9e01-ce21a423c457 None None] MFA Rules not processed for user `89e7df5170c841abb449f3b4a547ec4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:55.696192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b6438873-19c3-4e4f-9e01-ce21a423c457 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:55.712537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 19:59:55.769394 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 762/1516] 10.222.0.62 () {58 vars in 1015 bytes} [Tue Sep 13 19:59:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:59.647930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434dc79-558e-4d12-bec8-8b8abdd1bdbf None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:59.648380 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434dc79-558e-4d12-bec8-8b8abdd1bdbf None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:59.648490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a434dc79-558e-4d12-bec8-8b8abdd1bdbf None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:59.649865 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 755/1517] 10.222.0.59 () {54 vars in 961 bytes} [Tue Sep 13 19:59:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 19:59:59.654783 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75d921-740a-4152-9780-705ed169bc7b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:59.655249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75d921-740a-4152-9780-705ed169bc7b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:59.655357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed75d921-740a-4152-9780-705ed169bc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:59.674731 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ed75d921-740a-4152-9780-705ed169bc7b None None] MFA Rules not processed for user `89e7df5170c841abb449f3b4a547ec4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 19:59:59.675903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ed75d921-740a-4152-9780-705ed169bc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 19:59:59.684558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 763/1518] 10.222.0.59 () {58 vars in 1058 bytes} [Tue Sep 13 19:59:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 19:59:59.692794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434dc79-558e-4d12-bec8-8b8abdd1bdbf None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 19:59:59.705840 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a434dc79-558e-4d12-bec8-8b8abdd1bdbf None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 19:59:59.710733 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c856d7-1eb6-47aa-8618-1841c2fedbbc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e7df5170c841abb449f3b4a547ec4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 19:59:59.711351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c856d7-1eb6-47aa-8618-1841c2fedbbc service placement] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 19:59:59.711622 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c856d7-1eb6-47aa-8618-1841c2fedbbc service placement] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 19:59:59.711897 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c856d7-1eb6-47aa-8618-1841c2fedbbc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 19:59:59.719942 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c856d7-1eb6-47aa-8618-1841c2fedbbc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 19:59:59.721971 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c856d7-1eb6-47aa-8618-1841c2fedbbc service placement] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 19:59:59.731347 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 756/1519] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 19:59:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:06.672996 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dc589-c9fd-4166-94ba-164b8b7c9d38 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:06.673545 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dc589-c9fd-4166-94ba-164b8b7c9d38 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:06.673545 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6dc589-c9fd-4166-94ba-164b8b7c9d38 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:06.674980 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 764/1520] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 20:00:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:00:06.681010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb762c-3efc-495a-b506-511b8f1f40ad None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:06.681457 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb762c-3efc-495a-b506-511b8f1f40ad None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:06.681570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fb762c-3efc-495a-b506-511b8f1f40ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:06.700847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-d7fb762c-3efc-495a-b506-511b8f1f40ad None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:06.702059 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d7fb762c-3efc-495a-b506-511b8f1f40ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:06.710278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 757/1521] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 20:00:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:06.862499 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6dc589-c9fd-4166-94ba-164b8b7c9d38 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:06.876652 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6dc589-c9fd-4166-94ba-164b8b7c9d38 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:06.882709 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494f3e33-75d5-4622-a971-4c974fba24a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:06.883305 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f3e33-75d5-4622-a971-4c974fba24a1 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:06.883584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f3e33-75d5-4622-a971-4c974fba24a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:06.883858 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494f3e33-75d5-4622-a971-4c974fba24a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:06.891974 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f3e33-75d5-4622-a971-4c974fba24a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:06.894173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494f3e33-75d5-4622-a971-4c974fba24a1 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:06.903138 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 765/1522] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:07.959969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54c966-1745-4772-9007-5b4bddf3308c None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:07.960408 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54c966-1745-4772-9007-5b4bddf3308c None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:07.960605 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a54c966-1745-4772-9007-5b4bddf3308c None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:07.961913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 758/1523] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 13 20:00:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:00:07.968098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fe467-a4be-4a5b-9674-ac45ab2ecaf9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:07.968543 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fe467-a4be-4a5b-9674-ac45ab2ecaf9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:07.968675 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7fe467-a4be-4a5b-9674-ac45ab2ecaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:07.988020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1d7fe467-a4be-4a5b-9674-ac45ab2ecaf9 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:07.989226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1d7fe467-a4be-4a5b-9674-ac45ab2ecaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:07.996839 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 766/1524] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 13 20:00:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:08.148624 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54c966-1745-4772-9007-5b4bddf3308c None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:08.162831 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a54c966-1745-4772-9007-5b4bddf3308c None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:08.168071 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26763f90-85c7-493c-ac2c-9cd323d116c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:08.168659 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26763f90-85c7-493c-ac2c-9cd323d116c0 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:08.168934 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26763f90-85c7-493c-ac2c-9cd323d116c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:08.169200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26763f90-85c7-493c-ac2c-9cd323d116c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:08.178058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26763f90-85c7-493c-ac2c-9cd323d116c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:08.179638 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26763f90-85c7-493c-ac2c-9cd323d116c0 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:08.188730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 759/1525] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:12.223218 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ead9bb-2589-4b2d-b383-57efa16e8b08 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.223808 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ead9bb-2589-4b2d-b383-57efa16e8b08 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.223808 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ead9bb-2589-4b2d-b383-57efa16e8b08 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.225053 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 767/1526] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 20:00:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:00:12.230269 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13d0f6-c76e-4191-b5d5-075acad50622 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.230706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13d0f6-c76e-4191-b5d5-075acad50622 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.230817 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13d0f6-c76e-4191-b5d5-075acad50622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.250169 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-ae13d0f6-c76e-4191-b5d5-075acad50622 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:12.251369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ae13d0f6-c76e-4191-b5d5-075acad50622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:12.259245 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 760/1527] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 20:00:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:12.546511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ead9bb-2589-4b2d-b383-57efa16e8b08 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:12.548203 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-18ead9bb-2589-4b2d-b383-57efa16e8b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:12.625316 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ead9bb-2589-4b2d-b383-57efa16e8b08 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:12.629387 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715d06d-7292-467f-8f37-207d09438a95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:12.630010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715d06d-7292-467f-8f37-207d09438a95 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:12.630293 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715d06d-7292-467f-8f37-207d09438a95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:12.630566 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715d06d-7292-467f-8f37-207d09438a95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:12.639277 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715d06d-7292-467f-8f37-207d09438a95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:12.640697 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715d06d-7292-467f-8f37-207d09438a95 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:12.650463 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 768/1528] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:14.783814 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da44ac-3121-448d-91de-e3d9a6950bd7 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:14.784413 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da44ac-3121-448d-91de-e3d9a6950bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:14.784413 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52da44ac-3121-448d-91de-e3d9a6950bd7 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:14.785720 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 761/1529] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 20:00:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:00:14.791085 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64f2bb-de34-4f58-aca6-d587d16d928b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:14.791545 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64f2bb-de34-4f58-aca6-d587d16d928b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:14.791651 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64f2bb-de34-4f58-aca6-d587d16d928b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:14.810739 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8e64f2bb-de34-4f58-aca6-d587d16d928b None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:14.811913 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8e64f2bb-de34-4f58-aca6-d587d16d928b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:14.820006 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 769/1530] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 20:00:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:15.114664 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13c46d-0969-4964-bc58-9314b4c99cb2 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.114948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13c46d-0969-4964-bc58-9314b4c99cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.115220 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd13c46d-0969-4964-bc58-9314b4c99cb2 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.116616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 762/1531] 10.222.0.59 () {54 vars in 965 bytes} [Tue Sep 13 20:00:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:00:15.122127 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56d029-c6b6-49bd-b3e9-25e9e54d72ca None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.122413 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56d029-c6b6-49bd-b3e9-25e9e54d72ca None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.122686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b56d029-c6b6-49bd-b3e9-25e9e54d72ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.159276 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5b56d029-c6b6-49bd-b3e9-25e9e54d72ca None None] MFA Rules not processed for user `b86b85c457d84ac99359ac93add704d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:15.160468 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5b56d029-c6b6-49bd-b3e9-25e9e54d72ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:15.166874 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 770/1532] 10.222.0.59 () {58 vars in 1062 bytes} [Tue Sep 13 20:00:15 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:15.175494 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13c46d-0969-4964-bc58-9314b4c99cb2 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:15.186134 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd13c46d-0969-4964-bc58-9314b4c99cb2 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:15.190221 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7779a342-5fd9-4111-a96a-31c00a8c9715 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:15.190809 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779a342-5fd9-4111-a96a-31c00a8c9715 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:15.191089 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779a342-5fd9-4111-a96a-31c00a8c9715 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:15.191363 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7779a342-5fd9-4111-a96a-31c00a8c9715 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:15.200110 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779a342-5fd9-4111-a96a-31c00a8c9715 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:15.201520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7779a342-5fd9-4111-a96a-31c00a8c9715 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:15.210766 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 763/1533] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:18.812056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792081b-3546-467e-a1f0-3eab4d1136fe None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:18.812611 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792081b-3546-467e-a1f0-3eab4d1136fe None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:18.812611 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2792081b-3546-467e-a1f0-3eab4d1136fe None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:18.814522 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 771/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 20:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:00:18.819784 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e5127-b232-4c03-806a-842afb9baac6 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:18.820227 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e5127-b232-4c03-806a-842afb9baac6 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:18.820333 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854e5127-b232-4c03-806a-842afb9baac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:18.827929 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=81 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:18.840426 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-854e5127-b232-4c03-806a-842afb9baac6 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:18.841645 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-854e5127-b232-4c03-806a-842afb9baac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:18.849477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 764/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 20:00:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:00:19.150326 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792081b-3546-467e-a1f0-3eab4d1136fe None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:19.151971 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2792081b-3546-467e-a1f0-3eab4d1136fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:19.196091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:19.229463 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2792081b-3546-467e-a1f0-3eab4d1136fe None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:19.233829 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b673b0d4-8f5f-4326-bc06-63b14a04d399 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:19.234433 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673b0d4-8f5f-4326-bc06-63b14a04d399 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:19.234714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673b0d4-8f5f-4326-bc06-63b14a04d399 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:19.234983 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b673b0d4-8f5f-4326-bc06-63b14a04d399 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:19.244460 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673b0d4-8f5f-4326-bc06-63b14a04d399 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:19.245923 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b673b0d4-8f5f-4326-bc06-63b14a04d399 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:19.255099 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 772/1536] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:21.353994 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154eeb52-a77d-463e-a715-a53df24b0cf3 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:21.354550 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154eeb52-a77d-463e-a715-a53df24b0cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:21.354550 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154eeb52-a77d-463e-a715-a53df24b0cf3 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:21.355873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 765/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 13 20:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:00:21.361518 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636682ad-62d1-442a-8f79-52a3ded10492 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:21.361991 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636682ad-62d1-442a-8f79-52a3ded10492 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:21.362113 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636682ad-62d1-442a-8f79-52a3ded10492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:21.381101 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-636682ad-62d1-442a-8f79-52a3ded10492 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:00:21.382319 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-636682ad-62d1-442a-8f79-52a3ded10492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:21.390031 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 773/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 13 20:00:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:00:21.689629 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154eeb52-a77d-463e-a715-a53df24b0cf3 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:00:21.691386 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-154eeb52-a77d-463e-a715-a53df24b0cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:00:21.704108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154eeb52-a77d-463e-a715-a53df24b0cf3 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:00:21.708188 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2862cdb9-63cf-4d4a-98d4-ffb61ae4cd56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:00:21.708780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862cdb9-63cf-4d4a-98d4-ffb61ae4cd56 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:00:21.709060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862cdb9-63cf-4d4a-98d4-ffb61ae4cd56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:00:21.709331 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862cdb9-63cf-4d4a-98d4-ffb61ae4cd56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:00:21.718000 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862cdb9-63cf-4d4a-98d4-ffb61ae4cd56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:00:21.719408 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2862cdb9-63cf-4d4a-98d4-ffb61ae4cd56 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:00:21.728653 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 766/1539] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:00:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:00:31.375810 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=20 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:00:31.724614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=8 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:56.511694 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594f9d4-dfd4-452d-a7dc-f6f4c3d0b6be None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:56.512389 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594f9d4-dfd4-452d-a7dc-f6f4c3d0b6be None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:56.512389 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594f9d4-dfd4-452d-a7dc-f6f4c3d0b6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:56.533917 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2594f9d4-dfd4-452d-a7dc-f6f4c3d0b6be None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:56.535153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2594f9d4-dfd4-452d-a7dc-f6f4c3d0b6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:56.550685 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 774/1540] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:01:56.560118 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b13a72-6249-4d97-b440-c59935febf21 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:56.560705 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b13a72-6249-4d97-b440-c59935febf21 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:56.560705 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b13a72-6249-4d97-b440-c59935febf21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:56.564903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916de87-7df7-461b-a07c-cbb9681a33ce None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:56.565452 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916de87-7df7-461b-a07c-cbb9681a33ce None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:56.565968 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916de87-7df7-461b-a07c-cbb9681a33ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:56.616418 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0916de87-7df7-461b-a07c-cbb9681a33ce None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:56.618158 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0916de87-7df7-461b-a07c-cbb9681a33ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:56.634337 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-f4b13a72-6249-4d97-b440-c59935febf21 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:56.636162 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f4b13a72-6249-4d97-b440-c59935febf21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:56.639695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 775/1541] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:01:56.651273 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 767/1542] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:01:56.657075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916de87-7df7-461b-a07c-cbb9681a33ce None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:56.657584 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd0e51-8217-4965-b505-b6fa38287ad6 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:56.658506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd0e51-8217-4965-b505-b6fa38287ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:56.658791 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd0e51-8217-4965-b505-b6fa38287ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:56.672532 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916de87-7df7-461b-a07c-cbb9681a33ce None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:56.687959 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e842ef7-7141-4295-93fe-d2c896192c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:56.688975 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e842ef7-7141-4295-93fe-d2c896192c92 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:56.689470 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e842ef7-7141-4295-93fe-d2c896192c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:56.689998 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e842ef7-7141-4295-93fe-d2c896192c92 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:56.690930 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e842ef7-7141-4295-93fe-d2c896192c92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:56.691528 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e842ef7-7141-4295-93fe-d2c896192c92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:56.693490 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e842ef7-7141-4295-93fe-d2c896192c92 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:56.698886 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-8fdd0e51-8217-4965-b505-b6fa38287ad6 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:56.700117 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8fdd0e51-8217-4965-b505-b6fa38287ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:56.717055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 776/1543] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:56.721505 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 768/1544] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:01:56.725941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e842ef7-7141-4295-93fe-d2c896192c92 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:56.726301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd0e51-8217-4965-b505-b6fa38287ad6 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:56.736854 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd0e51-8217-4965-b505-b6fa38287ad6 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:56.740716 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e842ef7-7141-4295-93fe-d2c896192c92 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:56.753470 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71112f8-40f0-4266-ac69-cebc135fb380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:56.754129 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71112f8-40f0-4266-ac69-cebc135fb380 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:56.754406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71112f8-40f0-4266-ac69-cebc135fb380 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:56.754677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71112f8-40f0-4266-ac69-cebc135fb380 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:56.756611 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71112f8-40f0-4266-ac69-cebc135fb380 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:56.757412 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449b0b76-bb55-47ac-8575-b7b0f2da9b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:56.758091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b0b76-bb55-47ac-8575-b7b0f2da9b84 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:56.758366 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b0b76-bb55-47ac-8575-b7b0f2da9b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:56.758633 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449b0b76-bb55-47ac-8575-b7b0f2da9b84 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:56.759265 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b0b76-bb55-47ac-8575-b7b0f2da9b84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:56.760283 dv-cinder-828807-6-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-449b0b76-bb55-47ac-8575-b7b0f2da9b84 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 20:01:56.760283 dv-cinder-828807-6-smb devstack@keystone.service[81554]: warnings.warn(msg) Sep 13 20:01:56.760283 dv-cinder-828807-6-smb devstack@keystone.service[81554]: Sep 13 20:01:56.761635 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71112f8-40f0-4266-ac69-cebc135fb380 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:56.763013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: WARNING py.warnings [None req-d71112f8-40f0-4266-ac69-cebc135fb380 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 13 20:01:56.763013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: warnings.warn(msg) Sep 13 20:01:56.763013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: Sep 13 20:01:56.763899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71112f8-40f0-4266-ac69-cebc135fb380 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:56.766409 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449b0b76-bb55-47ac-8575-b7b0f2da9b84 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:56.793841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 769/1545] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:56.795127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8f295-900f-4880-abb8-ef43ba996dd7 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:56.795408 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8f295-900f-4880-abb8-ef43ba996dd7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:56.795682 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8f295-900f-4880-abb8-ef43ba996dd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:56.824849 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-73e8f295-900f-4880-abb8-ef43ba996dd7 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:56.826082 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-73e8f295-900f-4880-abb8-ef43ba996dd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:56.835569 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 770/1546] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:56.836780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89553c1-5dae-4c0e-9ee8-e7329ca9457e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:56.837066 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89553c1-5dae-4c0e-9ee8-e7329ca9457e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:56.837338 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89553c1-5dae-4c0e-9ee8-e7329ca9457e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:56.864360 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-a89553c1-5dae-4c0e-9ee8-e7329ca9457e None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:56.865551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a89553c1-5dae-4c0e-9ee8-e7329ca9457e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:56.881895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 771/1547] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:56.881895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f5b45-1ee1-4b97-85f4-e52b7519ca44 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:56.881895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f5b45-1ee1-4b97-85f4-e52b7519ca44 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:56.881895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f5b45-1ee1-4b97-85f4-e52b7519ca44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:56.913371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 777/1548] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:56 2022] POST /identity/v3/projects => generated 387 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:56.916998 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-f16f5b45-1ee1-4b97-85f4-e52b7519ca44 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:56.916998 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f16f5b45-1ee1-4b97-85f4-e52b7519ca44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:56.918870 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65823a5e-eb53-4d72-a229-994aec0ffd02 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:56.919954 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65823a5e-eb53-4d72-a229-994aec0ffd02 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:56.920410 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65823a5e-eb53-4d72-a229-994aec0ffd02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:56.944152 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-65823a5e-eb53-4d72-a229-994aec0ffd02 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:56.945906 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-65823a5e-eb53-4d72-a229-994aec0ffd02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:56.981000 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 772/1549] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:56.981928 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f5b45-1ee1-4b97-85f4-e52b7519ca44 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:56.991170 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f5b45-1ee1-4b97-85f4-e52b7519ca44 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:56.995798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02f25a-33d2-4b5f-b6db-aba3aebe6e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:56.996389 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02f25a-33d2-4b5f-b6db-aba3aebe6e7e admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:56.996672 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02f25a-33d2-4b5f-b6db-aba3aebe6e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:56.996955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b02f25a-33d2-4b5f-b6db-aba3aebe6e7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:56.997589 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02f25a-33d2-4b5f-b6db-aba3aebe6e7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:57.000103 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b02f25a-33d2-4b5f-b6db-aba3aebe6e7e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:57.014076 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 778/1550] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:57.016212 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127ea35-da0c-4fef-9ab7-3b69ffa7eb10 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:57.016618 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127ea35-da0c-4fef-9ab7-3b69ffa7eb10 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:57.016905 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0127ea35-da0c-4fef-9ab7-3b69ffa7eb10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:57.036536 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0127ea35-da0c-4fef-9ab7-3b69ffa7eb10 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:57.037915 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0127ea35-da0c-4fef-9ab7-3b69ffa7eb10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:57.045735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 779/1551] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:57.047435 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1f671-cb1b-48a0-bf9c-32704be8fb43 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:57.047717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1f671-cb1b-48a0-bf9c-32704be8fb43 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:57.047987 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1f671-cb1b-48a0-bf9c-32704be8fb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:57.067395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7cd1f671-cb1b-48a0-bf9c-32704be8fb43 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:57.068551 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7cd1f671-cb1b-48a0-bf9c-32704be8fb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:57.076332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 780/1552] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:57.077450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8903b-f00f-4054-95ec-dfcf83c5a627 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:57.077757 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8903b-f00f-4054-95ec-dfcf83c5a627 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:57.078033 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c8903b-f00f-4054-95ec-dfcf83c5a627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:57.091453 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 773/1553] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:56 2022] POST /identity/v3/projects => generated 367 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:57.092335 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02f25a-33d2-4b5f-b6db-aba3aebe6e7e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:57.099108 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-33c8903b-f00f-4054-95ec-dfcf83c5a627 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:57.100291 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-33c8903b-f00f-4054-95ec-dfcf83c5a627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:57.156449 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b02f25a-33d2-4b5f-b6db-aba3aebe6e7e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:57.161104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6748176b-6f87-486d-b3d4-c5a52bb1f6bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:57.161806 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748176b-6f87-486d-b3d4-c5a52bb1f6bf admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:57.162097 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748176b-6f87-486d-b3d4-c5a52bb1f6bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:57.162311 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 781/1554] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:57.162417 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6748176b-6f87-486d-b3d4-c5a52bb1f6bf admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:57.163019 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748176b-6f87-486d-b3d4-c5a52bb1f6bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:57.163687 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce19d4-1b6e-491d-b484-27c440278c14 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:57.163972 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce19d4-1b6e-491d-b484-27c440278c14 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:57.164070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: WARNING py.warnings [None req-6748176b-6f87-486d-b3d4-c5a52bb1f6bf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 20:01:57.164070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: warnings.warn(msg) Sep 13 20:01:57.164070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: Sep 13 20:01:57.164445 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ce19d4-1b6e-491d-b484-27c440278c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:57.165207 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6748176b-6f87-486d-b3d4-c5a52bb1f6bf admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:57.184006 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-63ce19d4-1b6e-491d-b484-27c440278c14 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:57.185251 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-63ce19d4-1b6e-491d-b484-27c440278c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:57.193224 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 782/1555] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:57.195122 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88789737-0666-4167-9ed1-3363bf777ba5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:57.195122 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88789737-0666-4167-9ed1-3363bf777ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:57.195122 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88789737-0666-4167-9ed1-3363bf777ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:57.214560 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-88789737-0666-4167-9ed1-3363bf777ba5 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:57.215848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-88789737-0666-4167-9ed1-3363bf777ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:57.225249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 783/1556] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:57.226594 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d3edd-48bc-41b3-9c37-9abe330e1dcd None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:57.226984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d3edd-48bc-41b3-9c37-9abe330e1dcd None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:57.227476 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d3edd-48bc-41b3-9c37-9abe330e1dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:57.246707 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-178d3edd-48bc-41b3-9c37-9abe330e1dcd None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:57.247884 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-178d3edd-48bc-41b3-9c37-9abe330e1dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:57.255945 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 784/1557] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:57.256854 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d3edd-48bc-41b3-9c37-9abe330e1dcd None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:57.266743 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d3edd-48bc-41b3-9c37-9abe330e1dcd None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:57.271244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec2faa-65b6-41bf-aef0-6e2749ec81a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:57.271819 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec2faa-65b6-41bf-aef0-6e2749ec81a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:57.272093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec2faa-65b6-41bf-aef0-6e2749ec81a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:57.272361 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ec2faa-65b6-41bf-aef0-6e2749ec81a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:57.272990 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec2faa-65b6-41bf-aef0-6e2749ec81a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:57.273288 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec2faa-65b6-41bf-aef0-6e2749ec81a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:57.273429 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 774/1558] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:57 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:57.274803 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887aa7d-7c7a-4067-9e40-4758a0678bae None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:57.274975 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ec2faa-65b6-41bf-aef0-6e2749ec81a8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:57.275200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887aa7d-7c7a-4067-9e40-4758a0678bae None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:57.275562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887aa7d-7c7a-4067-9e40-4758a0678bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:57.282903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:57.295334 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 785/1559] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:57.295334 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec2faa-65b6-41bf-aef0-6e2749ec81a8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:57.297259 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-a887aa7d-7c7a-4067-9e40-4758a0678bae None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:57.298502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a887aa7d-7c7a-4067-9e40-4758a0678bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:57.300102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ec2faa-65b6-41bf-aef0-6e2749ec81a8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:57.304661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5323f4-fa56-40cf-93f7-801bb62fce8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:57.305242 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5323f4-fa56-40cf-93f7-801bb62fce8d admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:57.305518 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5323f4-fa56-40cf-93f7-801bb62fce8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:57.305818 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5323f4-fa56-40cf-93f7-801bb62fce8d admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:57.306559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5323f4-fa56-40cf-93f7-801bb62fce8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:57.306935 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 775/1560] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:57.307771 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887aa7d-7c7a-4067-9e40-4758a0678bae None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:57.308568 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5323f4-fa56-40cf-93f7-801bb62fce8d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:57.317810 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887aa7d-7c7a-4067-9e40-4758a0678bae None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:57.322824 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a41c1-6d6b-4dc6-9d5a-3c2f64ba3478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:57.331344 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a41c1-6d6b-4dc6-9d5a-3c2f64ba3478 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:57.331344 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a41c1-6d6b-4dc6-9d5a-3c2f64ba3478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:57.331344 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a41c1-6d6b-4dc6-9d5a-3c2f64ba3478 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:57.331344 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a41c1-6d6b-4dc6-9d5a-3c2f64ba3478 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:57.331344 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a41c1-6d6b-4dc6-9d5a-3c2f64ba3478 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:57.331344 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a41c1-6d6b-4dc6-9d5a-3c2f64ba3478 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:57.338465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 776/1561] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:57.339747 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df767c8e-21c7-47ce-b6f1-a677ba7eaba6 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:57.340033 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df767c8e-21c7-47ce-b6f1-a677ba7eaba6 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:57.340299 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df767c8e-21c7-47ce-b6f1-a677ba7eaba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:57.360099 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-df767c8e-21c7-47ce-b6f1-a677ba7eaba6 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:57.361280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-df767c8e-21c7-47ce-b6f1-a677ba7eaba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:57.369101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 777/1562] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:01:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:57.377437 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df767c8e-21c7-47ce-b6f1-a677ba7eaba6 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:57.377437 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:57.380293 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df767c8e-21c7-47ce-b6f1-a677ba7eaba6 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:57.385135 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2e098-c801-4a6b-8d5c-3875b96d03e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:57.385718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2e098-c801-4a6b-8d5c-3875b96d03e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:57.386001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2e098-c801-4a6b-8d5c-3875b96d03e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:57.386328 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d2e098-c801-4a6b-8d5c-3875b96d03e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:57.386946 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2e098-c801-4a6b-8d5c-3875b96d03e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:57.387242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2e098-c801-4a6b-8d5c-3875b96d03e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:57.388808 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d2e098-c801-4a6b-8d5c-3875b96d03e7 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:57.394092 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 786/1563] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:57 2022] POST /identity/v3/users => generated 284 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:57.394850 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5323f4-fa56-40cf-93f7-801bb62fce8d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:57.401055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 778/1564] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:57.401903 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2e098-c801-4a6b-8d5c-3875b96d03e7 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:57.411924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d2e098-c801-4a6b-8d5c-3875b96d03e7 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:57.412360 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5323f4-fa56-40cf-93f7-801bb62fce8d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:57.416704 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40f3e2-a965-46dc-8c83-483b6145c781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:57.417722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7b355-4a60-4ea9-ba6f-b6872f3ea2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:57.417872 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40f3e2-a965-46dc-8c83-483b6145c781 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:57.417979 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7b355-4a60-4ea9-ba6f-b6872f3ea2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:57.418081 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40f3e2-a965-46dc-8c83-483b6145c781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:57.418180 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7b355-4a60-4ea9-ba6f-b6872f3ea2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:57.418282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a40f3e2-a965-46dc-8c83-483b6145c781 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:57.418429 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d7b355-4a60-4ea9-ba6f-b6872f3ea2e0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:57.419018 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40f3e2-a965-46dc-8c83-483b6145c781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:57.419147 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7b355-4a60-4ea9-ba6f-b6872f3ea2e0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:57.419382 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7b355-4a60-4ea9-ba6f-b6872f3ea2e0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:57.420588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a40f3e2-a965-46dc-8c83-483b6145c781 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:57.421057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d7b355-4a60-4ea9-ba6f-b6872f3ea2e0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:57.431844 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 779/1565] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:57.434955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40f3e2-a965-46dc-8c83-483b6145c781 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:57.435076 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 787/1566] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:57.435076 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7b355-4a60-4ea9-ba6f-b6872f3ea2e0 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:57.442679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a40f3e2-a965-46dc-8c83-483b6145c781 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:57.447635 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5aab2-dbff-4805-b054-4793365ceb49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:57.448223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5aab2-dbff-4805-b054-4793365ceb49 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:57.448499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5aab2-dbff-4805-b054-4793365ceb49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:57.448768 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd5aab2-dbff-4805-b054-4793365ceb49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:57.449387 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5aab2-dbff-4805-b054-4793365ceb49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:57.451177 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d7b355-4a60-4ea9-ba6f-b6872f3ea2e0 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:57.451368 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd5aab2-dbff-4805-b054-4793365ceb49 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:57.455707 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb73e2-436a-4335-b673-5c13e5e60a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:57.456295 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb73e2-436a-4335-b673-5c13e5e60a67 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:57.456577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb73e2-436a-4335-b673-5c13e5e60a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:57.456853 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb73e2-436a-4335-b673-5c13e5e60a67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:57.457488 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb73e2-436a-4335-b673-5c13e5e60a67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:57.457826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb73e2-436a-4335-b673-5c13e5e60a67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:57.459417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fb73e2-436a-4335-b673-5c13e5e60a67 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:57.472011 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 788/1567] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:57.472970 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb73e2-436a-4335-b673-5c13e5e60a67 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:57.482439 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fb73e2-436a-4335-b673-5c13e5e60a67 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:57.487595 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fd85a-0d99-41d7-80e1-a3a270e8f525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:57.488168 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fd85a-0d99-41d7-80e1-a3a270e8f525 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:57.488446 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fd85a-0d99-41d7-80e1-a3a270e8f525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:57.488713 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4fd85a-0d99-41d7-80e1-a3a270e8f525 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:57.489329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fd85a-0d99-41d7-80e1-a3a270e8f525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:57.491278 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4fd85a-0d99-41d7-80e1-a3a270e8f525 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:57.543339 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 780/1568] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:57 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:57.544165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5aab2-dbff-4805-b054-4793365ceb49 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:57.566099 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 789/1569] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:57 2022] POST /identity/v3/projects => generated 379 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:57.572213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fd85a-0d99-41d7-80e1-a3a270e8f525 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:57.609780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd5aab2-dbff-4805-b054-4793365ceb49 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:57.629400 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4fd85a-0d99-41d7-80e1-a3a270e8f525 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:57.634094 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1629c52-bb16-4ee0-8fa9-f0d28dae4dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:57.639382 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1629c52-bb16-4ee0-8fa9-f0d28dae4dbb admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:57.639382 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1629c52-bb16-4ee0-8fa9-f0d28dae4dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:57.639382 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1629c52-bb16-4ee0-8fa9-f0d28dae4dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:57.639382 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1629c52-bb16-4ee0-8fa9-f0d28dae4dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:57.639382 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1629c52-bb16-4ee0-8fa9-f0d28dae4dbb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:57.647983 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 790/1570] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:57.648901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1629c52-bb16-4ee0-8fa9-f0d28dae4dbb admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:57.658988 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1629c52-bb16-4ee0-8fa9-f0d28dae4dbb admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:57.664002 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f394123-c508-4656-8dfe-9357ede2549f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:57.664275 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f394123-c508-4656-8dfe-9357ede2549f admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:57.664553 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f394123-c508-4656-8dfe-9357ede2549f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:57.664821 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f394123-c508-4656-8dfe-9357ede2549f admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:57.665441 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f394123-c508-4656-8dfe-9357ede2549f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:57.667354 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f394123-c508-4656-8dfe-9357ede2549f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:57.667487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476c42a-024a-48c8-b029-32f99914eb6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:57.668053 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476c42a-024a-48c8-b029-32f99914eb6e admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:57.668333 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476c42a-024a-48c8-b029-32f99914eb6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:57.668607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4476c42a-024a-48c8-b029-32f99914eb6e admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:57.669249 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476c42a-024a-48c8-b029-32f99914eb6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:01:57.669551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476c42a-024a-48c8-b029-32f99914eb6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:57.671794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4476c42a-024a-48c8-b029-32f99914eb6e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:57.683695 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 781/1571] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:01:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:01:57.684550 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476c42a-024a-48c8-b029-32f99914eb6e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:57.694756 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4476c42a-024a-48c8-b029-32f99914eb6e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:57.699367 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab276b-ae13-4b87-b59f-4eba12dfed1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:57.699949 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab276b-ae13-4b87-b59f-4eba12dfed1a admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:57.703992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab276b-ae13-4b87-b59f-4eba12dfed1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:57.703992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ab276b-ae13-4b87-b59f-4eba12dfed1a admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:57.703992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab276b-ae13-4b87-b59f-4eba12dfed1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:57.703992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ab276b-ae13-4b87-b59f-4eba12dfed1a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:57.750144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 791/1572] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:57 2022] POST /identity/v3/projects => generated 393 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:57.751190 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f394123-c508-4656-8dfe-9357ede2549f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:57.800473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 782/1573] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:57 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:57.800473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab276b-ae13-4b87-b59f-4eba12dfed1a admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:57.814315 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f394123-c508-4656-8dfe-9357ede2549f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:57.823115 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:57.841052 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:57.863985 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ab276b-ae13-4b87-b59f-4eba12dfed1a admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:57.868574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4dca2-3aae-41e2-b4a1-5925c92d4699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:57.868896 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de6f1d-d7bc-4810-9364-241e495d0d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:57.869181 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4dca2-3aae-41e2-b4a1-5925c92d4699 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:57.869462 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4dca2-3aae-41e2-b4a1-5925c92d4699 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:57.869563 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de6f1d-d7bc-4810-9364-241e495d0d5d admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:57.869763 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4dca2-3aae-41e2-b4a1-5925c92d4699 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:57.869882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de6f1d-d7bc-4810-9364-241e495d0d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:57.870055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71de6f1d-d7bc-4810-9364-241e495d0d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:57.870395 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4dca2-3aae-41e2-b4a1-5925c92d4699 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:57.870681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de6f1d-d7bc-4810-9364-241e495d0d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:57.872276 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71de6f1d-d7bc-4810-9364-241e495d0d5d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:57.872386 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad4dca2-3aae-41e2-b4a1-5925c92d4699 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:57.890965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 792/1574] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:57 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:57.890965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de6f1d-d7bc-4810-9364-241e495d0d5d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:57.898005 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71de6f1d-d7bc-4810-9364-241e495d0d5d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:57.902675 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ce5de-0b50-4099-b78c-e3a05236d8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:57.903270 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ce5de-0b50-4099-b78c-e3a05236d8ed admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:57.903553 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ce5de-0b50-4099-b78c-e3a05236d8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:57.903822 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2ce5de-0b50-4099-b78c-e3a05236d8ed admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:57.904446 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ce5de-0b50-4099-b78c-e3a05236d8ed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:57.906410 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2ce5de-0b50-4099-b78c-e3a05236d8ed admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:57.993467 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 783/1575] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:57 2022] POST /identity/v3/projects => generated 385 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:57.994377 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4dca2-3aae-41e2-b4a1-5925c92d4699 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:58.006413 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 793/1576] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:57 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:58.007150 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ce5de-0b50-4099-b78c-e3a05236d8ed admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:58.016385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2ce5de-0b50-4099-b78c-e3a05236d8ed admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:58.057597 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4dca2-3aae-41e2-b4a1-5925c92d4699 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:58.063337 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdecf3f-89b7-4fe1-9a42-10185c17470e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:58.063939 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdecf3f-89b7-4fe1-9a42-10185c17470e admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.064216 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdecf3f-89b7-4fe1-9a42-10185c17470e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.064485 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdecf3f-89b7-4fe1-9a42-10185c17470e admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.065105 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdecf3f-89b7-4fe1-9a42-10185c17470e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:58.067162 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdecf3f-89b7-4fe1-9a42-10185c17470e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:58.072899 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73040ac5-a333-4786-a429-c41f4f956358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:58.073536 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73040ac5-a333-4786-a429-c41f4f956358 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.073843 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73040ac5-a333-4786-a429-c41f4f956358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.074118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73040ac5-a333-4786-a429-c41f4f956358 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.074757 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73040ac5-a333-4786-a429-c41f4f956358 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:58.076974 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73040ac5-a333-4786-a429-c41f4f956358 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:58.087561 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 794/1577] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:58.088334 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73040ac5-a333-4786-a429-c41f4f956358 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:58.097498 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73040ac5-a333-4786-a429-c41f4f956358 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:58.102013 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1bd9d-ee5d-4639-bc19-e9edf3714a16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:58.102569 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1bd9d-ee5d-4639-bc19-e9edf3714a16 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.103103 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1bd9d-ee5d-4639-bc19-e9edf3714a16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.103379 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc1bd9d-ee5d-4639-bc19-e9edf3714a16 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.103983 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1bd9d-ee5d-4639-bc19-e9edf3714a16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:58.105849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc1bd9d-ee5d-4639-bc19-e9edf3714a16 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:58.176217 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 784/1578] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:57 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:58.176957 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdecf3f-89b7-4fe1-9a42-10185c17470e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:58.186487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdecf3f-89b7-4fe1-9a42-10185c17470e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:58.191996 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516335c-732c-4de6-8b27-24f6847cf067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:58.192604 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516335c-732c-4de6-8b27-24f6847cf067 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.192889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516335c-732c-4de6-8b27-24f6847cf067 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.193163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e516335c-732c-4de6-8b27-24f6847cf067 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.193840 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516335c-732c-4de6-8b27-24f6847cf067 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:58.195848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e516335c-732c-4de6-8b27-24f6847cf067 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:58.205589 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 795/1579] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:58 2022] POST /identity/v3/projects => generated 401 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:58.206436 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1bd9d-ee5d-4639-bc19-e9edf3714a16 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:58.267602 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc1bd9d-ee5d-4639-bc19-e9edf3714a16 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:58.272192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5ac01-329e-4aa8-b3a2-267046d8f3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:58.272801 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5ac01-329e-4aa8-b3a2-267046d8f3dc admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.273079 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5ac01-329e-4aa8-b3a2-267046d8f3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.273350 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f5ac01-329e-4aa8-b3a2-267046d8f3dc admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.273745 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 785/1580] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:58 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:58.276897 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516335c-732c-4de6-8b27-24f6847cf067 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:58.277088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5ac01-329e-4aa8-b3a2-267046d8f3dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:58.279056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f5ac01-329e-4aa8-b3a2-267046d8f3dc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:58.284774 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e516335c-732c-4de6-8b27-24f6847cf067 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:58.289629 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0c661-739e-4b2d-9aa6-d64d12738db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:58.290295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0c661-739e-4b2d-9aa6-d64d12738db6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.290575 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0c661-739e-4b2d-9aa6-d64d12738db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.290845 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e0c661-739e-4b2d-9aa6-d64d12738db6 admin admin] PATH_INFO: `/v3/projects/9924c8e960e84d3fa49021d47a27fd32/users/0851425d841946f49c73af574b818ace/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.291550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:58.306291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0c661-739e-4b2d-9aa6-d64d12738db6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9924c8e960e84d3fa49021d47a27fd32, user_id=0851425d841946f49c73af574b818ace, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:58.308920 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e0c661-739e-4b2d-9aa6-d64d12738db6 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:58.362958 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 796/1581] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:58 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:58.362958 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5ac01-329e-4aa8-b3a2-267046d8f3dc admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:58.370240 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f5ac01-329e-4aa8-b3a2-267046d8f3dc admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:58.374856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392eb52-99a3-4c9f-b941-eb0ed82bf989 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:58.380241 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392eb52-99a3-4c9f-b941-eb0ed82bf989 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.380241 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392eb52-99a3-4c9f-b941-eb0ed82bf989 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.380241 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c392eb52-99a3-4c9f-b941-eb0ed82bf989 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.380241 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392eb52-99a3-4c9f-b941-eb0ed82bf989 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:58.380241 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c392eb52-99a3-4c9f-b941-eb0ed82bf989 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:58.383081 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 786/1582] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:58 2022] PUT /identity/v3/projects/9924c8e960e84d3fa49021d47a27fd32/users/0851425d841946f49c73af574b818ace/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:58.383990 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0c661-739e-4b2d-9aa6-d64d12738db6 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:58.444758 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e0c661-739e-4b2d-9aa6-d64d12738db6 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:58.449292 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc50e5c-6edc-4951-910c-98b72e1aedd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:58.449915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc50e5c-6edc-4951-910c-98b72e1aedd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.450196 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc50e5c-6edc-4951-910c-98b72e1aedd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.450471 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc50e5c-6edc-4951-910c-98b72e1aedd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.451099 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc50e5c-6edc-4951-910c-98b72e1aedd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:58.452687 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc50e5c-6edc-4951-910c-98b72e1aedd5 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:58.462320 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 787/1583] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:58.463703 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc50e5c-6edc-4951-910c-98b72e1aedd5 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:58.470064 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:58.473753 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc50e5c-6edc-4951-910c-98b72e1aedd5 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:58.474044 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 797/1584] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:58 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:58.474867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392eb52-99a3-4c9f-b941-eb0ed82bf989 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:58.478659 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb70b3-d8eb-4992-9a94-35581826d373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:58.480702 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb70b3-d8eb-4992-9a94-35581826d373 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.480702 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb70b3-d8eb-4992-9a94-35581826d373 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.480702 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7bb70b3-d8eb-4992-9a94-35581826d373 admin admin] PATH_INFO: `/v3/projects/633c72adfdda4948a94d6b494d56ce44/users/e4abe8fc69ff469498a52394b02629f8/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.485417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c392eb52-99a3-4c9f-b941-eb0ed82bf989 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:58.490004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26dc42-f6c4-4e26-8c96-8b918fd5c57c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:58.490596 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26dc42-f6c4-4e26-8c96-8b918fd5c57c admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.490878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26dc42-f6c4-4e26-8c96-8b918fd5c57c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.491264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26dc42-f6c4-4e26-8c96-8b918fd5c57c admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.491910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26dc42-f6c4-4e26-8c96-8b918fd5c57c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:58.493577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26dc42-f6c4-4e26-8c96-8b918fd5c57c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:58.495427 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb70b3-d8eb-4992-9a94-35581826d373 admin admin] RBAC: Authorizing `identity:create_grant(project_id=633c72adfdda4948a94d6b494d56ce44, user_id=e4abe8fc69ff469498a52394b02629f8, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:58.498098 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7bb70b3-d8eb-4992-9a94-35581826d373 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:58.504312 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 798/1585] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:58.505091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26dc42-f6c4-4e26-8c96-8b918fd5c57c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:58.515228 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26dc42-f6c4-4e26-8c96-8b918fd5c57c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:58.519856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb60d35-46c6-44e7-b013-9908d95e8630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:58.520372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb60d35-46c6-44e7-b013-9908d95e8630 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.520652 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb60d35-46c6-44e7-b013-9908d95e8630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.520926 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb60d35-46c6-44e7-b013-9908d95e8630 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.521542 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb60d35-46c6-44e7-b013-9908d95e8630 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:58.523466 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb60d35-46c6-44e7-b013-9908d95e8630 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:58.548639 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 788/1586] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:58 2022] PUT /identity/v3/projects/633c72adfdda4948a94d6b494d56ce44/users/e4abe8fc69ff469498a52394b02629f8/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:58.549471 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb70b3-d8eb-4992-9a94-35581826d373 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:58.611541 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7bb70b3-d8eb-4992-9a94-35581826d373 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:58.616192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454ad57b-6f59-4436-9e97-c2a71cc07554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:58.616797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ad57b-6f59-4436-9e97-c2a71cc07554 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.617072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ad57b-6f59-4436-9e97-c2a71cc07554 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.617336 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454ad57b-6f59-4436-9e97-c2a71cc07554 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.618020 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ad57b-6f59-4436-9e97-c2a71cc07554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:58.619602 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454ad57b-6f59-4436-9e97-c2a71cc07554 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:58.624731 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 799/1587] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:01:58 2022] POST /identity/v3/users => generated 301 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:58.624731 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb60d35-46c6-44e7-b013-9908d95e8630 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:58.632385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb60d35-46c6-44e7-b013-9908d95e8630 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:58.637261 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 789/1588] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:58.637261 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac41cd-330e-48c5-b1d3-8da6c28d47d9 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.637261 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac41cd-330e-48c5-b1d3-8da6c28d47d9 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.637261 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac41cd-330e-48c5-b1d3-8da6c28d47d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.637635 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90f805-394c-4ea4-b22d-bd3a9b90ef90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:58.637635 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90f805-394c-4ea4-b22d-bd3a9b90ef90 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.637854 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90f805-394c-4ea4-b22d-bd3a9b90ef90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.638120 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e90f805-394c-4ea4-b22d-bd3a9b90ef90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.638749 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90f805-394c-4ea4-b22d-bd3a9b90ef90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:58.640415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e90f805-394c-4ea4-b22d-bd3a9b90ef90 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:58.653308 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 800/1589] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:58.653308 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90f805-394c-4ea4-b22d-bd3a9b90ef90 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:58.655967 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-45ac41cd-330e-48c5-b1d3-8da6c28d47d9 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:58.657179 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-45ac41cd-330e-48c5-b1d3-8da6c28d47d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:58.660632 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e90f805-394c-4ea4-b22d-bd3a9b90ef90 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:58.664888 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 790/1590] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:58.670486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab6bc0-16f2-4eb1-bc48-8b77d2ac29cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:58.670486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab6bc0-16f2-4eb1-bc48-8b77d2ac29cd admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.670722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac41cd-330e-48c5-b1d3-8da6c28d47d9 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:58.671873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab6bc0-16f2-4eb1-bc48-8b77d2ac29cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.671873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ab6bc0-16f2-4eb1-bc48-8b77d2ac29cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.671873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab6bc0-16f2-4eb1-bc48-8b77d2ac29cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:58.671873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ab6bc0-16f2-4eb1-bc48-8b77d2ac29cd admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:58.676031 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac41cd-330e-48c5-b1d3-8da6c28d47d9 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:58.680815 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d763d3-db9d-4c80-9ea8-67465da4aa46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:58.681414 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d763d3-db9d-4c80-9ea8-67465da4aa46 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.681706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d763d3-db9d-4c80-9ea8-67465da4aa46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.681995 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d763d3-db9d-4c80-9ea8-67465da4aa46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.682759 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d763d3-db9d-4c80-9ea8-67465da4aa46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:58.684351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d763d3-db9d-4c80-9ea8-67465da4aa46 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:58.684983 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 801/1591] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:58.685872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab6bc0-16f2-4eb1-bc48-8b77d2ac29cd admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:58.698156 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 791/1592] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:58.698313 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ab6bc0-16f2-4eb1-bc48-8b77d2ac29cd admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:58.698450 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75707157-9797-4fbf-81b6-8d04b87b71f5 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.698450 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75707157-9797-4fbf-81b6-8d04b87b71f5 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.698450 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75707157-9797-4fbf-81b6-8d04b87b71f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.700532 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4482fab-d18f-415d-9a0f-e545e2cf5981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:58.701134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4482fab-d18f-415d-9a0f-e545e2cf5981 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.701412 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4482fab-d18f-415d-9a0f-e545e2cf5981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.701680 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4482fab-d18f-415d-9a0f-e545e2cf5981 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.707624 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4482fab-d18f-415d-9a0f-e545e2cf5981 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:58.707624 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4482fab-d18f-415d-9a0f-e545e2cf5981 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:58.716883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 802/1593] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:58.716883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4482fab-d18f-415d-9a0f-e545e2cf5981 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:58.724107 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4482fab-d18f-415d-9a0f-e545e2cf5981 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:58.725951 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-75707157-9797-4fbf-81b6-8d04b87b71f5 None None] MFA Rules not processed for user `e4abe8fc69ff469498a52394b02629f8`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:58.727162 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-75707157-9797-4fbf-81b6-8d04b87b71f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:58.728873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87de7f-af1d-4ce2-aca2-142880047c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:58.729451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87de7f-af1d-4ce2-aca2-142880047c5a admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.729822 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87de7f-af1d-4ce2-aca2-142880047c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.730095 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e87de7f-af1d-4ce2-aca2-142880047c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.730723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87de7f-af1d-4ce2-aca2-142880047c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:58.732290 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e87de7f-af1d-4ce2-aca2-142880047c5a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:58.742486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 803/1594] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:58.743260 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87de7f-af1d-4ce2-aca2-142880047c5a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:58.752956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e87de7f-af1d-4ce2-aca2-142880047c5a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:58.757431 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1f9c9-89bb-4c51-880b-7189f6bad502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:58.758022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1f9c9-89bb-4c51-880b-7189f6bad502 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.758305 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1f9c9-89bb-4c51-880b-7189f6bad502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.758574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a1f9c9-89bb-4c51-880b-7189f6bad502 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.759185 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1f9c9-89bb-4c51-880b-7189f6bad502 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:58.760759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a1f9c9-89bb-4c51-880b-7189f6bad502 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:58.776425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 804/1595] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:58.776425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1f9c9-89bb-4c51-880b-7189f6bad502 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:58.783723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a1f9c9-89bb-4c51-880b-7189f6bad502 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:58.788110 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e0f2d-1c8e-4241-850b-1e8df478f2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:58.788673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e0f2d-1c8e-4241-850b-1e8df478f2ab admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.788950 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e0f2d-1c8e-4241-850b-1e8df478f2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.789217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e0f2d-1c8e-4241-850b-1e8df478f2ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.789857 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e0f2d-1c8e-4241-850b-1e8df478f2ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:58.791398 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e0f2d-1c8e-4241-850b-1e8df478f2ab admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:58.797111 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 792/1596] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:01:58 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:58.798154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75707157-9797-4fbf-81b6-8d04b87b71f5 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:58.801218 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 805/1597] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:58.801912 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e0f2d-1c8e-4241-850b-1e8df478f2ab admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:58.811148 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e0f2d-1c8e-4241-850b-1e8df478f2ab admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:58.815695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64ea2e-535e-4df9-868f-f555986c71a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:58.816324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64ea2e-535e-4df9-868f-f555986c71a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.816599 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64ea2e-535e-4df9-868f-f555986c71a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.816870 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da64ea2e-535e-4df9-868f-f555986c71a7 admin admin] PATH_INFO: `/v3/projects/f0b86104bd93469eac8523901d2b2d31/users/ae681d7c4d1840e49acc4c7b1255a808/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.831676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64ea2e-535e-4df9-868f-f555986c71a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0b86104bd93469eac8523901d2b2d31, user_id=ae681d7c4d1840e49acc4c7b1255a808, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:58.832695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-da64ea2e-535e-4df9-868f-f555986c71a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 20:01:58.832695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: warnings.warn(msg) Sep 13 20:01:58.832695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: Sep 13 20:01:58.834649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da64ea2e-535e-4df9-868f-f555986c71a7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:58.852075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:58.858565 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75707157-9797-4fbf-81b6-8d04b87b71f5 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:58.862365 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f156132-cd00-424d-854b-41b4f444147d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:58.863003 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f156132-cd00-424d-854b-41b4f444147d service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.863278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f156132-cd00-424d-854b-41b4f444147d service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.863552 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f156132-cd00-424d-854b-41b4f444147d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.872392 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f156132-cd00-424d-854b-41b4f444147d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:58.876762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f156132-cd00-424d-854b-41b4f444147d service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:58.883792 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 793/1598] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:58.884595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f156132-cd00-424d-854b-41b4f444147d service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:58.894301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f156132-cd00-424d-854b-41b4f444147d service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:58.910777 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 806/1599] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:58 2022] PUT /identity/v3/projects/f0b86104bd93469eac8523901d2b2d31/users/ae681d7c4d1840e49acc4c7b1255a808/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:58.910777 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64ea2e-535e-4df9-868f-f555986c71a7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:58.960026 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97517bf9-1715-4915-863c-8e9a62c80ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:58.960636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97517bf9-1715-4915-863c-8e9a62c80ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.960910 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97517bf9-1715-4915-863c-8e9a62c80ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.961184 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97517bf9-1715-4915-863c-8e9a62c80ff3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.961859 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97517bf9-1715-4915-863c-8e9a62c80ff3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:58.963629 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97517bf9-1715-4915-863c-8e9a62c80ff3 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:58.973535 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 794/1600] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:58.974383 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da64ea2e-535e-4df9-868f-f555986c71a7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:58.979249 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97517bf9-1715-4915-863c-8e9a62c80ff3 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:58.979543 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5e2ae-faa9-4663-8f63-8226403d8a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:58.980206 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5e2ae-faa9-4663-8f63-8226403d8a9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.980489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5e2ae-faa9-4663-8f63-8226403d8a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.980766 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f5e2ae-faa9-4663-8f63-8226403d8a9f admin admin] PATH_INFO: `/v3/projects/2758e645d42148f5a43581d3cd435c50/users/148bba2e6a824ae7b3528b6db9ea141c/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.984216 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97517bf9-1715-4915-863c-8e9a62c80ff3 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:58.988825 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482295a-8824-492f-b475-65482d077ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:58.990329 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482295a-8824-492f-b475-65482d077ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:58.990329 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482295a-8824-492f-b475-65482d077ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:58.990329 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7482295a-8824-492f-b475-65482d077ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:58.990689 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482295a-8824-492f-b475-65482d077ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:58.992211 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7482295a-8824-492f-b475-65482d077ec9 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:58.996281 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5e2ae-faa9-4663-8f63-8226403d8a9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=2758e645d42148f5a43581d3cd435c50, user_id=148bba2e6a824ae7b3528b6db9ea141c, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:58.999600 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f5e2ae-faa9-4663-8f63-8226403d8a9f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:59.003676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 795/1601] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:01:59.004450 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482295a-8824-492f-b475-65482d077ec9 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:59.013809 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7482295a-8824-492f-b475-65482d077ec9 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:59.018847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3078a-26b7-4c2f-b13c-8b866a6799e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:59.019493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3078a-26b7-4c2f-b13c-8b866a6799e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:59.019772 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3078a-26b7-4c2f-b13c-8b866a6799e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:59.020049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf3078a-26b7-4c2f-b13c-8b866a6799e4 admin admin] PATH_INFO: `/v3/projects/847778f574cf425fa76d6df2abf9cb82/users/c83ccb0008d04b4f98c05915e5748713/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:59.035437 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3078a-26b7-4c2f-b13c-8b866a6799e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=847778f574cf425fa76d6df2abf9cb82, user_id=c83ccb0008d04b4f98c05915e5748713, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:59.038142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf3078a-26b7-4c2f-b13c-8b866a6799e4 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:59.097789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 807/1602] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:58 2022] PUT /identity/v3/projects/2758e645d42148f5a43581d3cd435c50/users/148bba2e6a824ae7b3528b6db9ea141c/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:59.098442 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5e2ae-faa9-4663-8f63-8226403d8a9f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:59.102800 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:59.125677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 796/1603] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:59 2022] PUT /identity/v3/projects/847778f574cf425fa76d6df2abf9cb82/users/c83ccb0008d04b4f98c05915e5748713/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:59.127161 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3078a-26b7-4c2f-b13c-8b866a6799e4 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:59.162269 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f5e2ae-faa9-4663-8f63-8226403d8a9f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:59.185282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf3078a-26b7-4c2f-b13c-8b866a6799e4 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:59.189036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d863a5-8e18-4763-876a-3b63de048252 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:59.189637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d863a5-8e18-4763-876a-3b63de048252 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:59.189941 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d863a5-8e18-4763-876a-3b63de048252 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:59.190212 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d863a5-8e18-4763-876a-3b63de048252 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:59.216965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37807cbb-52e6-40fb-a8a2-8c5e77706951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:59.217616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37807cbb-52e6-40fb-a8a2-8c5e77706951 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:59.218539 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37807cbb-52e6-40fb-a8a2-8c5e77706951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:59.218840 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37807cbb-52e6-40fb-a8a2-8c5e77706951 admin admin] PATH_INFO: `/v3/projects/aa26348a29224665a9c43fa81cbca5c3/users/abb30d0c8b764bed8ca98f35ea070e86/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:59.233060 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37807cbb-52e6-40fb-a8a2-8c5e77706951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa26348a29224665a9c43fa81cbca5c3, user_id=abb30d0c8b764bed8ca98f35ea070e86, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:59.236272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37807cbb-52e6-40fb-a8a2-8c5e77706951 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:59.247240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d863a5-8e18-4763-876a-3b63de048252 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:59.248744 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d863a5-8e18-4763-876a-3b63de048252 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:59.258061 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 797/1604] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:59 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:59.259489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1164d-ae24-41bc-9d3c-581d89bcf01b None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:59.259696 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1164d-ae24-41bc-9d3c-581d89bcf01b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:59.260042 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb1164d-ae24-41bc-9d3c-581d89bcf01b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:59.274498 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:59.291931 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-ddb1164d-ae24-41bc-9d3c-581d89bcf01b None None] MFA Rules not processed for user `ae681d7c4d1840e49acc4c7b1255a808`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:59.293272 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ddb1164d-ae24-41bc-9d3c-581d89bcf01b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:59.340274 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 808/1605] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:59 2022] PUT /identity/v3/projects/aa26348a29224665a9c43fa81cbca5c3/users/abb30d0c8b764bed8ca98f35ea070e86/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:59.341096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37807cbb-52e6-40fb-a8a2-8c5e77706951 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:59.386815 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 798/1606] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:01:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:59.386815 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1164d-ae24-41bc-9d3c-581d89bcf01b None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:59.398090 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb1164d-ae24-41bc-9d3c-581d89bcf01b None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:59.432331 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37807cbb-52e6-40fb-a8a2-8c5e77706951 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:59.441579 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3eca9e9-a2b3-43d8-98e5-b8a06dbebaf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:59.442299 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eca9e9-a2b3-43d8-98e5-b8a06dbebaf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:59.442586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eca9e9-a2b3-43d8-98e5-b8a06dbebaf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:59.442859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3eca9e9-a2b3-43d8-98e5-b8a06dbebaf4 admin admin] PATH_INFO: `/v3/projects/f01e074d7c91487c81374c1e45d81f9c/users/75a27959e4354f11bcf13a1d254a6b56/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:59.464553 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eca9e9-a2b3-43d8-98e5-b8a06dbebaf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f01e074d7c91487c81374c1e45d81f9c, user_id=75a27959e4354f11bcf13a1d254a6b56, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:59.468863 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3eca9e9-a2b3-43d8-98e5-b8a06dbebaf4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:59.474508 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be8113b-f63a-41df-b52e-7312cd4a7253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:59.475194 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8113b-f63a-41df-b52e-7312cd4a7253 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:59.475474 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8113b-f63a-41df-b52e-7312cd4a7253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:59.475775 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be8113b-f63a-41df-b52e-7312cd4a7253 admin admin] PATH_INFO: `/v3/projects/1365a5b2906d47398e6a007a3c29a263/users/093fa7a93dd545c986542e16894d7a35/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:59.493902 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be8113b-f63a-41df-b52e-7312cd4a7253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1365a5b2906d47398e6a007a3c29a263, user_id=093fa7a93dd545c986542e16894d7a35, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:59.496578 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be8113b-f63a-41df-b52e-7312cd4a7253 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:59.526651 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 809/1607] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:59 2022] PUT /identity/v3/projects/f01e074d7c91487c81374c1e45d81f9c/users/75a27959e4354f11bcf13a1d254a6b56/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:59.528038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d4172-ebc7-4734-8651-0ea4924379b3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:59.528317 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d4172-ebc7-4734-8651-0ea4924379b3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:59.528587 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419d4172-ebc7-4734-8651-0ea4924379b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:59.546324 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 799/1608] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:01:59 2022] PUT /identity/v3/projects/1365a5b2906d47398e6a007a3c29a263/users/093fa7a93dd545c986542e16894d7a35/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:01:59.547699 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc056f1-9c63-41c1-ac44-36a101251267 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:59.549865 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc056f1-9c63-41c1-ac44-36a101251267 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:59.549865 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc056f1-9c63-41c1-ac44-36a101251267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:59.552576 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-419d4172-ebc7-4734-8651-0ea4924379b3 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:59.553876 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-419d4172-ebc7-4734-8651-0ea4924379b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:59.565561 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:59.576425 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-9cc056f1-9c63-41c1-ac44-36a101251267 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:59.579288 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9cc056f1-9c63-41c1-ac44-36a101251267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:59.626208 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 810/1609] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:59.627595 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957ac24-a018-4044-a0e6-7654f15ee6d1 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:59.628102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957ac24-a018-4044-a0e6-7654f15ee6d1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:59.630505 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d957ac24-a018-4044-a0e6-7654f15ee6d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:59.650492 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 800/1610] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:59.652397 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d957ac24-a018-4044-a0e6-7654f15ee6d1 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:59.653723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d957ac24-a018-4044-a0e6-7654f15ee6d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:59.654163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc056f1-9c63-41c1-ac44-36a101251267 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:59.667032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 811/1611] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:59.667032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bcdd85-de5c-4e95-9bce-0d38c4098576 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:59.667407 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc056f1-9c63-41c1-ac44-36a101251267 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:59.667504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bcdd85-de5c-4e95-9bce-0d38c4098576 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:59.667504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bcdd85-de5c-4e95-9bce-0d38c4098576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:59.675804 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc748199-fab9-4899-b739-759ab636c1ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:59.677521 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc748199-fab9-4899-b739-759ab636c1ed admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:59.677760 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc748199-fab9-4899-b739-759ab636c1ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:59.679346 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc748199-fab9-4899-b739-759ab636c1ed admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:59.682354 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc748199-fab9-4899-b739-759ab636c1ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:59.689429 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc748199-fab9-4899-b739-759ab636c1ed admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:59.693772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f5bcdd85-de5c-4e95-9bce-0d38c4098576 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:59.695015 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f5bcdd85-de5c-4e95-9bce-0d38c4098576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:59.704250 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 812/1612] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:59.705274 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea97ad-45e8-43fb-be58-092806b8aa65 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:59.721152 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea97ad-45e8-43fb-be58-092806b8aa65 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:59.721152 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ea97ad-45e8-43fb-be58-092806b8aa65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:59.730075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-99ea97ad-45e8-43fb-be58-092806b8aa65 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:01:59.732426 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-99ea97ad-45e8-43fb-be58-092806b8aa65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:01:59.740264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 813/1613] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:01:59.741064 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea97ad-45e8-43fb-be58-092806b8aa65 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:59.798774 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:01:59.804275 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ea97ad-45e8-43fb-be58-092806b8aa65 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:59.810810 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d8d7d-b833-44ea-8756-cd0a19673de3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:59.810810 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d8d7d-b833-44ea-8756-cd0a19673de3 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:59.810810 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d8d7d-b833-44ea-8756-cd0a19673de3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:59.810810 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d8d7d-b833-44ea-8756-cd0a19673de3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:59.812129 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 801/1614] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:01:59 2022] POST /identity/v3/projects => generated 373 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:01:59.813170 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc748199-fab9-4899-b739-759ab636c1ed admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:59.823726 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d8d7d-b833-44ea-8756-cd0a19673de3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:01:59.825102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d8d7d-b833-44ea-8756-cd0a19673de3 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:01:59.839133 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 814/1615] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:01:59.840806 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d8d7d-b833-44ea-8756-cd0a19673de3 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:01:59.851781 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d8d7d-b833-44ea-8756-cd0a19673de3 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:59.884619 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc748199-fab9-4899-b739-759ab636c1ed admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:01:59.889431 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d9f24-7736-4255-a603-0b576123c9b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:59.890922 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d9f24-7736-4255-a603-0b576123c9b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:59.891344 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d9f24-7736-4255-a603-0b576123c9b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:59.891692 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180d9f24-7736-4255-a603-0b576123c9b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:01:59.926433 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d517e8-afde-4415-a8ac-9591e5e9d660 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:01:59.927046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d517e8-afde-4415-a8ac-9591e5e9d660 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:01:59.927320 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d517e8-afde-4415-a8ac-9591e5e9d660 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:01:59.927588 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d517e8-afde-4415-a8ac-9591e5e9d660 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:00.007475 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d9f24-7736-4255-a603-0b576123c9b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:00.008185 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:00.009909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180d9f24-7736-4255-a603-0b576123c9b5 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:00.023949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d517e8-afde-4415-a8ac-9591e5e9d660 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:00.029066 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d517e8-afde-4415-a8ac-9591e5e9d660 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:00.029354 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 802/1616] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:00.029354 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d9f24-7736-4255-a603-0b576123c9b5 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:00.040498 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 815/1617] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:01:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:00.040987 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180d9f24-7736-4255-a603-0b576123c9b5 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:00.041344 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d517e8-afde-4415-a8ac-9591e5e9d660 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:00.047977 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd06f0-483c-4560-b18a-94b0e1b4417d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:00.051809 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd06f0-483c-4560-b18a-94b0e1b4417d service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:00.051809 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd06f0-483c-4560-b18a-94b0e1b4417d service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:00.051809 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bd06f0-483c-4560-b18a-94b0e1b4417d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:00.052103 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d517e8-afde-4415-a8ac-9591e5e9d660 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:00.055074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0572e2-7bf7-45e1-bce4-979bba60eac8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:00.056151 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0572e2-7bf7-45e1-bce4-979bba60eac8 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:00.056309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0572e2-7bf7-45e1-bce4-979bba60eac8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:00.056679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0572e2-7bf7-45e1-bce4-979bba60eac8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:00.062892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd06f0-483c-4560-b18a-94b0e1b4417d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:00.064463 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bd06f0-483c-4560-b18a-94b0e1b4417d service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:00.069941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0572e2-7bf7-45e1-bce4-979bba60eac8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:00.073143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0572e2-7bf7-45e1-bce4-979bba60eac8 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:00.076543 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 803/1618] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:00.077925 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd06f0-483c-4560-b18a-94b0e1b4417d service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:00.088050 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bd06f0-483c-4560-b18a-94b0e1b4417d service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:00.089746 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 816/1619] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:00.097632 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094638d-4779-4f8c-a4a0-ae4d93ada043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:00.097632 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094638d-4779-4f8c-a4a0-ae4d93ada043 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:00.097632 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094638d-4779-4f8c-a4a0-ae4d93ada043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:00.097632 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094638d-4779-4f8c-a4a0-ae4d93ada043 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:00.098197 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094638d-4779-4f8c-a4a0-ae4d93ada043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:00.098289 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1094638d-4779-4f8c-a4a0-ae4d93ada043 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:00.235542 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0572e2-7bf7-45e1-bce4-979bba60eac8 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:00.248107 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 804/1620] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:02:00 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:00.248812 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0572e2-7bf7-45e1-bce4-979bba60eac8 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:00.258183 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4d8c7-82f1-47d6-b967-d6973a367ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:00.258183 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4d8c7-82f1-47d6-b967-d6973a367ca9 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:00.258183 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4d8c7-82f1-47d6-b967-d6973a367ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:00.258183 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb4d8c7-82f1-47d6-b967-d6973a367ca9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:00.258600 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb4d8c7-82f1-47d6-b967-d6973a367ca9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:00.261374 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb4d8c7-82f1-47d6-b967-d6973a367ca9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:00.283238 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 817/1621] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:02:00.287387 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094638d-4779-4f8c-a4a0-ae4d93ada043 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:00.297559 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1094638d-4779-4f8c-a4a0-ae4d93ada043 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:00.305072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af678f80-cac7-4123-b951-fe318eb4196d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:00.305780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af678f80-cac7-4123-b951-fe318eb4196d admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:00.306128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af678f80-cac7-4123-b951-fe318eb4196d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:00.306409 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af678f80-cac7-4123-b951-fe318eb4196d admin admin] PATH_INFO: `/v3/projects/194b16cd94fa48708ba5ddb68a7182a0/users/e07f0061e8d14693a3c4bbe36259b922/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:00.327803 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af678f80-cac7-4123-b951-fe318eb4196d admin admin] RBAC: Authorizing `identity:create_grant(project_id=194b16cd94fa48708ba5ddb68a7182a0, user_id=e07f0061e8d14693a3c4bbe36259b922, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:00.329823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af678f80-cac7-4123-b951-fe318eb4196d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:00.462610 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 805/1622] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:00 2022] PUT /identity/v3/projects/194b16cd94fa48708ba5ddb68a7182a0/users/e07f0061e8d14693a3c4bbe36259b922/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:00.463239 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4d8c7-82f1-47d6-b967-d6973a367ca9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:00.474087 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb4d8c7-82f1-47d6-b967-d6973a367ca9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:00.579780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ed0bf0-c763-42c7-8081-45ca2035895c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:00.580598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed0bf0-c763-42c7-8081-45ca2035895c admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:00.580989 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed0bf0-c763-42c7-8081-45ca2035895c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:00.581838 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ed0bf0-c763-42c7-8081-45ca2035895c admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:00.582564 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed0bf0-c763-42c7-8081-45ca2035895c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:00.586909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ed0bf0-c763-42c7-8081-45ca2035895c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:00.616811 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 818/1623] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:00.617219 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af678f80-cac7-4123-b951-fe318eb4196d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:00.632242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af678f80-cac7-4123-b951-fe318eb4196d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:00.641596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ea653-8456-4e24-b4e4-738b2f886242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:00.642318 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ea653-8456-4e24-b4e4-738b2f886242 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:00.642595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ea653-8456-4e24-b4e4-738b2f886242 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:00.642868 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ea653-8456-4e24-b4e4-738b2f886242 admin admin] PATH_INFO: `/v3/projects/194b16cd94fa48708ba5ddb68a7182a0/users/e07f0061e8d14693a3c4bbe36259b922/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:00.648942 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ea653-8456-4e24-b4e4-738b2f886242 admin admin] RBAC: Authorizing `identity:create_grant(project_id=194b16cd94fa48708ba5ddb68a7182a0, user_id=e07f0061e8d14693a3c4bbe36259b922, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:00.652972 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ea653-8456-4e24-b4e4-738b2f886242 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:00.681612 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 806/1624] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:00 2022] PUT /identity/v3/projects/194b16cd94fa48708ba5ddb68a7182a0/users/e07f0061e8d14693a3c4bbe36259b922/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:00.692087 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bba02b-e74c-43a0-8708-71056f1402fd None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:00.693141 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bba02b-e74c-43a0-8708-71056f1402fd None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:00.693496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bba02b-e74c-43a0-8708-71056f1402fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:00.752962 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e8bba02b-e74c-43a0-8708-71056f1402fd None None] MFA Rules not processed for user `e07f0061e8d14693a3c4bbe36259b922`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:00.758052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e8bba02b-e74c-43a0-8708-71056f1402fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:00.839228 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 819/1625] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:00 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:00.847509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ea653-8456-4e24-b4e4-738b2f886242 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:00.940101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:00.958547 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ea653-8456-4e24-b4e4-738b2f886242 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:00.962857 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22e51ad-c7bb-44a8-9140-026f5a6212d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:00.963544 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e51ad-c7bb-44a8-9140-026f5a6212d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:00.964276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e51ad-c7bb-44a8-9140-026f5a6212d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:00.964399 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e51ad-c7bb-44a8-9140-026f5a6212d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:00.980552 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e51ad-c7bb-44a8-9140-026f5a6212d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:00.984219 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22e51ad-c7bb-44a8-9140-026f5a6212d9 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:00.999024 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 807/1626] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:02.685657 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bba02b-e74c-43a0-8708-71056f1402fd None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:02.809144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:02.839244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bba02b-e74c-43a0-8708-71056f1402fd None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:02.857664 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce1bb1b-e7c9-4fe1-8b87-679f0fdaea7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:02.858410 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1bb1b-e7c9-4fe1-8b87-679f0fdaea7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:02.859093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1bb1b-e7c9-4fe1-8b87-679f0fdaea7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:02.859382 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce1bb1b-e7c9-4fe1-8b87-679f0fdaea7d admin admin] PATH_INFO: `/v3/users/ae681d7c4d1840e49acc4c7b1255a808` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:02.862462 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1bb1b-e7c9-4fe1-8b87-679f0fdaea7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae681d7c4d1840e49acc4c7b1255a808)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:02.863515 dv-cinder-828807-6-smb devstack@keystone.service[81554]: WARNING py.warnings [None req-7ce1bb1b-e7c9-4fe1-8b87-679f0fdaea7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 20:02:02.863515 dv-cinder-828807-6-smb devstack@keystone.service[81554]: warnings.warn(msg) Sep 13 20:02:02.863515 dv-cinder-828807-6-smb devstack@keystone.service[81554]: Sep 13 20:02:02.872051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce1bb1b-e7c9-4fe1-8b87-679f0fdaea7d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:02.969290 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493911a-a9c7-4ec9-84d5-6fbadf8d9f45 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:02.969819 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493911a-a9c7-4ec9-84d5-6fbadf8d9f45 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:02.969975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1493911a-a9c7-4ec9-84d5-6fbadf8d9f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:03.014151 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-1493911a-a9c7-4ec9-84d5-6fbadf8d9f45 None None] MFA Rules not processed for user `093fa7a93dd545c986542e16894d7a35`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:03.016284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1493911a-a9c7-4ec9-84d5-6fbadf8d9f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:03.151380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7ce1bb1b-e7c9-4fe1-8b87-679f0fdaea7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae681d7c4d1840e49acc4c7b1255a808'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:03.184296 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 808/1627] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:02 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:03.187535 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00dfd3-494d-43bd-b61a-36e8f1657c7e None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:03.187938 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00dfd3-494d-43bd-b61a-36e8f1657c7e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:03.188822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb00dfd3-494d-43bd-b61a-36e8f1657c7e None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:03.192511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 809/1628] 10.222.0.59 () {54 vars in 962 bytes} [Tue Sep 13 20:02:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:02:03.193896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00dfd3-494d-43bd-b61a-36e8f1657c7e None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:03.236134 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb00dfd3-494d-43bd-b61a-36e8f1657c7e None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:03.263744 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114e343-3f09-40aa-99cf-4a75380fd0d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:03.263744 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114e343-3f09-40aa-99cf-4a75380fd0d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:03.263744 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114e343-3f09-40aa-99cf-4a75380fd0d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:03.263744 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a114e343-3f09-40aa-99cf-4a75380fd0d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:03.264261 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114e343-3f09-40aa-99cf-4a75380fd0d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:03.264261 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a114e343-3f09-40aa-99cf-4a75380fd0d0 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:03.308523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7ce1bb1b-e7c9-4fe1-8b87-679f0fdaea7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae681d7c4d1840e49acc4c7b1255a808'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:03.348127 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7ce1bb1b-e7c9-4fe1-8b87-679f0fdaea7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae681d7c4d1840e49acc4c7b1255a808'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:03.350393 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7ce1bb1b-e7c9-4fe1-8b87-679f0fdaea7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae681d7c4d1840e49acc4c7b1255a808'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:03.363533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7ce1bb1b-e7c9-4fe1-8b87-679f0fdaea7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae681d7c4d1840e49acc4c7b1255a808'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:03.371464 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 820/1629] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:02 2022] DELETE /identity/v3/users/ae681d7c4d1840e49acc4c7b1255a808 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:03.372995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d0376-da41-44e8-ba67-08d32ac28cfd None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:03.373283 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d0376-da41-44e8-ba67-08d32ac28cfd None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:03.373563 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d0376-da41-44e8-ba67-08d32ac28cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:03.436397 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a81d0376-da41-44e8-ba67-08d32ac28cfd None None] MFA Rules not processed for user `3919b24291f54df99a9da0f5d3164ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:03.438418 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a81d0376-da41-44e8-ba67-08d32ac28cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:03.539302 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 821/1630] 10.222.0.59 () {58 vars in 1059 bytes} [Tue Sep 13 20:02:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:03.540730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68a53e-5a39-493f-9fb7-06f1dd154982 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:03.541122 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68a53e-5a39-493f-9fb7-06f1dd154982 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:03.541494 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68a53e-5a39-493f-9fb7-06f1dd154982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:03.575819 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8d68a53e-5a39-493f-9fb7-06f1dd154982 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:03.578453 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8d68a53e-5a39-493f-9fb7-06f1dd154982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:03.654635 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 822/1631] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:03.654635 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fce864-7269-4c86-bc2d-e054f610f0d5 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:03.654635 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fce864-7269-4c86-bc2d-e054f610f0d5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:03.654635 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fce864-7269-4c86-bc2d-e054f610f0d5 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:03.655887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 823/1632] 10.222.0.59 () {54 vars in 912 bytes} [Tue Sep 13 20:02:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:02:03.663087 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacc861-3c0e-4f6a-a9f6-fa054ac0a1e1 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:03.663371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacc861-3c0e-4f6a-a9f6-fa054ac0a1e1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:03.663648 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cacc861-3c0e-4f6a-a9f6-fa054ac0a1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:03.683489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5cacc861-3c0e-4f6a-a9f6-fa054ac0a1e1 None None] MFA Rules not processed for user `3919b24291f54df99a9da0f5d3164ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:03.684693 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5cacc861-3c0e-4f6a-a9f6-fa054ac0a1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:03.694188 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 824/1633] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Sep 13 20:02:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:03.694955 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacc861-3c0e-4f6a-a9f6-fa054ac0a1e1 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:03.696130 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5cacc861-3c0e-4f6a-a9f6-fa054ac0a1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:03.759345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cacc861-3c0e-4f6a-a9f6-fa054ac0a1e1 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:03.763716 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b100f8-1b82-40f7-addb-1edb0fb6314b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:03.765269 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b100f8-1b82-40f7-addb-1edb0fb6314b service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:03.765566 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b100f8-1b82-40f7-addb-1edb0fb6314b service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:03.765875 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b100f8-1b82-40f7-addb-1edb0fb6314b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:03.778526 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b100f8-1b82-40f7-addb-1edb0fb6314b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:03.778958 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b100f8-1b82-40f7-addb-1edb0fb6314b service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:03.789828 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 825/1634] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:03.790910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b100f8-1b82-40f7-addb-1edb0fb6314b service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:03.792374 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e0b100f8-1b82-40f7-addb-1edb0fb6314b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:03.824833 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 810/1635] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:02:03 2022] POST /identity/v3/projects => generated 405 bytes in 627 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:03.824833 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114e343-3f09-40aa-99cf-4a75380fd0d0 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:03.828242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a114e343-3f09-40aa-99cf-4a75380fd0d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:03.835528 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:03.900763 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b100f8-1b82-40f7-addb-1edb0fb6314b service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:03.980265 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a114e343-3f09-40aa-99cf-4a75380fd0d0 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:03.995084 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3e222-0c1f-4df1-9f57-fc1d6659e665 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:03.995728 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3e222-0c1f-4df1-9f57-fc1d6659e665 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:03.995998 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3e222-0c1f-4df1-9f57-fc1d6659e665 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:03.996275 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3e222-0c1f-4df1-9f57-fc1d6659e665 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:04.014849 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d281c0-d8b2-465d-9fe7-23125736e031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:04.018229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d281c0-d8b2-465d-9fe7-23125736e031 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:04.018229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d281c0-d8b2-465d-9fe7-23125736e031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:04.018229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d281c0-d8b2-465d-9fe7-23125736e031 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:04.018229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d281c0-d8b2-465d-9fe7-23125736e031 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:04.024652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d281c0-d8b2-465d-9fe7-23125736e031 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:04.093739 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3e222-0c1f-4df1-9f57-fc1d6659e665 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:04.096394 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3e222-0c1f-4df1-9f57-fc1d6659e665 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:04.120208 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 826/1636] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:04.169091 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 811/1637] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:02:03 2022] POST /identity/v3/users => generated 309 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:04.170419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3e222-0c1f-4df1-9f57-fc1d6659e665 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:04.185730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3e222-0c1f-4df1-9f57-fc1d6659e665 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:04.190592 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d976ccd-c645-4762-9742-7d99373b34be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:04.191792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d976ccd-c645-4762-9742-7d99373b34be admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:04.192192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d976ccd-c645-4762-9742-7d99373b34be admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:04.193288 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d976ccd-c645-4762-9742-7d99373b34be admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:04.193288 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d976ccd-c645-4762-9742-7d99373b34be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:04.196383 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d976ccd-c645-4762-9742-7d99373b34be admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:04.214668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d281c0-d8b2-465d-9fe7-23125736e031 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:04.225076 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 827/1638] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:04.236873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d281c0-d8b2-465d-9fe7-23125736e031 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:04.252192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbef9d8-c5a4-485a-8be1-2de7da14a29e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:04.259489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbef9d8-c5a4-485a-8be1-2de7da14a29e admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:04.259489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbef9d8-c5a4-485a-8be1-2de7da14a29e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:04.259489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbef9d8-c5a4-485a-8be1-2de7da14a29e admin admin] PATH_INFO: `/v3/projects/b28ae2954fff4efa8cc564a8ad0a7396/users/b8d8c60d2e234a7981245f507986bb65/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:04.288020 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbef9d8-c5a4-485a-8be1-2de7da14a29e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28ae2954fff4efa8cc564a8ad0a7396, user_id=b8d8c60d2e234a7981245f507986bb65, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:04.292140 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbef9d8-c5a4-485a-8be1-2de7da14a29e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:04.433684 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 812/1639] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:04 2022] PUT /identity/v3/projects/b28ae2954fff4efa8cc564a8ad0a7396/users/b8d8c60d2e234a7981245f507986bb65/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:02:04.435790 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d976ccd-c645-4762-9742-7d99373b34be admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:04.447325 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d976ccd-c645-4762-9742-7d99373b34be admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:04.532050 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d73b1d-5e21-4a3c-b2bd-085d91477770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:04.532873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d73b1d-5e21-4a3c-b2bd-085d91477770 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:04.533406 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d73b1d-5e21-4a3c-b2bd-085d91477770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:04.534427 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d73b1d-5e21-4a3c-b2bd-085d91477770 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:04.535448 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d73b1d-5e21-4a3c-b2bd-085d91477770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:04.542174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d73b1d-5e21-4a3c-b2bd-085d91477770 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:04.574518 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 828/1640] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:04.580548 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbef9d8-c5a4-485a-8be1-2de7da14a29e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:04.601570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbef9d8-c5a4-485a-8be1-2de7da14a29e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:04.607941 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee1f8a-5cb9-4ab7-9ae8-9d530f1fde95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:04.608814 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee1f8a-5cb9-4ab7-9ae8-9d530f1fde95 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:04.610174 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee1f8a-5cb9-4ab7-9ae8-9d530f1fde95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:04.610174 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee1f8a-5cb9-4ab7-9ae8-9d530f1fde95 admin admin] PATH_INFO: `/v3/projects/b28ae2954fff4efa8cc564a8ad0a7396/users/b8d8c60d2e234a7981245f507986bb65/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:04.612481 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee1f8a-5cb9-4ab7-9ae8-9d530f1fde95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b28ae2954fff4efa8cc564a8ad0a7396, user_id=b8d8c60d2e234a7981245f507986bb65, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:04.615812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ee1f8a-5cb9-4ab7-9ae8-9d530f1fde95 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:04.636588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 813/1641] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:04 2022] PUT /identity/v3/projects/b28ae2954fff4efa8cc564a8ad0a7396/users/b8d8c60d2e234a7981245f507986bb65/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:05.736784 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:05.945945 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d73b1d-5e21-4a3c-b2bd-085d91477770 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:05.948233 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-34d73b1d-5e21-4a3c-b2bd-085d91477770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:05.974602 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d73b1d-5e21-4a3c-b2bd-085d91477770 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:06.163367 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6a7f9f-3ad4-4c9e-88ee-74432a8de58f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:06.181348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a7f9f-3ad4-4c9e-88ee-74432a8de58f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:06.181348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a7f9f-3ad4-4c9e-88ee-74432a8de58f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:06.181348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6a7f9f-3ad4-4c9e-88ee-74432a8de58f admin admin] PATH_INFO: `/v3/projects/f0b86104bd93469eac8523901d2b2d31` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:06.181348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a7f9f-3ad4-4c9e-88ee-74432a8de58f admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0b86104bd93469eac8523901d2b2d31)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:06.181348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6a7f9f-3ad4-4c9e-88ee-74432a8de58f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:06.442398 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ff6a7f9f-3ad4-4c9e-88ee-74432a8de58f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0b86104bd93469eac8523901d2b2d31', 'request_id': 'req-ff6a7f9f-3ad4-4c9e-88ee-74432a8de58f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:06.560943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ff6a7f9f-3ad4-4c9e-88ee-74432a8de58f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0b86104bd93469eac8523901d2b2d31', 'request_id': 'req-ff6a7f9f-3ad4-4c9e-88ee-74432a8de58f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:06.572448 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ff6a7f9f-3ad4-4c9e-88ee-74432a8de58f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0b86104bd93469eac8523901d2b2d31', 'request_id': 'req-ff6a7f9f-3ad4-4c9e-88ee-74432a8de58f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:06.573997 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:06.621815 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ff6a7f9f-3ad4-4c9e-88ee-74432a8de58f admin admin] The token cache is being invalidate because project f0b86104bd93469eac8523901d2b2d31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:06.622109 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ff6a7f9f-3ad4-4c9e-88ee-74432a8de58f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:06.631385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ff6a7f9f-3ad4-4c9e-88ee-74432a8de58f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:06.631385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 829/1642] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:05 2022] DELETE /identity/v3/projects/f0b86104bd93469eac8523901d2b2d31 => generated 0 bytes in 682 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:06.635032 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee1f8a-5cb9-4ab7-9ae8-9d530f1fde95 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:06.642006 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e2ee1f8a-5cb9-4ab7-9ae8-9d530f1fde95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:06.651297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73af8d8-5e98-4d4b-adb0-d74681469c96 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:06.654737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:06.655386 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73af8d8-5e98-4d4b-adb0-d74681469c96 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:06.655386 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73af8d8-5e98-4d4b-adb0-d74681469c96 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:06.661994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 830/1643] 10.222.0.59 () {54 vars in 962 bytes} [Tue Sep 13 20:02:06 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:02:06.663635 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ee1f8a-5cb9-4ab7-9ae8-9d530f1fde95 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:06.676705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4629c-28aa-4845-9e32-cd8fdbc87915 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:06.677725 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4629c-28aa-4845-9e32-cd8fdbc87915 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:06.678172 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac4629c-28aa-4845-9e32-cd8fdbc87915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:06.730369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9ac4629c-28aa-4845-9e32-cd8fdbc87915 None None] MFA Rules not processed for user `3919b24291f54df99a9da0f5d3164ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:06.732081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9ac4629c-28aa-4845-9e32-cd8fdbc87915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:06.788279 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817a6b14-ccdc-4e63-ad2e-0a9e121723bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:06.790136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a6b14-ccdc-4e63-ad2e-0a9e121723bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:06.790914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a6b14-ccdc-4e63-ad2e-0a9e121723bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:06.790914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817a6b14-ccdc-4e63-ad2e-0a9e121723bc admin admin] PATH_INFO: `/v3/users/e07f0061e8d14693a3c4bbe36259b922` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:06.798430 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a6b14-ccdc-4e63-ad2e-0a9e121723bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e07f0061e8d14693a3c4bbe36259b922)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:06.799866 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817a6b14-ccdc-4e63-ad2e-0a9e121723bc admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:06.908345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 831/1644] 10.222.0.59 () {58 vars in 1059 bytes} [Tue Sep 13 20:02:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:02:06.914665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f6f13-5160-47e9-915a-e180c1754f0e None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:06.915097 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f6f13-5160-47e9-915a-e180c1754f0e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:06.915461 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f6f13-5160-47e9-915a-e180c1754f0e None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:06.917256 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 832/1645] 10.222.0.59 () {54 vars in 912 bytes} [Tue Sep 13 20:02:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 20:02:06.928057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abad00c-b74d-475b-ba64-fc907719d3d4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:06.928444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abad00c-b74d-475b-ba64-fc907719d3d4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:06.928822 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abad00c-b74d-475b-ba64-fc907719d3d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:06.974335 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7abad00c-b74d-475b-ba64-fc907719d3d4 None None] MFA Rules not processed for user `3919b24291f54df99a9da0f5d3164ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:06.978993 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7abad00c-b74d-475b-ba64-fc907719d3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:07.002937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 833/1646] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Sep 13 20:02:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:02:07.021369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abad00c-b74d-475b-ba64-fc907719d3d4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:07.024860 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7abad00c-b74d-475b-ba64-fc907719d3d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:07.137371 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-817a6b14-ccdc-4e63-ad2e-0a9e121723bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e07f0061e8d14693a3c4bbe36259b922'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:07.197960 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abad00c-b74d-475b-ba64-fc907719d3d4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:07.217135 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ebd36-fbb9-4b8b-b488-f9603c4fe0ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:07.217135 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ebd36-fbb9-4b8b-b488-f9603c4fe0ea service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:07.217135 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ebd36-fbb9-4b8b-b488-f9603c4fe0ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:07.217135 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ebd36-fbb9-4b8b-b488-f9603c4fe0ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:07.233928 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-817a6b14-ccdc-4e63-ad2e-0a9e121723bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e07f0061e8d14693a3c4bbe36259b922'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:07.244240 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ebd36-fbb9-4b8b-b488-f9603c4fe0ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:07.246482 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ebd36-fbb9-4b8b-b488-f9603c4fe0ea service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:07.269327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-817a6b14-ccdc-4e63-ad2e-0a9e121723bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e07f0061e8d14693a3c4bbe36259b922'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:07.270543 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-817a6b14-ccdc-4e63-ad2e-0a9e121723bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e07f0061e8d14693a3c4bbe36259b922'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:07.297445 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 834/1647] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:02:07.303092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-817a6b14-ccdc-4e63-ad2e-0a9e121723bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e07f0061e8d14693a3c4bbe36259b922'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:07.327990 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 814/1648] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:06 2022] DELETE /identity/v3/users/e07f0061e8d14693a3c4bbe36259b922 => generated 0 bytes in 694 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:08.838253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ebd36-fbb9-4b8b-b488-f9603c4fe0ea service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:08.860907 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ebd36-fbb9-4b8b-b488-f9603c4fe0ea service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:08.991054 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bf4dbf-bf0e-4f2e-ab9b-111e23d5aa75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:08.991880 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf4dbf-bf0e-4f2e-ab9b-111e23d5aa75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:08.992243 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf4dbf-bf0e-4f2e-ab9b-111e23d5aa75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:08.992673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bf4dbf-bf0e-4f2e-ab9b-111e23d5aa75 admin admin] PATH_INFO: `/v3/projects/194b16cd94fa48708ba5ddb68a7182a0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:08.993934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf4dbf-bf0e-4f2e-ab9b-111e23d5aa75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=194b16cd94fa48708ba5ddb68a7182a0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:08.997012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bf4dbf-bf0e-4f2e-ab9b-111e23d5aa75 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:09.054919 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:09.193074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-28bf4dbf-bf0e-4f2e-ab9b-111e23d5aa75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '194b16cd94fa48708ba5ddb68a7182a0', 'request_id': 'req-28bf4dbf-bf0e-4f2e-ab9b-111e23d5aa75'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:09.317784 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-28bf4dbf-bf0e-4f2e-ab9b-111e23d5aa75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '194b16cd94fa48708ba5ddb68a7182a0', 'request_id': 'req-28bf4dbf-bf0e-4f2e-ab9b-111e23d5aa75'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:09.328460 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-28bf4dbf-bf0e-4f2e-ab9b-111e23d5aa75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '194b16cd94fa48708ba5ddb68a7182a0', 'request_id': 'req-28bf4dbf-bf0e-4f2e-ab9b-111e23d5aa75'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:09.363156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-28bf4dbf-bf0e-4f2e-ab9b-111e23d5aa75 admin admin] The token cache is being invalidate because project 194b16cd94fa48708ba5ddb68a7182a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:09.366090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-28bf4dbf-bf0e-4f2e-ab9b-111e23d5aa75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:09.366090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-28bf4dbf-bf0e-4f2e-ab9b-111e23d5aa75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:09.373024 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 835/1649] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:08 2022] DELETE /identity/v3/projects/194b16cd94fa48708ba5ddb68a7182a0 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:09.378514 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d1414-ef76-41e9-8d82-f2cca9e3f2a7 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:09.379463 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d1414-ef76-41e9-8d82-f2cca9e3f2a7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:09.380370 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0d1414-ef76-41e9-8d82-f2cca9e3f2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:09.425719 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-6f0d1414-ef76-41e9-8d82-f2cca9e3f2a7 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:09.430332 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6f0d1414-ef76-41e9-8d82-f2cca9e3f2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:09.542233 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 815/1650] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:09.551775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037857b5-82fe-4203-866b-12168a9d0e4e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:09.557671 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037857b5-82fe-4203-866b-12168a9d0e4e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:09.557671 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037857b5-82fe-4203-866b-12168a9d0e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:09.615152 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-037857b5-82fe-4203-866b-12168a9d0e4e None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:09.619659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-037857b5-82fe-4203-866b-12168a9d0e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:09.647530 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 836/1651] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:09.657012 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d1414-ef76-41e9-8d82-f2cca9e3f2a7 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:09.671855 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0d1414-ef76-41e9-8d82-f2cca9e3f2a7 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:09.679894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b30173-5b13-4e50-a701-adca2bdaadda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:09.680809 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b30173-5b13-4e50-a701-adca2bdaadda admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:09.681098 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b30173-5b13-4e50-a701-adca2bdaadda admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:09.681376 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b30173-5b13-4e50-a701-adca2bdaadda admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:09.682138 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b30173-5b13-4e50-a701-adca2bdaadda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:02:09.682395 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b30173-5b13-4e50-a701-adca2bdaadda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:09.685456 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b30173-5b13-4e50-a701-adca2bdaadda admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:09.725617 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 816/1652] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:02:09.730112 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037857b5-82fe-4203-866b-12168a9d0e4e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:09.741014 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037857b5-82fe-4203-866b-12168a9d0e4e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:09.746491 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3044e5-8d71-41a4-93b3-1b0eb7e6bef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:09.747161 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3044e5-8d71-41a4-93b3-1b0eb7e6bef5 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:09.757970 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3044e5-8d71-41a4-93b3-1b0eb7e6bef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:09.764624 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3044e5-8d71-41a4-93b3-1b0eb7e6bef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:09.764624 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3044e5-8d71-41a4-93b3-1b0eb7e6bef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:09.764624 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3044e5-8d71-41a4-93b3-1b0eb7e6bef5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:09.939560 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 837/1653] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:02:09 2022] POST /identity/v3/projects => generated 369 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:02:09.943745 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b30173-5b13-4e50-a701-adca2bdaadda admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:09.959282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b30173-5b13-4e50-a701-adca2bdaadda admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:09.969817 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:10.093628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b357b-f045-4854-bfaa-8739250f9af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:10.094297 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b357b-f045-4854-bfaa-8739250f9af2 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:10.094588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b357b-f045-4854-bfaa-8739250f9af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:10.094870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b357b-f045-4854-bfaa-8739250f9af2 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:10.095530 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b357b-f045-4854-bfaa-8739250f9af2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:10.098848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b357b-f045-4854-bfaa-8739250f9af2 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:10.270250 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 817/1654] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:02:09 2022] POST /identity/v3/users => generated 285 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:10.273972 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3044e5-8d71-41a4-93b3-1b0eb7e6bef5 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:10.285383 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3044e5-8d71-41a4-93b3-1b0eb7e6bef5 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:10.303086 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f0042-17f5-44d7-8c9e-ea1e908e487e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:10.303919 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f0042-17f5-44d7-8c9e-ea1e908e487e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:10.304970 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f0042-17f5-44d7-8c9e-ea1e908e487e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:10.305341 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f0042-17f5-44d7-8c9e-ea1e908e487e admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:10.306353 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f0042-17f5-44d7-8c9e-ea1e908e487e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:10.309599 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f0042-17f5-44d7-8c9e-ea1e908e487e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:10.327661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 838/1655] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:10.327802 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b357b-f045-4854-bfaa-8739250f9af2 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:10.339586 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b357b-f045-4854-bfaa-8739250f9af2 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:10.346025 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c2fe6-4f22-47f8-b07e-f69d33a8731b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:10.347074 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c2fe6-4f22-47f8-b07e-f69d33a8731b admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:10.347074 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c2fe6-4f22-47f8-b07e-f69d33a8731b admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:10.347592 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c2fe6-4f22-47f8-b07e-f69d33a8731b admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:10.348280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c2fe6-4f22-47f8-b07e-f69d33a8731b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:10.351354 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c2fe6-4f22-47f8-b07e-f69d33a8731b admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:10.367190 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 818/1656] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:02:10.377493 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f0042-17f5-44d7-8c9e-ea1e908e487e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:10.393602 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f0042-17f5-44d7-8c9e-ea1e908e487e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:10.405479 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28142bf-7a75-4e58-ad16-b645e2e728e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:10.406359 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28142bf-7a75-4e58-ad16-b645e2e728e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:10.407437 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28142bf-7a75-4e58-ad16-b645e2e728e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:10.407813 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28142bf-7a75-4e58-ad16-b645e2e728e7 admin admin] PATH_INFO: `/v3/projects/81460855e0c84ee29ee289fd400d9224/users/224820dde5474f45b34fea4f8d3ea393/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:10.435682 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28142bf-7a75-4e58-ad16-b645e2e728e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81460855e0c84ee29ee289fd400d9224, user_id=224820dde5474f45b34fea4f8d3ea393, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:10.441150 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28142bf-7a75-4e58-ad16-b645e2e728e7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:10.565149 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 839/1657] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:10 2022] PUT /identity/v3/projects/81460855e0c84ee29ee289fd400d9224/users/224820dde5474f45b34fea4f8d3ea393/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:10.566771 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93079bad-1f58-47c0-a05a-a376b46e3ecb None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:10.567782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93079bad-1f58-47c0-a05a-a376b46e3ecb None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:10.568561 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93079bad-1f58-47c0-a05a-a376b46e3ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:10.629522 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2780bdf-de70-4ca6-8b4b-11eac64c2c62 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:10.629861 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2780bdf-de70-4ca6-8b4b-11eac64c2c62 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:10.630144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2780bdf-de70-4ca6-8b4b-11eac64c2c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:10.641897 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-93079bad-1f58-47c0-a05a-a376b46e3ecb None None] MFA Rules not processed for user `224820dde5474f45b34fea4f8d3ea393`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:10.647776 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-93079bad-1f58-47c0-a05a-a376b46e3ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:10.694050 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d2780bdf-de70-4ca6-8b4b-11eac64c2c62 None None] MFA Rules not processed for user `b8d8c60d2e234a7981245f507986bb65`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:10.698222 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d2780bdf-de70-4ca6-8b4b-11eac64c2c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:10.860519 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 819/1658] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:10 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:10.862180 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93079bad-1f58-47c0-a05a-a376b46e3ecb None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:10.979526 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 840/1659] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:10 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:11.066752 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93079bad-1f58-47c0-a05a-a376b46e3ecb None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:11.091021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebeacba-3d80-473a-b368-3357048e98d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:11.091021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeacba-3d80-473a-b368-3357048e98d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:11.091021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeacba-3d80-473a-b368-3357048e98d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:11.091021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebeacba-3d80-473a-b368-3357048e98d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:11.091332 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebeacba-3d80-473a-b368-3357048e98d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:11.091332 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebeacba-3d80-473a-b368-3357048e98d9 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:11.205584 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 820/1660] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:02:10 2022] POST /identity/v3/projects => generated 369 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:11.210036 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2780bdf-de70-4ca6-8b4b-11eac64c2c62 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:11.228928 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2780bdf-de70-4ca6-8b4b-11eac64c2c62 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:11.331847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=6,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:11.364718 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d079a-dbc4-497f-828c-56fc1622d672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:11.365476 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d079a-dbc4-497f-828c-56fc1622d672 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:11.365810 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d079a-dbc4-497f-828c-56fc1622d672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:11.376067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876d079a-dbc4-497f-828c-56fc1622d672 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:11.376067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d079a-dbc4-497f-828c-56fc1622d672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:11.376067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876d079a-dbc4-497f-828c-56fc1622d672 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:11.467570 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 841/1661] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:02:11 2022] POST /identity/v3/users => generated 291 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:11.471239 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebeacba-3d80-473a-b368-3357048e98d9 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:11.476786 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:11.487332 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebeacba-3d80-473a-b368-3357048e98d9 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:11.501094 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c7005-6cc0-4c80-94c5-4d18f4fc0344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:11.501798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c7005-6cc0-4c80-94c5-4d18f4fc0344 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:11.502078 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c7005-6cc0-4c80-94c5-4d18f4fc0344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:11.502351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452c7005-6cc0-4c80-94c5-4d18f4fc0344 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:11.503010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c7005-6cc0-4c80-94c5-4d18f4fc0344 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:11.504643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452c7005-6cc0-4c80-94c5-4d18f4fc0344 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:11.532238 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 821/1662] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:11.536398 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d079a-dbc4-497f-828c-56fc1622d672 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:11.550189 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876d079a-dbc4-497f-828c-56fc1622d672 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:11.567155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852dc17-edc5-438c-932c-d73832a20377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:11.568095 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852dc17-edc5-438c-932c-d73832a20377 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:11.568378 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852dc17-edc5-438c-932c-d73832a20377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:11.568651 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b852dc17-edc5-438c-932c-d73832a20377 admin admin] PATH_INFO: `/v3/projects/038916eeea614453bcc5c4827ae8112b/users/01562fada1564828ba89c5d024f0a966/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:11.603475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852dc17-edc5-438c-932c-d73832a20377 admin admin] RBAC: Authorizing `identity:create_grant(project_id=038916eeea614453bcc5c4827ae8112b, user_id=01562fada1564828ba89c5d024f0a966, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:11.606282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b852dc17-edc5-438c-932c-d73832a20377 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:11.707662 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 842/1663] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:11 2022] PUT /identity/v3/projects/038916eeea614453bcc5c4827ae8112b/users/01562fada1564828ba89c5d024f0a966/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:11.711565 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c7005-6cc0-4c80-94c5-4d18f4fc0344 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:11.729927 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452c7005-6cc0-4c80-94c5-4d18f4fc0344 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:11.893791 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970100a9-08ed-4278-af48-754cb2d50618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:11.894531 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970100a9-08ed-4278-af48-754cb2d50618 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:11.894907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970100a9-08ed-4278-af48-754cb2d50618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:11.895076 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970100a9-08ed-4278-af48-754cb2d50618 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:11.896258 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970100a9-08ed-4278-af48-754cb2d50618 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:11.897356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970100a9-08ed-4278-af48-754cb2d50618 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:11.924383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 822/1664] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:11 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:11.929176 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852dc17-edc5-438c-932c-d73832a20377 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:11.948693 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b852dc17-edc5-438c-932c-d73832a20377 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:11.976243 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06636b7d-002b-4e3f-a025-02e2db3cbe7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:11.977180 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06636b7d-002b-4e3f-a025-02e2db3cbe7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:11.977580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06636b7d-002b-4e3f-a025-02e2db3cbe7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:11.977898 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06636b7d-002b-4e3f-a025-02e2db3cbe7e admin admin] PATH_INFO: `/v3/projects/038916eeea614453bcc5c4827ae8112b/users/01562fada1564828ba89c5d024f0a966/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:11.996256 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06636b7d-002b-4e3f-a025-02e2db3cbe7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=038916eeea614453bcc5c4827ae8112b, user_id=01562fada1564828ba89c5d024f0a966, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:12.002901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06636b7d-002b-4e3f-a025-02e2db3cbe7e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:12.038817 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 843/1665] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:11 2022] PUT /identity/v3/projects/038916eeea614453bcc5c4827ae8112b/users/01562fada1564828ba89c5d024f0a966/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:12.041005 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a86b9b-b505-413a-beb9-84cd1a8d4dfb None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:12.041293 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a86b9b-b505-413a-beb9-84cd1a8d4dfb None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:12.041568 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a86b9b-b505-413a-beb9-84cd1a8d4dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:12.103702 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-b8a86b9b-b505-413a-beb9-84cd1a8d4dfb None None] MFA Rules not processed for user `01562fada1564828ba89c5d024f0a966`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:12.105411 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b8a86b9b-b505-413a-beb9-84cd1a8d4dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:12.281116 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 823/1666] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:12 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:12.296850 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06636b7d-002b-4e3f-a025-02e2db3cbe7e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:12.298966 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-06636b7d-002b-4e3f-a025-02e2db3cbe7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:12.436211 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06636b7d-002b-4e3f-a025-02e2db3cbe7e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:12.448180 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505b5ca-321b-44ac-a204-618f09360225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:12.449160 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505b5ca-321b-44ac-a204-618f09360225 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:12.449521 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505b5ca-321b-44ac-a204-618f09360225 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:12.449897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505b5ca-321b-44ac-a204-618f09360225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:12.474574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505b5ca-321b-44ac-a204-618f09360225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:12.476302 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505b5ca-321b-44ac-a204-618f09360225 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:12.489041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 844/1667] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:12 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:12.670844 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a86b9b-b505-413a-beb9-84cd1a8d4dfb None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:12.670951 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b5757-3e60-4863-a580-8e8c3873ef32 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:12.670951 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b5757-3e60-4863-a580-8e8c3873ef32 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:12.670951 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3b5757-3e60-4863-a580-8e8c3873ef32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:12.671146 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b8a86b9b-b505-413a-beb9-84cd1a8d4dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:12.689112 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a86b9b-b505-413a-beb9-84cd1a8d4dfb None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:12.694437 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1ccbf-f463-4546-b4b7-aef583d9b28a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:12.695636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1ccbf-f463-4546-b4b7-aef583d9b28a service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:12.699214 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1ccbf-f463-4546-b4b7-aef583d9b28a service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:12.699214 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b1ccbf-f463-4546-b4b7-aef583d9b28a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:12.759178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6e3b5757-3e60-4863-a580-8e8c3873ef32 None None] MFA Rules not processed for user `0851425d841946f49c73af574b818ace`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:12.761626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6e3b5757-3e60-4863-a580-8e8c3873ef32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:12.850727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1ccbf-f463-4546-b4b7-aef583d9b28a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:12.857138 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b1ccbf-f463-4546-b4b7-aef583d9b28a service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:12.891066 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 824/1668] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:12 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:12.988425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 845/1669] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:02:13.005551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1ccbf-f463-4546-b4b7-aef583d9b28a service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:13.007899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-32b1ccbf-f463-4546-b4b7-aef583d9b28a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:13.062170 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:13.215746 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b1ccbf-f463-4546-b4b7-aef583d9b28a service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:13.224080 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0767839-82e6-4880-9ca7-a3ea412c4271 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:13.225921 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0767839-82e6-4880-9ca7-a3ea412c4271 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:13.226208 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0767839-82e6-4880-9ca7-a3ea412c4271 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:13.227176 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0767839-82e6-4880-9ca7-a3ea412c4271 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:13.242573 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0767839-82e6-4880-9ca7-a3ea412c4271 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:13.245861 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0767839-82e6-4880-9ca7-a3ea412c4271 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:13.286067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 825/1670] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:13 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:15.107799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa6199-a3be-4a49-b739-587c6564a18a None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:15.109032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa6199-a3be-4a49-b739-587c6564a18a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:15.109473 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efa6199-a3be-4a49-b739-587c6564a18a None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:15.111475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 846/1671] 10.222.0.59 () {54 vars in 921 bytes} [Tue Sep 13 20:02:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:02:15.175310 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de506e1f-1491-469f-9631-719252f11e1c None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:15.176495 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de506e1f-1491-469f-9631-719252f11e1c None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:15.176971 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de506e1f-1491-469f-9631-719252f11e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:15.249821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-de506e1f-1491-469f-9631-719252f11e1c None None] MFA Rules not processed for user `89e7df5170c841abb449f3b4a547ec4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:15.262452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-de506e1f-1491-469f-9631-719252f11e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:15.514636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 826/1672] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Sep 13 20:02:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:15.647203 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa6199-a3be-4a49-b739-587c6564a18a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:15.649225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5efa6199-a3be-4a49-b739-587c6564a18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:15.683788 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efa6199-a3be-4a49-b739-587c6564a18a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:15.700102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122146d-29b4-4ef3-a39b-f6f9e6192ed4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e7df5170c841abb449f3b4a547ec4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:15.700935 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122146d-29b4-4ef3-a39b-f6f9e6192ed4 service placement] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:15.705317 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122146d-29b4-4ef3-a39b-f6f9e6192ed4 service placement] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:15.705317 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122146d-29b4-4ef3-a39b-f6f9e6192ed4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:15.718414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122146d-29b4-4ef3-a39b-f6f9e6192ed4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:15.721370 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122146d-29b4-4ef3-a39b-f6f9e6192ed4 service placement] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:15.748270 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 847/1673] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:15.890794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de506e1f-1491-469f-9631-719252f11e1c None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:15.893042 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-de506e1f-1491-469f-9631-719252f11e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:15.910709 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbef4a-34c5-415c-bf6b-ddf0d143d8a1 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:15.911703 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbef4a-34c5-415c-bf6b-ddf0d143d8a1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:15.912279 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbbef4a-34c5-415c-bf6b-ddf0d143d8a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:15.945512 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:15.999880 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2cbbef4a-34c5-415c-bf6b-ddf0d143d8a1 None None] MFA Rules not processed for user `75a27959e4354f11bcf13a1d254a6b56`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:16.001431 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2cbbef4a-34c5-415c-bf6b-ddf0d143d8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:16.162240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de506e1f-1491-469f-9631-719252f11e1c None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:16.178430 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 848/1674] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:02:16.183932 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbef4a-34c5-415c-bf6b-ddf0d143d8a1 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:16.187215 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2cbbef4a-34c5-415c-bf6b-ddf0d143d8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:16.190456 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd19409-a35a-4d5d-9abc-2ef8179bfd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:16.191132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd19409-a35a-4d5d-9abc-2ef8179bfd38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:16.191688 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd19409-a35a-4d5d-9abc-2ef8179bfd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:16.191975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd19409-a35a-4d5d-9abc-2ef8179bfd38 admin admin] PATH_INFO: `/v3/users/e4abe8fc69ff469498a52394b02629f8` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:16.194946 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd19409-a35a-4d5d-9abc-2ef8179bfd38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e4abe8fc69ff469498a52394b02629f8)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:16.202953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd19409-a35a-4d5d-9abc-2ef8179bfd38 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:16.227985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbbef4a-34c5-415c-bf6b-ddf0d143d8a1 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:16.244831 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1879e277-e263-466a-9ec2-a42afbd7d9f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:16.245778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879e277-e263-466a-9ec2-a42afbd7d9f9 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:16.246876 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879e277-e263-466a-9ec2-a42afbd7d9f9 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:16.248600 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1879e277-e263-466a-9ec2-a42afbd7d9f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:16.270512 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879e277-e263-466a-9ec2-a42afbd7d9f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:16.270512 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1879e277-e263-466a-9ec2-a42afbd7d9f9 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:16.296057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 849/1675] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:16 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:02:16.495185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:16.547089 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1bd19409-a35a-4d5d-9abc-2ef8179bfd38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e4abe8fc69ff469498a52394b02629f8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:16.667936 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1bd19409-a35a-4d5d-9abc-2ef8179bfd38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e4abe8fc69ff469498a52394b02629f8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:16.693949 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1bd19409-a35a-4d5d-9abc-2ef8179bfd38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e4abe8fc69ff469498a52394b02629f8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:16.694922 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1bd19409-a35a-4d5d-9abc-2ef8179bfd38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e4abe8fc69ff469498a52394b02629f8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:16.711173 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1bd19409-a35a-4d5d-9abc-2ef8179bfd38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e4abe8fc69ff469498a52394b02629f8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:16.724190 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 827/1676] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:15 2022] DELETE /identity/v3/users/e4abe8fc69ff469498a52394b02629f8 => generated 0 bytes in 834 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:16.733774 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eedca1-d5e0-4b99-b8e5-012f5b54289a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:16.734194 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eedca1-d5e0-4b99-b8e5-012f5b54289a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:16.734474 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eedca1-d5e0-4b99-b8e5-012f5b54289a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:16.790356 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-27eedca1-d5e0-4b99-b8e5-012f5b54289a None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:16.791657 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-27eedca1-d5e0-4b99-b8e5-012f5b54289a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:16.965567 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 850/1677] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:17.019566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd19409-a35a-4d5d-9abc-2ef8179bfd38 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:17.021055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1bd19409-a35a-4d5d-9abc-2ef8179bfd38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:17.162064 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd19409-a35a-4d5d-9abc-2ef8179bfd38 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:17.167231 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8dcca4-ba0c-407f-ac6b-9e7f0b3adec0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:17.170402 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dcca4-ba0c-407f-ac6b-9e7f0b3adec0 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:17.170666 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dcca4-ba0c-407f-ac6b-9e7f0b3adec0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:17.172935 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dcca4-ba0c-407f-ac6b-9e7f0b3adec0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:17.190812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8dcca4-ba0c-407f-ac6b-9e7f0b3adec0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:17.194357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8dcca4-ba0c-407f-ac6b-9e7f0b3adec0 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:17.213453 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 828/1678] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:17.680655 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a50938-c58c-4553-a04e-01b527f0cf95 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:17.681857 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a50938-c58c-4553-a04e-01b527f0cf95 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:17.682355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a50938-c58c-4553-a04e-01b527f0cf95 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:17.688354 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 851/1679] 10.222.0.59 () {54 vars in 921 bytes} [Tue Sep 13 20:02:17 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:02:17.746033 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627dbe0-4264-486e-9c3a-c8e683e0981e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:17.746477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627dbe0-4264-486e-9c3a-c8e683e0981e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:17.746939 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9627dbe0-4264-486e-9c3a-c8e683e0981e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:17.783774 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-9627dbe0-4264-486e-9c3a-c8e683e0981e None None] MFA Rules not processed for user `89e7df5170c841abb449f3b4a547ec4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:17.787298 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9627dbe0-4264-486e-9c3a-c8e683e0981e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:17.933182 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 829/1680] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Sep 13 20:02:17 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:18.045412 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a50938-c58c-4553-a04e-01b527f0cf95 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:18.054616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-27a50938-c58c-4553-a04e-01b527f0cf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:18.124693 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a50938-c58c-4553-a04e-01b527f0cf95 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:18.138548 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30655f23-2ff8-4487-8dfb-1a042e8fc069 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e7df5170c841abb449f3b4a547ec4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:18.139418 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30655f23-2ff8-4487-8dfb-1a042e8fc069 service placement] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:18.142355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30655f23-2ff8-4487-8dfb-1a042e8fc069 service placement] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:18.143395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30655f23-2ff8-4487-8dfb-1a042e8fc069 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:18.179213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30655f23-2ff8-4487-8dfb-1a042e8fc069 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:18.180905 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30655f23-2ff8-4487-8dfb-1a042e8fc069 service placement] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:18.234849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 852/1681] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:18.422509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627dbe0-4264-486e-9c3a-c8e683e0981e None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:18.424100 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9627dbe0-4264-486e-9c3a-c8e683e0981e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:18.444799 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9627dbe0-4264-486e-9c3a-c8e683e0981e None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:18.451475 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c284a3-3076-4dfb-8ffd-489aa052598e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:18.452464 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c284a3-3076-4dfb-8ffd-489aa052598e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:18.452979 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c284a3-3076-4dfb-8ffd-489aa052598e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:18.453887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c284a3-3076-4dfb-8ffd-489aa052598e admin admin] PATH_INFO: `/v3/users/093fa7a93dd545c986542e16894d7a35` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:18.455633 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c284a3-3076-4dfb-8ffd-489aa052598e admin admin] RBAC: Authorizing `identity:delete_user(user_id=093fa7a93dd545c986542e16894d7a35)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:18.458810 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c284a3-3076-4dfb-8ffd-489aa052598e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:18.664919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:18.674915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-17c284a3-3076-4dfb-8ffd-489aa052598e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093fa7a93dd545c986542e16894d7a35'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:18.760075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-17c284a3-3076-4dfb-8ffd-489aa052598e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093fa7a93dd545c986542e16894d7a35'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:18.785642 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-17c284a3-3076-4dfb-8ffd-489aa052598e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093fa7a93dd545c986542e16894d7a35'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:18.791067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-17c284a3-3076-4dfb-8ffd-489aa052598e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093fa7a93dd545c986542e16894d7a35'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:18.821335 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-17c284a3-3076-4dfb-8ffd-489aa052598e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093fa7a93dd545c986542e16894d7a35'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:18.844859 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 830/1682] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:18 2022] DELETE /identity/v3/users/093fa7a93dd545c986542e16894d7a35 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:19.377879 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb699bc-88d1-43c0-bc21-1137b48c7305 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:19.378439 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb699bc-88d1-43c0-bc21-1137b48c7305 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:19.378439 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb699bc-88d1-43c0-bc21-1137b48c7305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:19.437605 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-fbb699bc-88d1-43c0-bc21-1137b48c7305 None None] MFA Rules not processed for user `148bba2e6a824ae7b3528b6db9ea141c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:19.438896 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fbb699bc-88d1-43c0-bc21-1137b48c7305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:19.492206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c284a3-3076-4dfb-8ffd-489aa052598e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:19.496335 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-17c284a3-3076-4dfb-8ffd-489aa052598e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:19.649413 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:19.673069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 853/1683] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:19.680450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb699bc-88d1-43c0-bc21-1137b48c7305 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:19.682248 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fbb699bc-88d1-43c0-bc21-1137b48c7305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:19.791218 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c284a3-3076-4dfb-8ffd-489aa052598e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:19.801806 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdee53d-378e-400a-b326-5bab2773fc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:19.802520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdee53d-378e-400a-b326-5bab2773fc6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:19.813314 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdee53d-378e-400a-b326-5bab2773fc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:19.813621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdee53d-378e-400a-b326-5bab2773fc6b admin admin] PATH_INFO: `/v3/projects/633c72adfdda4948a94d6b494d56ce44` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:19.816797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdee53d-378e-400a-b326-5bab2773fc6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=633c72adfdda4948a94d6b494d56ce44)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:19.819022 dv-cinder-828807-6-smb devstack@keystone.service[81555]: WARNING py.warnings [None req-afdee53d-378e-400a-b326-5bab2773fc6b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 13 20:02:19.819022 dv-cinder-828807-6-smb devstack@keystone.service[81555]: warnings.warn(msg) Sep 13 20:02:19.819022 dv-cinder-828807-6-smb devstack@keystone.service[81555]: Sep 13 20:02:19.822090 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdee53d-378e-400a-b326-5bab2773fc6b admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:19.925182 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb699bc-88d1-43c0-bc21-1137b48c7305 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:19.950514 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708ad19e-72fc-4aea-bf74-83fcdf1000a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:19.954774 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ad19e-72fc-4aea-bf74-83fcdf1000a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:19.955106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ad19e-72fc-4aea-bf74-83fcdf1000a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:19.955378 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708ad19e-72fc-4aea-bf74-83fcdf1000a2 admin admin] PATH_INFO: `/v3/projects/1365a5b2906d47398e6a007a3c29a263` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:19.963974 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ad19e-72fc-4aea-bf74-83fcdf1000a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1365a5b2906d47398e6a007a3c29a263)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:19.967075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-708ad19e-72fc-4aea-bf74-83fcdf1000a2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:20.106168 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-afdee53d-378e-400a-b326-5bab2773fc6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '633c72adfdda4948a94d6b494d56ce44', 'request_id': 'req-afdee53d-378e-400a-b326-5bab2773fc6b'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:20.120110 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-afdee53d-378e-400a-b326-5bab2773fc6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '633c72adfdda4948a94d6b494d56ce44', 'request_id': 'req-afdee53d-378e-400a-b326-5bab2773fc6b'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:20.153071 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-708ad19e-72fc-4aea-bf74-83fcdf1000a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1365a5b2906d47398e6a007a3c29a263', 'request_id': 'req-708ad19e-72fc-4aea-bf74-83fcdf1000a2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:20.154742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-afdee53d-378e-400a-b326-5bab2773fc6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '633c72adfdda4948a94d6b494d56ce44', 'request_id': 'req-afdee53d-378e-400a-b326-5bab2773fc6b'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:20.263131 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-afdee53d-378e-400a-b326-5bab2773fc6b admin admin] The token cache is being invalidate because project 633c72adfdda4948a94d6b494d56ce44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:20.265503 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-afdee53d-378e-400a-b326-5bab2773fc6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:20.266523 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-afdee53d-378e-400a-b326-5bab2773fc6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:20.275149 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 831/1684] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:19 2022] DELETE /identity/v3/projects/633c72adfdda4948a94d6b494d56ce44 => generated 0 bytes in 780 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:20.276585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3921acb-4d4a-4a71-853c-7bba31f6211d None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:20.286915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3921acb-4d4a-4a71-853c-7bba31f6211d None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:20.286915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3921acb-4d4a-4a71-853c-7bba31f6211d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:20.334744 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-f3921acb-4d4a-4a71-853c-7bba31f6211d None None] MFA Rules not processed for user `148bba2e6a824ae7b3528b6db9ea141c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:20.335972 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f3921acb-4d4a-4a71-853c-7bba31f6211d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:20.362844 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-708ad19e-72fc-4aea-bf74-83fcdf1000a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1365a5b2906d47398e6a007a3c29a263', 'request_id': 'req-708ad19e-72fc-4aea-bf74-83fcdf1000a2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:20.377456 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-708ad19e-72fc-4aea-bf74-83fcdf1000a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1365a5b2906d47398e6a007a3c29a263', 'request_id': 'req-708ad19e-72fc-4aea-bf74-83fcdf1000a2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:20.403838 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-708ad19e-72fc-4aea-bf74-83fcdf1000a2 admin admin] The token cache is being invalidate because project 1365a5b2906d47398e6a007a3c29a263 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:20.413581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-708ad19e-72fc-4aea-bf74-83fcdf1000a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:20.415888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-708ad19e-72fc-4aea-bf74-83fcdf1000a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:20.418768 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 854/1685] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:19 2022] DELETE /identity/v3/projects/1365a5b2906d47398e6a007a3c29a263 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:20.423068 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3c01d-964e-4587-be0e-d16ed111b445 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:20.425947 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3c01d-964e-4587-be0e-d16ed111b445 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:20.426250 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a3c01d-964e-4587-be0e-d16ed111b445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:20.461372 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:20.474504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-11a3c01d-964e-4587-be0e-d16ed111b445 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:20.477609 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 832/1686] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:20 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:20.482092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3921acb-4d4a-4a71-853c-7bba31f6211d None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:20.482196 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-11a3c01d-964e-4587-be0e-d16ed111b445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:20.482299 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f3921acb-4d4a-4a71-853c-7bba31f6211d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:20.629831 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3921acb-4d4a-4a71-853c-7bba31f6211d None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:20.641202 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851db184-bdaf-43c8-ae75-3bff8c03394a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:20.642394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851db184-bdaf-43c8-ae75-3bff8c03394a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:20.642889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851db184-bdaf-43c8-ae75-3bff8c03394a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:20.643367 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851db184-bdaf-43c8-ae75-3bff8c03394a admin admin] PATH_INFO: `/v3/users/224820dde5474f45b34fea4f8d3ea393` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:20.646254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851db184-bdaf-43c8-ae75-3bff8c03394a admin admin] RBAC: Authorizing `identity:delete_user(user_id=224820dde5474f45b34fea4f8d3ea393)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:20.652448 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851db184-bdaf-43c8-ae75-3bff8c03394a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:20.658733 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 855/1687] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:20.660032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3c01d-964e-4587-be0e-d16ed111b445 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:20.670918 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-11a3c01d-964e-4587-be0e-d16ed111b445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:20.700095 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a3c01d-964e-4587-be0e-d16ed111b445 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:20.708795 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e0cb95-37fd-41c6-8d26-77802fd3739e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:20.709582 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0cb95-37fd-41c6-8d26-77802fd3739e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:20.710006 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0cb95-37fd-41c6-8d26-77802fd3739e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:20.710443 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e0cb95-37fd-41c6-8d26-77802fd3739e admin admin] PATH_INFO: `/v3/users/b8d8c60d2e234a7981245f507986bb65` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:20.711769 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0cb95-37fd-41c6-8d26-77802fd3739e admin admin] RBAC: Authorizing `identity:delete_user(user_id=b8d8c60d2e234a7981245f507986bb65)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:20.714079 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e0cb95-37fd-41c6-8d26-77802fd3739e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:20.755013 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:20.889470 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-851db184-bdaf-43c8-ae75-3bff8c03394a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '224820dde5474f45b34fea4f8d3ea393'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:20.944965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-89e0cb95-37fd-41c6-8d26-77802fd3739e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b8d8c60d2e234a7981245f507986bb65'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:21.031090 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-851db184-bdaf-43c8-ae75-3bff8c03394a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '224820dde5474f45b34fea4f8d3ea393'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:21.059190 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-851db184-bdaf-43c8-ae75-3bff8c03394a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '224820dde5474f45b34fea4f8d3ea393'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:21.060976 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-851db184-bdaf-43c8-ae75-3bff8c03394a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '224820dde5474f45b34fea4f8d3ea393'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:21.075586 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-851db184-bdaf-43c8-ae75-3bff8c03394a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '224820dde5474f45b34fea4f8d3ea393'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:21.083878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 833/1688] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:20 2022] DELETE /identity/v3/users/224820dde5474f45b34fea4f8d3ea393 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:21.085347 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851db184-bdaf-43c8-ae75-3bff8c03394a admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:21.087281 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-851db184-bdaf-43c8-ae75-3bff8c03394a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:21.141318 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-89e0cb95-37fd-41c6-8d26-77802fd3739e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b8d8c60d2e234a7981245f507986bb65'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:21.162850 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-89e0cb95-37fd-41c6-8d26-77802fd3739e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b8d8c60d2e234a7981245f507986bb65'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:21.163839 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-89e0cb95-37fd-41c6-8d26-77802fd3739e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b8d8c60d2e234a7981245f507986bb65'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:21.181114 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-89e0cb95-37fd-41c6-8d26-77802fd3739e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b8d8c60d2e234a7981245f507986bb65'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:21.188164 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851db184-bdaf-43c8-ae75-3bff8c03394a admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:21.197265 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 856/1689] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:20 2022] DELETE /identity/v3/users/b8d8c60d2e234a7981245f507986bb65 => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:21.197265 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f4714-3a88-42b4-ac9b-44767b8eccdc None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:21.197265 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f4714-3a88-42b4-ac9b-44767b8eccdc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:21.197265 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0f4714-3a88-42b4-ac9b-44767b8eccdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:21.201438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d45cdc0-ef62-42cd-9706-4882e589e797 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:21.202609 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45cdc0-ef62-42cd-9706-4882e589e797 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:21.203104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45cdc0-ef62-42cd-9706-4882e589e797 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:21.203591 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d45cdc0-ef62-42cd-9706-4882e589e797 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:21.206696 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7d45cdc0-ef62-42cd-9706-4882e589e797 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:21.238893 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2e0f4714-3a88-42b4-ac9b-44767b8eccdc None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:21.240132 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2e0f4714-3a88-42b4-ac9b-44767b8eccdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:21.307649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45cdc0-ef62-42cd-9706-4882e589e797 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:21.312019 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d45cdc0-ef62-42cd-9706-4882e589e797 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:21.328572 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 834/1690] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:21 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:21.330246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef8fd0-2382-43bf-9a45-72e4191adaab None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:21.331605 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef8fd0-2382-43bf-9a45-72e4191adaab None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:21.332072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cef8fd0-2382-43bf-9a45-72e4191adaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:21.382857 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-5cef8fd0-2382-43bf-9a45-72e4191adaab None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:21.384163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5cef8fd0-2382-43bf-9a45-72e4191adaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:21.425057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 857/1691] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:21.429409 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f4714-3a88-42b4-ac9b-44767b8eccdc None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:21.444093 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:21.449906 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0f4714-3a88-42b4-ac9b-44767b8eccdc None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:21.465171 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8938e41-12f4-4a2c-b97d-2632e3468af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:21.465830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8938e41-12f4-4a2c-b97d-2632e3468af0 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:21.466111 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8938e41-12f4-4a2c-b97d-2632e3468af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:21.467214 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8938e41-12f4-4a2c-b97d-2632e3468af0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:21.472223 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8938e41-12f4-4a2c-b97d-2632e3468af0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:02:21.472707 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8938e41-12f4-4a2c-b97d-2632e3468af0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:21.481198 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8938e41-12f4-4a2c-b97d-2632e3468af0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:21.517517 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 858/1692] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:02:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:02:21.520737 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8938e41-12f4-4a2c-b97d-2632e3468af0 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:21.542386 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8938e41-12f4-4a2c-b97d-2632e3468af0 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:21.545137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 835/1693] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:21.554600 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773e5e8-e338-4e0c-bcf3-dd1b65eedf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:21.555540 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773e5e8-e338-4e0c-bcf3-dd1b65eedf20 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:21.555685 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773e5e8-e338-4e0c-bcf3-dd1b65eedf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:21.556324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2773e5e8-e338-4e0c-bcf3-dd1b65eedf20 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:21.556951 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773e5e8-e338-4e0c-bcf3-dd1b65eedf20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:21.559226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2773e5e8-e338-4e0c-bcf3-dd1b65eedf20 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:21.580791 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef8fd0-2382-43bf-9a45-72e4191adaab None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:21.585258 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5cef8fd0-2382-43bf-9a45-72e4191adaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:21.685630 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cef8fd0-2382-43bf-9a45-72e4191adaab None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:21.687462 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a10e8-0a99-4d73-9a06-cdeb13810c70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:21.691724 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a10e8-0a99-4d73-9a06-cdeb13810c70 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:21.692104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a10e8-0a99-4d73-9a06-cdeb13810c70 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:21.692447 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a10e8-0a99-4d73-9a06-cdeb13810c70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:21.693621 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 859/1694] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:02:21 2022] POST /identity/v3/projects => generated 379 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:21.694626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773e5e8-e338-4e0c-bcf3-dd1b65eedf20 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:21.712131 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a10e8-0a99-4d73-9a06-cdeb13810c70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:21.716790 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a10e8-0a99-4d73-9a06-cdeb13810c70 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:21.762190 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 836/1695] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:02:21.888512 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2773e5e8-e338-4e0c-bcf3-dd1b65eedf20 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:21.907459 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076b9b1-b15e-4f85-a78d-d4ab10aa9fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:21.908195 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076b9b1-b15e-4f85-a78d-d4ab10aa9fdc admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:21.908485 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076b9b1-b15e-4f85-a78d-d4ab10aa9fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:21.914573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3076b9b1-b15e-4f85-a78d-d4ab10aa9fdc admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:21.914573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076b9b1-b15e-4f85-a78d-d4ab10aa9fdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:21.914573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3076b9b1-b15e-4f85-a78d-d4ab10aa9fdc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:21.951752 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=6,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:22.077098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 860/1696] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:02:21 2022] POST /identity/v3/users => generated 290 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:22.078976 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a10e8-0a99-4d73-9a06-cdeb13810c70 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:22.096225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a10e8-0a99-4d73-9a06-cdeb13810c70 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:22.107216 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fa192-132f-4ddb-9d95-2e27eb2f5057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:22.108067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fa192-132f-4ddb-9d95-2e27eb2f5057 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:22.108560 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fa192-132f-4ddb-9d95-2e27eb2f5057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:22.108940 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59fa192-132f-4ddb-9d95-2e27eb2f5057 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:22.111674 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59fa192-132f-4ddb-9d95-2e27eb2f5057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:22.113582 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59fa192-132f-4ddb-9d95-2e27eb2f5057 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:22.142820 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 837/1697] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:22.144589 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076b9b1-b15e-4f85-a78d-d4ab10aa9fdc admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:22.159259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3076b9b1-b15e-4f85-a78d-d4ab10aa9fdc admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:22.167771 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbf1d5-b9ea-4025-8da1-19e17d7a9913 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:22.169084 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbf1d5-b9ea-4025-8da1-19e17d7a9913 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:22.169590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbf1d5-b9ea-4025-8da1-19e17d7a9913 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:22.170124 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbf1d5-b9ea-4025-8da1-19e17d7a9913 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:22.171289 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbf1d5-b9ea-4025-8da1-19e17d7a9913 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:22.173167 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbf1d5-b9ea-4025-8da1-19e17d7a9913 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:22.201430 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 861/1698] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:22.201559 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fa192-132f-4ddb-9d95-2e27eb2f5057 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:22.201635 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbf1d5-b9ea-4025-8da1-19e17d7a9913 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:22.201724 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e59fa192-132f-4ddb-9d95-2e27eb2f5057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:22.214563 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbf1d5-b9ea-4025-8da1-19e17d7a9913 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:22.228108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59fa192-132f-4ddb-9d95-2e27eb2f5057 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:22.240366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df03ab-4acc-4e99-aea3-12fab39b8d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:22.241009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df03ab-4acc-4e99-aea3-12fab39b8d30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:22.241292 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df03ab-4acc-4e99-aea3-12fab39b8d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:22.241569 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6df03ab-4acc-4e99-aea3-12fab39b8d30 admin admin] PATH_INFO: `/v3/projects/b28ae2954fff4efa8cc564a8ad0a7396` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:22.243414 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df03ab-4acc-4e99-aea3-12fab39b8d30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b28ae2954fff4efa8cc564a8ad0a7396)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:22.244111 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8b2286-ed69-4785-a98a-4cf0f04cdff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:22.249118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b2286-ed69-4785-a98a-4cf0f04cdff9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:22.249669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6df03ab-4acc-4e99-aea3-12fab39b8d30 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:22.250038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b2286-ed69-4785-a98a-4cf0f04cdff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:22.252452 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8b2286-ed69-4785-a98a-4cf0f04cdff9 admin admin] PATH_INFO: `/v3/projects/55d8a8af39de47a382d2a43e1120a438/users/e0a4a5401f734432aade04e5d86a8e28/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:22.281857 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b2286-ed69-4785-a98a-4cf0f04cdff9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55d8a8af39de47a382d2a43e1120a438, user_id=e0a4a5401f734432aade04e5d86a8e28, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:22.286338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8b2286-ed69-4785-a98a-4cf0f04cdff9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:22.384775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 862/1699] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:22 2022] PUT /identity/v3/projects/55d8a8af39de47a382d2a43e1120a438/users/e0a4a5401f734432aade04e5d86a8e28/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:22.387075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79969b-c18c-429b-9ef2-a2aa2985da77 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:22.387553 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79969b-c18c-429b-9ef2-a2aa2985da77 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:22.387996 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d79969b-c18c-429b-9ef2-a2aa2985da77 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:22.390809 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 863/1700] 10.222.0.59 () {54 vars in 912 bytes} [Tue Sep 13 20:02:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:02:22.400387 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc71c81-d9c3-4d0f-95c4-83e1fdafc11e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:22.402097 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc71c81-d9c3-4d0f-95c4-83e1fdafc11e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:22.405087 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc71c81-d9c3-4d0f-95c4-83e1fdafc11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:22.478530 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:22.495568 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a6df03ab-4acc-4e99-aea3-12fab39b8d30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b28ae2954fff4efa8cc564a8ad0a7396', 'request_id': 'req-a6df03ab-4acc-4e99-aea3-12fab39b8d30'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:22.498721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0bc71c81-d9c3-4d0f-95c4-83e1fdafc11e None None] MFA Rules not processed for user `e0a4a5401f734432aade04e5d86a8e28`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:22.502113 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0bc71c81-d9c3-4d0f-95c4-83e1fdafc11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:22.510550 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a6df03ab-4acc-4e99-aea3-12fab39b8d30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b28ae2954fff4efa8cc564a8ad0a7396', 'request_id': 'req-a6df03ab-4acc-4e99-aea3-12fab39b8d30'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:22.535200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a6df03ab-4acc-4e99-aea3-12fab39b8d30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b28ae2954fff4efa8cc564a8ad0a7396', 'request_id': 'req-a6df03ab-4acc-4e99-aea3-12fab39b8d30'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:22.624830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 864/1701] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:22.624830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577e220-5c34-4b1a-95b6-e0d866688382 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:22.624830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577e220-5c34-4b1a-95b6-e0d866688382 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:22.624830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8577e220-5c34-4b1a-95b6-e0d866688382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:22.647654 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a6df03ab-4acc-4e99-aea3-12fab39b8d30 admin admin] The token cache is being invalidate because project b28ae2954fff4efa8cc564a8ad0a7396 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:22.648091 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a6df03ab-4acc-4e99-aea3-12fab39b8d30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:22.648668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a6df03ab-4acc-4e99-aea3-12fab39b8d30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:22.650221 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8577e220-5c34-4b1a-95b6-e0d866688382 None None] MFA Rules not processed for user `b86b85c457d84ac99359ac93add704d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:22.651855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8577e220-5c34-4b1a-95b6-e0d866688382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:22.655005 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 838/1702] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:22 2022] DELETE /identity/v3/projects/b28ae2954fff4efa8cc564a8ad0a7396 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:22.655900 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df03ab-4acc-4e99-aea3-12fab39b8d30 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:22.658885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a6df03ab-4acc-4e99-aea3-12fab39b8d30 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:22.726090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 865/1703] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Sep 13 20:02:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:22.728633 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68e071-785f-43b8-85d4-a82525ad2283 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:22.729134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68e071-785f-43b8-85d4-a82525ad2283 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:22.730120 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68e071-785f-43b8-85d4-a82525ad2283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:22.763745 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8c68e071-785f-43b8-85d4-a82525ad2283 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:22.765787 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8c68e071-785f-43b8-85d4-a82525ad2283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:22.780582 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 866/1704] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:22.781931 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68e071-785f-43b8-85d4-a82525ad2283 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:22.783138 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6df03ab-4acc-4e99-aea3-12fab39b8d30 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:22.789288 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8c68e071-785f-43b8-85d4-a82525ad2283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:22.793046 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d55ef2-ca09-4fb1-bed5-58dfc34a89fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:22.793666 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d55ef2-ca09-4fb1-bed5-58dfc34a89fc admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:22.794042 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d55ef2-ca09-4fb1-bed5-58dfc34a89fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:22.794571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d55ef2-ca09-4fb1-bed5-58dfc34a89fc admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:22.795724 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d55ef2-ca09-4fb1-bed5-58dfc34a89fc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:22.798265 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d55ef2-ca09-4fb1-bed5-58dfc34a89fc admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:22.808887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68e071-785f-43b8-85d4-a82525ad2283 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:22.813525 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b722de-cf3f-47e9-b6f2-65b8e1ab2478 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:22.814729 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b722de-cf3f-47e9-b6f2-65b8e1ab2478 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:22.815105 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b722de-cf3f-47e9-b6f2-65b8e1ab2478 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:22.815583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b722de-cf3f-47e9-b6f2-65b8e1ab2478 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:22.825428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b722de-cf3f-47e9-b6f2-65b8e1ab2478 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:22.827933 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b722de-cf3f-47e9-b6f2-65b8e1ab2478 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:22.838856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 867/1705] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:22.840995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f922f-848b-4033-9101-531c49f27ef6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:22.841988 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f922f-848b-4033-9101-531c49f27ef6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:22.842460 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22f922f-848b-4033-9101-531c49f27ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:22.883940 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e22f922f-848b-4033-9101-531c49f27ef6 None None] MFA Rules not processed for user `c83ccb0008d04b4f98c05915e5748713`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:22.886560 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e22f922f-848b-4033-9101-531c49f27ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:22.959422 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 839/1706] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:02:22 2022] POST /identity/v3/projects => generated 381 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:22.965668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9d1c2-1ee0-4bf9-bbce-c1362c9bf82f None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:22.968403 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9d1c2-1ee0-4bf9-bbce-c1362c9bf82f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:22.968884 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9d1c2-1ee0-4bf9-bbce-c1362c9bf82f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:22.974078 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:23.016839 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-baf9d1c2-1ee0-4bf9-bbce-c1362c9bf82f None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:23.020552 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-baf9d1c2-1ee0-4bf9-bbce-c1362c9bf82f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:23.078739 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 868/1707] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:22 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:23.078739 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f922f-848b-4033-9101-531c49f27ef6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:23.096631 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22f922f-848b-4033-9101-531c49f27ef6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:23.150104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 840/1708] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:23.151469 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfe99e-bfbf-4c80-a020-32ebbf78d8d8 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:23.155471 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfe99e-bfbf-4c80-a020-32ebbf78d8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:23.155471 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ebfe99e-bfbf-4c80-a020-32ebbf78d8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:23.196909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-1ebfe99e-bfbf-4c80-a020-32ebbf78d8d8 None None] MFA Rules not processed for user `c83ccb0008d04b4f98c05915e5748713`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:23.199286 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1ebfe99e-bfbf-4c80-a020-32ebbf78d8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:23.222496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa93ba9-ff84-4019-a087-40e5f0ced2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:23.223132 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa93ba9-ff84-4019-a087-40e5f0ced2ec admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:23.223414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa93ba9-ff84-4019-a087-40e5f0ced2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:23.223687 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa93ba9-ff84-4019-a087-40e5f0ced2ec admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:23.224745 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa93ba9-ff84-4019-a087-40e5f0ced2ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:23.226995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa93ba9-ff84-4019-a087-40e5f0ced2ec admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:23.344164 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:23.353273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 869/1709] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:02:23 2022] POST /identity/v3/users => generated 297 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:23.354928 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa93ba9-ff84-4019-a087-40e5f0ced2ec admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:23.376089 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 841/1710] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:23 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:23.378350 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebfe99e-bfbf-4c80-a020-32ebbf78d8d8 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:23.382311 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa93ba9-ff84-4019-a087-40e5f0ced2ec admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:23.398993 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9f32ac-a67e-4ec9-9fd9-9c67d192b7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:23.399619 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f32ac-a67e-4ec9-9fd9-9c67d192b7fa admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:23.399895 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f32ac-a67e-4ec9-9fd9-9c67d192b7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:23.400208 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9f32ac-a67e-4ec9-9fd9-9c67d192b7fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:23.418801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ebfe99e-bfbf-4c80-a020-32ebbf78d8d8 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:23.419003 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f32ac-a67e-4ec9-9fd9-9c67d192b7fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:02:23.419465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f32ac-a67e-4ec9-9fd9-9c67d192b7fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:23.421126 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9f32ac-a67e-4ec9-9fd9-9c67d192b7fa admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:23.437155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743aff8-1a55-4aa4-94d1-5f9d571a0edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:23.437857 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743aff8-1a55-4aa4-94d1-5f9d571a0edf admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:23.438141 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743aff8-1a55-4aa4-94d1-5f9d571a0edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:23.438412 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0743aff8-1a55-4aa4-94d1-5f9d571a0edf admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:23.439060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743aff8-1a55-4aa4-94d1-5f9d571a0edf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:23.440651 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0743aff8-1a55-4aa4-94d1-5f9d571a0edf admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:23.468008 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 842/1711] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:23.468008 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743aff8-1a55-4aa4-94d1-5f9d571a0edf admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:23.476646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 870/1712] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:02:23.476823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0743aff8-1a55-4aa4-94d1-5f9d571a0edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:23.478198 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d4fa8-ed6f-4875-ba3e-af3d4574d605 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:23.478532 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d4fa8-ed6f-4875-ba3e-af3d4574d605 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:23.478835 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440d4fa8-ed6f-4875-ba3e-af3d4574d605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:23.528067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-440d4fa8-ed6f-4875-ba3e-af3d4574d605 None None] MFA Rules not processed for user `abb30d0c8b764bed8ca98f35ea070e86`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:23.528067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-440d4fa8-ed6f-4875-ba3e-af3d4574d605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:23.731161 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0743aff8-1a55-4aa4-94d1-5f9d571a0edf admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:23.758459 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba59cf8-cce9-4870-859a-a8a64793c35e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:23.759416 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba59cf8-cce9-4870-859a-a8a64793c35e service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:23.759866 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba59cf8-cce9-4870-859a-a8a64793c35e service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:23.769801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba59cf8-cce9-4870-859a-a8a64793c35e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:23.774499 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 871/1713] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:23.776294 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d4fa8-ed6f-4875-ba3e-af3d4574d605 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:23.782709 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba59cf8-cce9-4870-859a-a8a64793c35e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:23.784651 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba59cf8-cce9-4870-859a-a8a64793c35e service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:23.811377 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440d4fa8-ed6f-4875-ba3e-af3d4574d605 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:23.820822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 843/1714] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:23 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:23.822271 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba59cf8-cce9-4870-859a-a8a64793c35e service nova] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:23.830210 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd35902-976f-43f3-ba2f-39270e54aea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:23.832650 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd35902-976f-43f3-ba2f-39270e54aea5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:23.832943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd35902-976f-43f3-ba2f-39270e54aea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:23.835361 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd35902-976f-43f3-ba2f-39270e54aea5 admin admin] PATH_INFO: `/v3/projects/41579ec4a69241a39874b6acb8026a4c/users/12c0c9f701894fb4806f1e46cba9d808/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:23.846838 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba59cf8-cce9-4870-859a-a8a64793c35e service nova] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:23.860823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae25843-eed1-416e-b49e-7d811329c610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:23.861617 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae25843-eed1-416e-b49e-7d811329c610 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:23.861918 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae25843-eed1-416e-b49e-7d811329c610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:23.862194 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae25843-eed1-416e-b49e-7d811329c610 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:23.868104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae25843-eed1-416e-b49e-7d811329c610 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:23.870131 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae25843-eed1-416e-b49e-7d811329c610 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:23.898538 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd35902-976f-43f3-ba2f-39270e54aea5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=41579ec4a69241a39874b6acb8026a4c, user_id=12c0c9f701894fb4806f1e46cba9d808, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:23.916121 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd35902-976f-43f3-ba2f-39270e54aea5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:24.025405 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 872/1715] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:23 2022] PUT /identity/v3/projects/41579ec4a69241a39874b6acb8026a4c/users/12c0c9f701894fb4806f1e46cba9d808/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:24.028646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c0e57-7921-4ed4-a496-5954ae2f4d42 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:24.029171 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c0e57-7921-4ed4-a496-5954ae2f4d42 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:24.030083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1c0e57-7921-4ed4-a496-5954ae2f4d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:24.058495 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 844/1716] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:02:23 2022] POST /identity/v3/projects => generated 363 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:24.059160 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae25843-eed1-416e-b49e-7d811329c610 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:24.064582 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-fae25843-eed1-416e-b49e-7d811329c610 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:24.067394 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-dc1c0e57-7921-4ed4-a496-5954ae2f4d42 None None] MFA Rules not processed for user `0851425d841946f49c73af574b818ace`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:24.081954 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dc1c0e57-7921-4ed4-a496-5954ae2f4d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:24.095422 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:24.174739 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 873/1717] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:24.175616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c0e57-7921-4ed4-a496-5954ae2f4d42 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:24.178605 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dc1c0e57-7921-4ed4-a496-5954ae2f4d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:24.215518 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae25843-eed1-416e-b49e-7d811329c610 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:24.227880 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e961abe-a157-488e-9b29-c2f07f122cdb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e7df5170c841abb449f3b4a547ec4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:24.229335 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e961abe-a157-488e-9b29-c2f07f122cdb service placement] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:24.229620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e961abe-a157-488e-9b29-c2f07f122cdb service placement] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:24.229993 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e961abe-a157-488e-9b29-c2f07f122cdb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:24.232613 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2e961abe-a157-488e-9b29-c2f07f122cdb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:24.249644 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e961abe-a157-488e-9b29-c2f07f122cdb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:24.251408 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e961abe-a157-488e-9b29-c2f07f122cdb service placement] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:24.270589 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 845/1718] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:24.273063 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e961abe-a157-488e-9b29-c2f07f122cdb service placement] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:24.274751 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2e961abe-a157-488e-9b29-c2f07f122cdb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:24.353431 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1c0e57-7921-4ed4-a496-5954ae2f4d42 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:24.360146 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ca089-8d72-4d63-92bc-726408c87fde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:24.360944 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ca089-8d72-4d63-92bc-726408c87fde service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:24.361227 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ca089-8d72-4d63-92bc-726408c87fde service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:24.361507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3ca089-8d72-4d63-92bc-726408c87fde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:24.381528 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:24.436596 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ca089-8d72-4d63-92bc-726408c87fde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:24.439073 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3ca089-8d72-4d63-92bc-726408c87fde service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:24.457304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 874/1719] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:24.457304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ca089-8d72-4d63-92bc-726408c87fde service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:24.467358 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3ca089-8d72-4d63-92bc-726408c87fde service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:24.470325 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e961abe-a157-488e-9b29-c2f07f122cdb service placement] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:24.481076 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee423e-1805-4c52-b25e-3ec8e61b325e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:24.482282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee423e-1805-4c52-b25e-3ec8e61b325e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:24.482385 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454fa3f-c0c2-4bfd-9077-1ae77f785daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:24.482569 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee423e-1805-4c52-b25e-3ec8e61b325e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:24.491544 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aee423e-1805-4c52-b25e-3ec8e61b325e admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:24.491842 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454fa3f-c0c2-4bfd-9077-1ae77f785daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:24.491842 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454fa3f-c0c2-4bfd-9077-1ae77f785daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:24.491842 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454fa3f-c0c2-4bfd-9077-1ae77f785daf admin admin] PATH_INFO: `/v3/projects/81460855e0c84ee29ee289fd400d9224` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:24.492032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee423e-1805-4c52-b25e-3ec8e61b325e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:24.492032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aee423e-1805-4c52-b25e-3ec8e61b325e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:24.492150 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454fa3f-c0c2-4bfd-9077-1ae77f785daf admin admin] RBAC: Authorizing `identity:delete_project(project_id=81460855e0c84ee29ee289fd400d9224)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:24.492150 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454fa3f-c0c2-4bfd-9077-1ae77f785daf admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:24.510830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 875/1720] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:24.513084 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee423e-1805-4c52-b25e-3ec8e61b325e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:24.555792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aee423e-1805-4c52-b25e-3ec8e61b325e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:24.574217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f66a34-b151-407f-aaaf-eef81b7fec72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:24.576994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f66a34-b151-407f-aaaf-eef81b7fec72 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:24.582254 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f66a34-b151-407f-aaaf-eef81b7fec72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:24.582254 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f66a34-b151-407f-aaaf-eef81b7fec72 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:24.582254 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f66a34-b151-407f-aaaf-eef81b7fec72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:24.585579 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f66a34-b151-407f-aaaf-eef81b7fec72 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:24.737449 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 876/1721] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:02:24 2022] POST /identity/v3/users => generated 282 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:24.738969 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f5880-ab4d-43a0-b86d-953a037afd9a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:24.739721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f5880-ab4d-43a0-b86d-953a037afd9a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:24.740673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f5880-ab4d-43a0-b86d-953a037afd9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:24.766886 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1454fa3f-c0c2-4bfd-9077-1ae77f785daf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81460855e0c84ee29ee289fd400d9224', 'request_id': 'req-1454fa3f-c0c2-4bfd-9077-1ae77f785daf'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:24.781014 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1454fa3f-c0c2-4bfd-9077-1ae77f785daf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81460855e0c84ee29ee289fd400d9224', 'request_id': 'req-1454fa3f-c0c2-4bfd-9077-1ae77f785daf'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:24.785617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ae3f5880-ab4d-43a0-b86d-953a037afd9a None None] MFA Rules not processed for user `75a27959e4354f11bcf13a1d254a6b56`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:24.787776 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ae3f5880-ab4d-43a0-b86d-953a037afd9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:24.811914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1454fa3f-c0c2-4bfd-9077-1ae77f785daf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81460855e0c84ee29ee289fd400d9224', 'request_id': 'req-1454fa3f-c0c2-4bfd-9077-1ae77f785daf'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:24.813098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:24.896825 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 877/1722] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:24.898659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f31e0-4bf8-4938-83fe-703c7b2cb9f1 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:24.899348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f31e0-4bf8-4938-83fe-703c7b2cb9f1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:24.899763 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f31e0-4bf8-4938-83fe-703c7b2cb9f1 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:24.908091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 878/1723] 10.222.0.59 () {54 vars in 912 bytes} [Tue Sep 13 20:02:24 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:02:24.909371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f31e0-4bf8-4938-83fe-703c7b2cb9f1 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:24.932486 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1454fa3f-c0c2-4bfd-9077-1ae77f785daf admin admin] The token cache is being invalidate because project 81460855e0c84ee29ee289fd400d9224 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:24.932782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1454fa3f-c0c2-4bfd-9077-1ae77f785daf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:24.935543 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1454fa3f-c0c2-4bfd-9077-1ae77f785daf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:24.939445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 846/1724] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:24 2022] DELETE /identity/v3/projects/81460855e0c84ee29ee289fd400d9224 => generated 0 bytes in 668 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:24.942047 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454fa3f-c0c2-4bfd-9077-1ae77f785daf admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:24.944588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1454fa3f-c0c2-4bfd-9077-1ae77f785daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:25.080607 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f31e0-4bf8-4938-83fe-703c7b2cb9f1 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:25.098890 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3733c30-25e8-4545-b847-e86a4cc4634a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:25.099903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3733c30-25e8-4545-b847-e86a4cc4634a admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:25.100991 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3733c30-25e8-4545-b847-e86a4cc4634a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:25.102615 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3733c30-25e8-4545-b847-e86a4cc4634a admin admin] PATH_INFO: `/v3/projects/41579ec4a69241a39874b6acb8026a4c/users/12c0c9f701894fb4806f1e46cba9d808/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:25.108299 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3733c30-25e8-4545-b847-e86a4cc4634a admin admin] RBAC: Authorizing `identity:create_grant(project_id=41579ec4a69241a39874b6acb8026a4c, user_id=12c0c9f701894fb4806f1e46cba9d808, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:25.112669 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3733c30-25e8-4545-b847-e86a4cc4634a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:25.133369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454fa3f-c0c2-4bfd-9077-1ae77f785daf admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:25.142497 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 879/1725] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:24 2022] PUT /identity/v3/projects/41579ec4a69241a39874b6acb8026a4c/users/12c0c9f701894fb4806f1e46cba9d808/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:25.147517 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d506415-8159-46fe-beaf-f912d79132c5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:25.147816 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d506415-8159-46fe-beaf-f912d79132c5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:25.148079 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d506415-8159-46fe-beaf-f912d79132c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:25.186813 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1d506415-8159-46fe-beaf-f912d79132c5 None None] MFA Rules not processed for user `b86b85c457d84ac99359ac93add704d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:25.189928 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1d506415-8159-46fe-beaf-f912d79132c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:25.269672 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430cb9c-0446-427a-9e52-a4151df2a964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:25.270538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430cb9c-0446-427a-9e52-a4151df2a964 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:25.270627 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430cb9c-0446-427a-9e52-a4151df2a964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:25.272379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c430cb9c-0446-427a-9e52-a4151df2a964 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:25.273042 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430cb9c-0446-427a-9e52-a4151df2a964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:25.274709 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c430cb9c-0446-427a-9e52-a4151df2a964 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:25.292377 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 847/1726] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:24 2022] GET /identity/v3/roles => generated 1420 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:25.293300 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430cb9c-0446-427a-9e52-a4151df2a964 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:25.304079 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c430cb9c-0446-427a-9e52-a4151df2a964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:25.325501 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c430cb9c-0446-427a-9e52-a4151df2a964 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:25.337890 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f946e-7d20-4f53-9af0-0ef68672761f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:25.338616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f946e-7d20-4f53-9af0-0ef68672761f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:25.338814 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f946e-7d20-4f53-9af0-0ef68672761f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:25.339087 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3f946e-7d20-4f53-9af0-0ef68672761f admin admin] PATH_INFO: `/v3/users/01562fada1564828ba89c5d024f0a966` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:25.342129 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f946e-7d20-4f53-9af0-0ef68672761f admin admin] RBAC: Authorizing `identity:delete_user(user_id=01562fada1564828ba89c5d024f0a966)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:25.344225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3f946e-7d20-4f53-9af0-0ef68672761f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:25.350174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 880/1727] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Sep 13 20:02:25 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:25.353844 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe8956-dfe3-4be9-a6d6-faf70ba6efd4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:25.354319 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe8956-dfe3-4be9-a6d6-faf70ba6efd4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:25.354674 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafe8956-dfe3-4be9-a6d6-faf70ba6efd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:25.372809 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:25.425985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-bafe8956-dfe3-4be9-a6d6-faf70ba6efd4 None None] MFA Rules not processed for user `12c0c9f701894fb4806f1e46cba9d808`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:25.427988 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bafe8956-dfe3-4be9-a6d6-faf70ba6efd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:25.576135 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 881/1728] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:25 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:25.576135 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe8956-dfe3-4be9-a6d6-faf70ba6efd4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:25.600605 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafe8956-dfe3-4be9-a6d6-faf70ba6efd4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:25.611356 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77283977-cfb7-448f-8d59-535bb73b87d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:25.612214 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77283977-cfb7-448f-8d59-535bb73b87d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:25.612777 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77283977-cfb7-448f-8d59-535bb73b87d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:25.613395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77283977-cfb7-448f-8d59-535bb73b87d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:25.614263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77283977-cfb7-448f-8d59-535bb73b87d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:25.616187 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77283977-cfb7-448f-8d59-535bb73b87d8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:25.629506 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 882/1729] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:25 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:25.630738 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77283977-cfb7-448f-8d59-535bb73b87d8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:25.632903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-77283977-cfb7-448f-8d59-535bb73b87d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:25.647037 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77283977-cfb7-448f-8d59-535bb73b87d8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:25.651571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1cdd8-7493-472e-b14d-bd6ac411e95b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:25.652357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1cdd8-7493-472e-b14d-bd6ac411e95b service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:25.652808 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1cdd8-7493-472e-b14d-bd6ac411e95b service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:25.653243 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba1cdd8-7493-472e-b14d-bd6ac411e95b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:25.662604 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1cdd8-7493-472e-b14d-bd6ac411e95b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:25.664341 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba1cdd8-7493-472e-b14d-bd6ac411e95b service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:25.676075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 883/1730] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:25 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:25.677397 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1cdd8-7493-472e-b14d-bd6ac411e95b service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:25.679056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9ba1cdd8-7493-472e-b14d-bd6ac411e95b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:25.716220 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9b3f946e-7d20-4f53-9af0-0ef68672761f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01562fada1564828ba89c5d024f0a966'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:25.788533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba1cdd8-7493-472e-b14d-bd6ac411e95b service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:25.797188 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9b3f946e-7d20-4f53-9af0-0ef68672761f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01562fada1564828ba89c5d024f0a966'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:25.798273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:25.802429 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e169bf-0b3d-4e30-8a4b-ff6f3f24cf42 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:25.804608 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e169bf-0b3d-4e30-8a4b-ff6f3f24cf42 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:25.807375 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e169bf-0b3d-4e30-8a4b-ff6f3f24cf42 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:25.807375 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e169bf-0b3d-4e30-8a4b-ff6f3f24cf42 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:25.833580 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9b3f946e-7d20-4f53-9af0-0ef68672761f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01562fada1564828ba89c5d024f0a966'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:25.833580 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9b3f946e-7d20-4f53-9af0-0ef68672761f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01562fada1564828ba89c5d024f0a966'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:25.836328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e169bf-0b3d-4e30-8a4b-ff6f3f24cf42 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:25.838761 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e169bf-0b3d-4e30-8a4b-ff6f3f24cf42 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:25.848040 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9b3f946e-7d20-4f53-9af0-0ef68672761f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01562fada1564828ba89c5d024f0a966'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:25.860186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 884/1731] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:25.861121 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e169bf-0b3d-4e30-8a4b-ff6f3f24cf42 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:25.872333 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 848/1732] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:25 2022] DELETE /identity/v3/users/01562fada1564828ba89c5d024f0a966 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:25.882716 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e169bf-0b3d-4e30-8a4b-ff6f3f24cf42 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:26.006232 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed020f93-8479-47ac-a5b7-96c61696682d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:26.007254 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed020f93-8479-47ac-a5b7-96c61696682d admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:26.007610 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed020f93-8479-47ac-a5b7-96c61696682d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:26.007950 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed020f93-8479-47ac-a5b7-96c61696682d admin admin] PATH_INFO: `/v3/projects/1ba4bdf051ff4ff4b902fddea1025438/users/c984eae5770b4b0bbc39c1827c7b0477/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:26.066093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed020f93-8479-47ac-a5b7-96c61696682d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ba4bdf051ff4ff4b902fddea1025438, user_id=c984eae5770b4b0bbc39c1827c7b0477, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:26.068926 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed020f93-8479-47ac-a5b7-96c61696682d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:26.147394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f946e-7d20-4f53-9af0-0ef68672761f admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:26.149915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9b3f946e-7d20-4f53-9af0-0ef68672761f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:26.161263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 885/1733] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:25 2022] PUT /identity/v3/projects/1ba4bdf051ff4ff4b902fddea1025438/users/c984eae5770b4b0bbc39c1827c7b0477/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:26.171489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58dbc6-ea22-4bfe-9b21-e7c0888dfc4a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:26.171805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58dbc6-ea22-4bfe-9b21-e7c0888dfc4a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:26.172072 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58dbc6-ea22-4bfe-9b21-e7c0888dfc4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:26.213423 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6b58dbc6-ea22-4bfe-9b21-e7c0888dfc4a None None] MFA Rules not processed for user `c984eae5770b4b0bbc39c1827c7b0477`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:26.215148 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6b58dbc6-ea22-4bfe-9b21-e7c0888dfc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:26.317756 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 886/1734] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:26.324175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58dbc6-ea22-4bfe-9b21-e7c0888dfc4a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:26.327055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6b58dbc6-ea22-4bfe-9b21-e7c0888dfc4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:26.351559 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3f946e-7d20-4f53-9af0-0ef68672761f admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:26.464340 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790ecb0-dbc4-4db3-9126-d32daef6218a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:26.467886 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790ecb0-dbc4-4db3-9126-d32daef6218a service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:26.467886 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790ecb0-dbc4-4db3-9126-d32daef6218a service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:26.467886 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1790ecb0-dbc4-4db3-9126-d32daef6218a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:26.479773 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1790ecb0-dbc4-4db3-9126-d32daef6218a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:26.500373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58dbc6-ea22-4bfe-9b21-e7c0888dfc4a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:26.506886 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599f32b-5d03-4c0a-b4c3-5a5aa81da39c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:26.507601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599f32b-5d03-4c0a-b4c3-5a5aa81da39c admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:26.508006 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599f32b-5d03-4c0a-b4c3-5a5aa81da39c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:26.508450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599f32b-5d03-4c0a-b4c3-5a5aa81da39c admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:26.509288 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599f32b-5d03-4c0a-b4c3-5a5aa81da39c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:26.523754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599f32b-5d03-4c0a-b4c3-5a5aa81da39c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:26.669420 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790ecb0-dbc4-4db3-9126-d32daef6218a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:26.671462 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1790ecb0-dbc4-4db3-9126-d32daef6218a service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:26.684383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 849/1735] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:02:26.702993 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 887/1736] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:02:26 2022] POST /identity/v3/projects => generated 365 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:26.703561 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790ecb0-dbc4-4db3-9126-d32daef6218a service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:26.729124 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1790ecb0-dbc4-4db3-9126-d32daef6218a service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:26.874491 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a6b12-dbe4-4053-a99b-2be14b1811bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:26.875412 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a6b12-dbe4-4053-a99b-2be14b1811bd admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:26.880321 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a6b12-dbe4-4053-a99b-2be14b1811bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:26.880321 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554a6b12-dbe4-4053-a99b-2be14b1811bd admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:26.880321 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a6b12-dbe4-4053-a99b-2be14b1811bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:26.880321 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554a6b12-dbe4-4053-a99b-2be14b1811bd admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:26.982335 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 850/1737] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:02:26 2022] POST /identity/v3/users => generated 289 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:26.986960 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599f32b-5d03-4c0a-b4c3-5a5aa81da39c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:27.005532 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599f32b-5d03-4c0a-b4c3-5a5aa81da39c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:27.047849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f78f1-6715-47dd-9339-4abc5ecf3540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:27.048760 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:27.050850 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f78f1-6715-47dd-9339-4abc5ecf3540 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:27.051139 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f78f1-6715-47dd-9339-4abc5ecf3540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:27.051416 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23f78f1-6715-47dd-9339-4abc5ecf3540 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:27.052082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f78f1-6715-47dd-9339-4abc5ecf3540 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:27.057155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23f78f1-6715-47dd-9339-4abc5ecf3540 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:27.137510 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 888/1738] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:27.138391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a6b12-dbe4-4053-a99b-2be14b1811bd admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:27.149097 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554a6b12-dbe4-4053-a99b-2be14b1811bd admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:27.158914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bcdcf-df0b-4d8a-8b5a-414749c43891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:27.159633 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bcdcf-df0b-4d8a-8b5a-414749c43891 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:27.159945 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bcdcf-df0b-4d8a-8b5a-414749c43891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:27.160233 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8bcdcf-df0b-4d8a-8b5a-414749c43891 admin admin] PATH_INFO: `/v3/projects/1b122518c86c4af48134ee5fc2e89b9e/users/4d054e2d246845878cdd76ce90037112/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:27.183123 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8bcdcf-df0b-4d8a-8b5a-414749c43891 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b122518c86c4af48134ee5fc2e89b9e, user_id=4d054e2d246845878cdd76ce90037112, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:27.192353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8bcdcf-df0b-4d8a-8b5a-414749c43891 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:27.326974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 851/1739] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:27 2022] PUT /identity/v3/projects/1b122518c86c4af48134ee5fc2e89b9e/users/4d054e2d246845878cdd76ce90037112/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:27.336782 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f78f1-6715-47dd-9339-4abc5ecf3540 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:27.355175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23f78f1-6715-47dd-9339-4abc5ecf3540 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:27.463882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab1b43-cfb2-4ae5-81e3-284068058cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:27.468833 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab1b43-cfb2-4ae5-81e3-284068058cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:27.468833 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab1b43-cfb2-4ae5-81e3-284068058cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:27.468833 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aab1b43-cfb2-4ae5-81e3-284068058cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:27.468833 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab1b43-cfb2-4ae5-81e3-284068058cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:27.469299 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aab1b43-cfb2-4ae5-81e3-284068058cf3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:27.485565 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 889/1740] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:27.487045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bcdcf-df0b-4d8a-8b5a-414749c43891 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:27.513250 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8bcdcf-df0b-4d8a-8b5a-414749c43891 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:27.519734 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:27.523546 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42dd37c3-d3f2-4631-b443-6fb2900300e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:27.524235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd37c3-d3f2-4631-b443-6fb2900300e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:27.526286 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd37c3-d3f2-4631-b443-6fb2900300e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:27.526286 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42dd37c3-d3f2-4631-b443-6fb2900300e2 admin admin] PATH_INFO: `/v3/projects/1b122518c86c4af48134ee5fc2e89b9e/users/4d054e2d246845878cdd76ce90037112/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:27.526960 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd37c3-d3f2-4631-b443-6fb2900300e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b122518c86c4af48134ee5fc2e89b9e, user_id=4d054e2d246845878cdd76ce90037112, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:27.541125 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42dd37c3-d3f2-4631-b443-6fb2900300e2 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:27.545562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab1b43-cfb2-4ae5-81e3-284068058cf3 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:27.548563 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5aab1b43-cfb2-4ae5-81e3-284068058cf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:27.568164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aab1b43-cfb2-4ae5-81e3-284068058cf3 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:27.594019 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 852/1741] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:27 2022] PUT /identity/v3/projects/1b122518c86c4af48134ee5fc2e89b9e/users/4d054e2d246845878cdd76ce90037112/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:27.607230 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9e972-f29d-41ef-9ba5-1b75c47d21aa None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:27.607436 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9e972-f29d-41ef-9ba5-1b75c47d21aa None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:27.607715 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa9e972-f29d-41ef-9ba5-1b75c47d21aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:27.679739 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-3fa9e972-f29d-41ef-9ba5-1b75c47d21aa None None] MFA Rules not processed for user `4d054e2d246845878cdd76ce90037112`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:27.681173 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3fa9e972-f29d-41ef-9ba5-1b75c47d21aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:27.737932 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef173e-a1fb-4d7e-b50d-b4bec0713cb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:27.765764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef173e-a1fb-4d7e-b50d-b4bec0713cb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:27.766059 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef173e-a1fb-4d7e-b50d-b4bec0713cb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:27.766338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ef173e-a1fb-4d7e-b50d-b4bec0713cb9 admin admin] PATH_INFO: `/v3/projects/038916eeea614453bcc5c4827ae8112b` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:27.771435 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef173e-a1fb-4d7e-b50d-b4bec0713cb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=038916eeea614453bcc5c4827ae8112b)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:27.777958 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ef173e-a1fb-4d7e-b50d-b4bec0713cb9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:27.779104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 853/1742] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:27 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:27.792911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9e972-f29d-41ef-9ba5-1b75c47d21aa None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:27.878686 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa9e972-f29d-41ef-9ba5-1b75c47d21aa None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:27.883598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9638e9-8b09-413d-86ab-d6c184b601e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:27.884412 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9638e9-8b09-413d-86ab-d6c184b601e8 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:27.884957 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9638e9-8b09-413d-86ab-d6c184b601e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:27.885089 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9638e9-8b09-413d-86ab-d6c184b601e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:27.895558 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9638e9-8b09-413d-86ab-d6c184b601e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:27.897063 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9638e9-8b09-413d-86ab-d6c184b601e8 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:27.907136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 854/1743] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:27 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:02:27.908375 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c6c74-3e85-4208-a78b-aea554acf95e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:27.908663 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c6c74-3e85-4208-a78b-aea554acf95e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:27.908943 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2c6c74-3e85-4208-a78b-aea554acf95e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:27.930862 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-3a2c6c74-3e85-4208-a78b-aea554acf95e None None] MFA Rules not processed for user `c83ccb0008d04b4f98c05915e5748713`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:27.932134 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3a2c6c74-3e85-4208-a78b-aea554acf95e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:27.993362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 855/1744] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:28.042649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f4ef173e-a1fb-4d7e-b50d-b4bec0713cb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '038916eeea614453bcc5c4827ae8112b', 'request_id': 'req-f4ef173e-a1fb-4d7e-b50d-b4bec0713cb9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:28.147801 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f4ef173e-a1fb-4d7e-b50d-b4bec0713cb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '038916eeea614453bcc5c4827ae8112b', 'request_id': 'req-f4ef173e-a1fb-4d7e-b50d-b4bec0713cb9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:28.157020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f4ef173e-a1fb-4d7e-b50d-b4bec0713cb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '038916eeea614453bcc5c4827ae8112b', 'request_id': 'req-f4ef173e-a1fb-4d7e-b50d-b4bec0713cb9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:28.176157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f4ef173e-a1fb-4d7e-b50d-b4bec0713cb9 admin admin] The token cache is being invalidate because project 038916eeea614453bcc5c4827ae8112b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:28.176515 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f4ef173e-a1fb-4d7e-b50d-b4bec0713cb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:28.178852 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f4ef173e-a1fb-4d7e-b50d-b4bec0713cb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:28.180882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 890/1745] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:27 2022] DELETE /identity/v3/projects/038916eeea614453bcc5c4827ae8112b => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:02:28.187512 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db92bf-c125-47d9-aed9-2ed0892b876d None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:28.188136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db92bf-c125-47d9-aed9-2ed0892b876d None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:28.188820 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db92bf-c125-47d9-aed9-2ed0892b876d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:28.249476 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef173e-a1fb-4d7e-b50d-b4bec0713cb9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:28.251229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f4ef173e-a1fb-4d7e-b50d-b4bec0713cb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:28.270312 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-23db92bf-c125-47d9-aed9-2ed0892b876d None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:28.282068 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-23db92bf-c125-47d9-aed9-2ed0892b876d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:28.539761 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:28.539861 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ef173e-a1fb-4d7e-b50d-b4bec0713cb9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:28.549663 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 856/1746] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:28.550365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d46ee-e623-4f07-a422-a095e10b7bee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:28.550965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d46ee-e623-4f07-a422-a095e10b7bee service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:28.551249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d46ee-e623-4f07-a422-a095e10b7bee service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:28.551532 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87d46ee-e623-4f07-a422-a095e10b7bee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:28.559250 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce810d-a250-48d6-b65f-227ac3e9efcf None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:28.561260 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce810d-a250-48d6-b65f-227ac3e9efcf None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:28.561655 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce810d-a250-48d6-b65f-227ac3e9efcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:28.563178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f87d46ee-e623-4f07-a422-a095e10b7bee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:28.647348 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-adce810d-a250-48d6-b65f-227ac3e9efcf None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:28.652863 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-adce810d-a250-48d6-b65f-227ac3e9efcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:28.691997 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 857/1747] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:02:28.693162 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce810d-a250-48d6-b65f-227ac3e9efcf None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:28.723659 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce810d-a250-48d6-b65f-227ac3e9efcf None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:28.743814 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf8487-1c8e-4645-9093-99c7bcead119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:28.744884 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf8487-1c8e-4645-9093-99c7bcead119 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:28.745173 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf8487-1c8e-4645-9093-99c7bcead119 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:28.749792 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf8487-1c8e-4645-9093-99c7bcead119 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:28.751716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf8487-1c8e-4645-9093-99c7bcead119 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:02:28.755396 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf8487-1c8e-4645-9093-99c7bcead119 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:28.757619 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf8487-1c8e-4645-9093-99c7bcead119 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:28.799810 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 858/1748] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:02:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:02:28.802831 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf8487-1c8e-4645-9093-99c7bcead119 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:28.809085 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d46ee-e623-4f07-a422-a095e10b7bee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:28.812900 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87d46ee-e623-4f07-a422-a095e10b7bee service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:28.825017 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf8487-1c8e-4645-9093-99c7bcead119 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:28.826740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 891/1749] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:28 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:02:28.831528 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d74b6-f581-48de-9cde-a604ec73677e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:28.832392 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d74b6-f581-48de-9cde-a604ec73677e admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:28.832671 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d74b6-f581-48de-9cde-a604ec73677e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:28.832944 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31d74b6-f581-48de-9cde-a604ec73677e admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:28.836633 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d74b6-f581-48de-9cde-a604ec73677e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:28.838128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31d74b6-f581-48de-9cde-a604ec73677e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:28.958836 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 859/1750] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:02:28 2022] POST /identity/v3/projects => generated 391 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:02:28.962872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d46ee-e623-4f07-a422-a095e10b7bee service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:28.985104 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87d46ee-e623-4f07-a422-a095e10b7bee service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:29.131446 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f7aa4-6f20-495b-ab23-c057828b6014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:29.132081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f7aa4-6f20-495b-ab23-c057828b6014 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:29.132364 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f7aa4-6f20-495b-ab23-c057828b6014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:29.132637 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f7aa4-6f20-495b-ab23-c057828b6014 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:29.133285 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f7aa4-6f20-495b-ab23-c057828b6014 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:29.146072 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f7aa4-6f20-495b-ab23-c057828b6014 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:29.317767 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 892/1751] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:02:28 2022] POST /identity/v3/users => generated 296 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:02:29.320811 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d74b6-f581-48de-9cde-a604ec73677e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:29.340623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31d74b6-f581-48de-9cde-a604ec73677e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:29.355659 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e01774-907c-4a1c-a9ae-7c62bdca4a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:29.358370 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e01774-907c-4a1c-a9ae-7c62bdca4a9c admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:29.358953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e01774-907c-4a1c-a9ae-7c62bdca4a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:29.359362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e01774-907c-4a1c-a9ae-7c62bdca4a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:29.361304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e01774-907c-4a1c-a9ae-7c62bdca4a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:29.366503 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e01774-907c-4a1c-a9ae-7c62bdca4a9c admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:29.405489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f7aa4-6f20-495b-ab23-c057828b6014 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:29.422467 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 860/1752] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:29.430957 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f7aa4-6f20-495b-ab23-c057828b6014 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:29.439536 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274c3721-bc60-44f8-a8a2-8cd1fd8aa610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:29.440186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c3721-bc60-44f8-a8a2-8cd1fd8aa610 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:29.459297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c3721-bc60-44f8-a8a2-8cd1fd8aa610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:29.459725 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274c3721-bc60-44f8-a8a2-8cd1fd8aa610 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:29.462235 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c3721-bc60-44f8-a8a2-8cd1fd8aa610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:29.472093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274c3721-bc60-44f8-a8a2-8cd1fd8aa610 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:29.497827 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 893/1753] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:29 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:29.502292 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e01774-907c-4a1c-a9ae-7c62bdca4a9c admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:29.526609 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e01774-907c-4a1c-a9ae-7c62bdca4a9c admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:29.543146 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d43dfd-e3e7-40a4-bd78-2d68f5dddcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:29.547876 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d43dfd-e3e7-40a4-bd78-2d68f5dddcdc admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:29.548217 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d43dfd-e3e7-40a4-bd78-2d68f5dddcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:29.554243 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d43dfd-e3e7-40a4-bd78-2d68f5dddcdc admin admin] PATH_INFO: `/v3/projects/ac5cdb225de5493da46b32fb79d54005/users/2576ed331bc24639bf81b12b83797272/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:29.584758 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d43dfd-e3e7-40a4-bd78-2d68f5dddcdc admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac5cdb225de5493da46b32fb79d54005, user_id=2576ed331bc24639bf81b12b83797272, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:29.596547 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d43dfd-e3e7-40a4-bd78-2d68f5dddcdc admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:29.615568 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:29.732095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 861/1754] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:29 2022] PUT /identity/v3/projects/ac5cdb225de5493da46b32fb79d54005/users/2576ed331bc24639bf81b12b83797272/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:29.747574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735dc41-275e-4d1f-a70f-b0df3c2eed9d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:29.748195 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735dc41-275e-4d1f-a70f-b0df3c2eed9d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:29.748624 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9735dc41-275e-4d1f-a70f-b0df3c2eed9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:29.824432 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9735dc41-275e-4d1f-a70f-b0df3c2eed9d None None] MFA Rules not processed for user `2576ed331bc24639bf81b12b83797272`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:29.828382 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9735dc41-275e-4d1f-a70f-b0df3c2eed9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:29.938767 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:30.087360 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 894/1755] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:29 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:30.088678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d43dfd-e3e7-40a4-bd78-2d68f5dddcdc admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:30.264931 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35376d-5307-45d0-834f-87646cf05726 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:30.265221 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35376d-5307-45d0-834f-87646cf05726 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:30.265499 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f35376d-5307-45d0-834f-87646cf05726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:30.310715 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d43dfd-e3e7-40a4-bd78-2d68f5dddcdc admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:30.319951 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506461a-26e2-4bee-94d5-7f53a47f4edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:30.320500 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506461a-26e2-4bee-94d5-7f53a47f4edf admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:30.320827 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506461a-26e2-4bee-94d5-7f53a47f4edf admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:30.321293 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506461a-26e2-4bee-94d5-7f53a47f4edf admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:30.323234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506461a-26e2-4bee-94d5-7f53a47f4edf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:30.324386 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506461a-26e2-4bee-94d5-7f53a47f4edf admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:30.397856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5f35376d-5307-45d0-834f-87646cf05726 None None] MFA Rules not processed for user `9fd7a80714874e73bf64dfa392632391`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:30.399858 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5f35376d-5307-45d0-834f-87646cf05726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:30.485343 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 862/1756] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:02:30 2022] POST /identity/v3/projects => generated 393 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:30.486903 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dcc7f-edb3-4f07-a9a5-99f10930d7c7 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:30.487192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dcc7f-edb3-4f07-a9a5-99f10930d7c7 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:30.487467 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8dcc7f-edb3-4f07-a9a5-99f10930d7c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:30.527226 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-dd8dcc7f-edb3-4f07-a9a5-99f10930d7c7 None None] MFA Rules not processed for user `abb30d0c8b764bed8ca98f35ea070e86`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:30.529525 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-dd8dcc7f-edb3-4f07-a9a5-99f10930d7c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:30.565892 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 895/1757] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Sep 13 20:02:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:30.566730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35376d-5307-45d0-834f-87646cf05726 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:30.595150 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f35376d-5307-45d0-834f-87646cf05726 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:30.636553 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 863/1758] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:30.832422 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b33b44-79a9-44ce-82ab-59b028bd3e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:30.832422 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b33b44-79a9-44ce-82ab-59b028bd3e29 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:30.833048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b33b44-79a9-44ce-82ab-59b028bd3e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:30.833048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b33b44-79a9-44ce-82ab-59b028bd3e29 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:30.833826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b33b44-79a9-44ce-82ab-59b028bd3e29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:30.835966 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b33b44-79a9-44ce-82ab-59b028bd3e29 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:30.941465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 896/1759] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:02:30 2022] POST /identity/v3/users => generated 303 bytes in 375 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:30.948825 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8dcc7f-edb3-4f07-a9a5-99f10930d7c7 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:30.968565 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8dcc7f-edb3-4f07-a9a5-99f10930d7c7 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:30.979826 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb36621-e289-4e44-aa0a-eae26bce8bff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:30.988529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb36621-e289-4e44-aa0a-eae26bce8bff admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:30.988529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb36621-e289-4e44-aa0a-eae26bce8bff admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:30.988529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb36621-e289-4e44-aa0a-eae26bce8bff admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:30.988529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb36621-e289-4e44-aa0a-eae26bce8bff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:30.988529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb36621-e289-4e44-aa0a-eae26bce8bff admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:31.009626 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 864/1760] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:30 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:31.013757 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b33b44-79a9-44ce-82ab-59b028bd3e29 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:31.043433 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b33b44-79a9-44ce-82ab-59b028bd3e29 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:31.057564 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e438d-7b7a-410e-9eca-06d196542ba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:31.060999 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb36621-e289-4e44-aa0a-eae26bce8bff admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:31.068948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bcb36621-e289-4e44-aa0a-eae26bce8bff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:31.078120 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e438d-7b7a-410e-9eca-06d196542ba2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:31.078669 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e438d-7b7a-410e-9eca-06d196542ba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:31.081789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801e438d-7b7a-410e-9eca-06d196542ba2 admin admin] PATH_INFO: `/v3/projects/1c8fa310ce9d44088bd13413f02876cb/users/095caa72a91f4d71b58e882459ae86d7/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:31.151559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e438d-7b7a-410e-9eca-06d196542ba2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c8fa310ce9d44088bd13413f02876cb, user_id=095caa72a91f4d71b58e882459ae86d7, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:31.159220 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801e438d-7b7a-410e-9eca-06d196542ba2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:31.255058 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 897/1761] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:31 2022] PUT /identity/v3/projects/1c8fa310ce9d44088bd13413f02876cb/users/095caa72a91f4d71b58e882459ae86d7/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:02:31.263522 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e438d-7b7a-410e-9eca-06d196542ba2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:31.343585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:31.375662 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb36621-e289-4e44-aa0a-eae26bce8bff admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:31.524568 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801e438d-7b7a-410e-9eca-06d196542ba2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:31.541819 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5da7a-317e-4f76-a3d3-5092c39ccd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:31.546535 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5da7a-317e-4f76-a3d3-5092c39ccd78 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:31.547008 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5da7a-317e-4f76-a3d3-5092c39ccd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:31.548369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5da7a-317e-4f76-a3d3-5092c39ccd78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:31.549473 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5da7a-317e-4f76-a3d3-5092c39ccd78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:31.555274 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5da7a-317e-4f76-a3d3-5092c39ccd78 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:31.580871 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3999903-be92-4ad9-90bc-deeca8b808f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00e78bf5e5c4db29c47dce1e87f3f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:31.581530 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3999903-be92-4ad9-90bc-deeca8b808f4 service swift] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:31.583034 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3999903-be92-4ad9-90bc-deeca8b808f4 service swift] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:31.584024 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3999903-be92-4ad9-90bc-deeca8b808f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:31.598484 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 898/1762] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:31 2022] GET /identity/v3/roles => generated 1420 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:31.603533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5da7a-317e-4f76-a3d3-5092c39ccd78 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:31.615384 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5da7a-317e-4f76-a3d3-5092c39ccd78 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:31.620882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49c8299-48be-4ad7-9cbf-bf021a63e768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:31.623505 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c8299-48be-4ad7-9cbf-bf021a63e768 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:31.623801 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c8299-48be-4ad7-9cbf-bf021a63e768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:31.624075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49c8299-48be-4ad7-9cbf-bf021a63e768 admin admin] PATH_INFO: `/v3/projects/1c8fa310ce9d44088bd13413f02876cb/users/095caa72a91f4d71b58e882459ae86d7/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:31.626100 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c8299-48be-4ad7-9cbf-bf021a63e768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c8fa310ce9d44088bd13413f02876cb, user_id=095caa72a91f4d71b58e882459ae86d7, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:31.628932 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49c8299-48be-4ad7-9cbf-bf021a63e768 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:31.646435 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 899/1763] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:31 2022] PUT /identity/v3/projects/1c8fa310ce9d44088bd13413f02876cb/users/095caa72a91f4d71b58e882459ae86d7/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:31.675007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa1c87-28f1-4539-9128-3bc469debcc7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:31.675850 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa1c87-28f1-4539-9128-3bc469debcc7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:31.676472 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dfa1c87-28f1-4539-9128-3bc469debcc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:31.751295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3999903-be92-4ad9-90bc-deeca8b808f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:31.753072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3999903-be92-4ad9-90bc-deeca8b808f4 service swift] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:31.774315 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6dfa1c87-28f1-4539-9128-3bc469debcc7 None None] MFA Rules not processed for user `095caa72a91f4d71b58e882459ae86d7`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:31.777156 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 865/1764] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Sep 13 20:02:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 717 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 13 20:02:31.778168 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6dfa1c87-28f1-4539-9128-3bc469debcc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:32.021527 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 900/1765] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:31 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:32.030796 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3999903-be92-4ad9-90bc-deeca8b808f4 service swift] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:32.032977 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b3999903-be92-4ad9-90bc-deeca8b808f4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:32.201068 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3999903-be92-4ad9-90bc-deeca8b808f4 service swift] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:32.359915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a25b5-5792-4129-94d1-103eb71e2318 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:32.360571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a25b5-5792-4129-94d1-103eb71e2318 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:32.360649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a25b5-5792-4129-94d1-103eb71e2318 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:32.360928 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a25b5-5792-4129-94d1-103eb71e2318 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:32.361515 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:32.392147 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a25b5-5792-4129-94d1-103eb71e2318 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:32.394079 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a25b5-5792-4129-94d1-103eb71e2318 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:32.436570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 866/1766] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:32 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:32.570998 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa1c87-28f1-4539-9128-3bc469debcc7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:32.602873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dfa1c87-28f1-4539-9128-3bc469debcc7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:32.628667 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d58f5-d35b-4914-9d9a-033f2e02fd37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:32.631673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d58f5-d35b-4914-9d9a-033f2e02fd37 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:32.632448 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d58f5-d35b-4914-9d9a-033f2e02fd37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:32.632809 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1d58f5-d35b-4914-9d9a-033f2e02fd37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:32.649057 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c56c4f-d178-4a6c-92f4-89fea153f3b0 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:32.649589 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c56c4f-d178-4a6c-92f4-89fea153f3b0 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:32.650050 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c56c4f-d178-4a6c-92f4-89fea153f3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:32.721609 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-22c56c4f-d178-4a6c-92f4-89fea153f3b0 None None] MFA Rules not processed for user `b86b85c457d84ac99359ac93add704d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:32.727553 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-22c56c4f-d178-4a6c-92f4-89fea153f3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:32.846410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:32.944020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d58f5-d35b-4914-9d9a-033f2e02fd37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:32.961147 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1d58f5-d35b-4914-9d9a-033f2e02fd37 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:32.970711 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 901/1767] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:32 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:33.010810 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 867/1768] 10.222.0.62 () {58 vars in 1015 bytes} [Tue Sep 13 20:02:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:33.355596 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d58f5-d35b-4914-9d9a-033f2e02fd37 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:33.389862 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8e1d58f5-d35b-4914-9d9a-033f2e02fd37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:33.389862 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1d58f5-d35b-4914-9d9a-033f2e02fd37 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:33.389862 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff910053-26d3-400c-9a7b-c4f06ffe05ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:33.391784 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff910053-26d3-400c-9a7b-c4f06ffe05ff service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:33.392141 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff910053-26d3-400c-9a7b-c4f06ffe05ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:33.392611 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff910053-26d3-400c-9a7b-c4f06ffe05ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:33.404758 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff910053-26d3-400c-9a7b-c4f06ffe05ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:33.406558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff910053-26d3-400c-9a7b-c4f06ffe05ff service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:33.416837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 902/1769] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:33 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:34.346775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:34.879202 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c56c4f-d178-4a6c-92f4-89fea153f3b0 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:34.886439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-22c56c4f-d178-4a6c-92f4-89fea153f3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:35.000917 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c56c4f-d178-4a6c-92f4-89fea153f3b0 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:35.007517 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0c464-8ad5-47e8-b5aa-eb78ef424451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:35.008674 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0c464-8ad5-47e8-b5aa-eb78ef424451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:35.009059 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0c464-8ad5-47e8-b5aa-eb78ef424451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:35.009435 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0c464-8ad5-47e8-b5aa-eb78ef424451 admin admin] PATH_INFO: `/v3/users/c984eae5770b4b0bbc39c1827c7b0477` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:35.010861 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd0c464-8ad5-47e8-b5aa-eb78ef424451 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c984eae5770b4b0bbc39c1827c7b0477)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:35.027560 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd0c464-8ad5-47e8-b5aa-eb78ef424451 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:35.027560 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:35.414240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5bd0c464-8ad5-47e8-b5aa-eb78ef424451 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c984eae5770b4b0bbc39c1827c7b0477'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:35.489936 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5bd0c464-8ad5-47e8-b5aa-eb78ef424451 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c984eae5770b4b0bbc39c1827c7b0477'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:35.537197 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5bd0c464-8ad5-47e8-b5aa-eb78ef424451 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c984eae5770b4b0bbc39c1827c7b0477'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:35.537197 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5bd0c464-8ad5-47e8-b5aa-eb78ef424451 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c984eae5770b4b0bbc39c1827c7b0477'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:35.550048 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5bd0c464-8ad5-47e8-b5aa-eb78ef424451 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c984eae5770b4b0bbc39c1827c7b0477'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:35.565927 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 868/1770] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:34 2022] DELETE /identity/v3/users/c984eae5770b4b0bbc39c1827c7b0477 => generated 0 bytes in 686 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:35.570059 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f43f0d-2437-41ec-b778-dff867e7eb4b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:35.570589 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f43f0d-2437-41ec-b778-dff867e7eb4b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:35.570806 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f43f0d-2437-41ec-b778-dff867e7eb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:35.645613 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e8f43f0d-2437-41ec-b778-dff867e7eb4b None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:35.653544 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e8f43f0d-2437-41ec-b778-dff867e7eb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:35.847294 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 903/1771] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:35.953787 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0c464-8ad5-47e8-b5aa-eb78ef424451 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:35.955768 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5bd0c464-8ad5-47e8-b5aa-eb78ef424451 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:36.131890 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:36.182648 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd0c464-8ad5-47e8-b5aa-eb78ef424451 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:36.205139 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d0c336-d310-4c0d-9855-39dc83f49410 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:36.207414 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0c336-d310-4c0d-9855-39dc83f49410 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:36.207708 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0c336-d310-4c0d-9855-39dc83f49410 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:36.208081 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d0c336-d310-4c0d-9855-39dc83f49410 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:36.241520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0c336-d310-4c0d-9855-39dc83f49410 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:36.253736 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d0c336-d310-4c0d-9855-39dc83f49410 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:36.280147 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 869/1772] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:37.451061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644a8a9-00fa-40e4-bda5-be5ad384d28e None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:37.451555 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644a8a9-00fa-40e4-bda5-be5ad384d28e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:37.451631 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8644a8a9-00fa-40e4-bda5-be5ad384d28e None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:37.453514 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 904/1773] 10.222.0.59 () {54 vars in 921 bytes} [Tue Sep 13 20:02:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:02:37.473623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984e54d-137e-4fdf-b626-97f92536219e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:37.474629 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984e54d-137e-4fdf-b626-97f92536219e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:37.475092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984e54d-137e-4fdf-b626-97f92536219e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:37.523479 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-9984e54d-137e-4fdf-b626-97f92536219e None None] MFA Rules not processed for user `3919b24291f54df99a9da0f5d3164ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:37.525043 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9984e54d-137e-4fdf-b626-97f92536219e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:37.719612 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 870/1774] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Sep 13 20:02:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:02:37.791399 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644a8a9-00fa-40e4-bda5-be5ad384d28e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:37.791399 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8644a8a9-00fa-40e4-bda5-be5ad384d28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:37.856971 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8644a8a9-00fa-40e4-bda5-be5ad384d28e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:37.872547 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52d33b-9f42-4496-b421-656887f41af5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:37.873647 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52d33b-9f42-4496-b421-656887f41af5 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:37.874356 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52d33b-9f42-4496-b421-656887f41af5 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:37.874789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a52d33b-9f42-4496-b421-656887f41af5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:37.908181 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52d33b-9f42-4496-b421-656887f41af5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:37.910155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a52d33b-9f42-4496-b421-656887f41af5 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:37.925226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 905/1775] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:38.507892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984e54d-137e-4fdf-b626-97f92536219e None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:38.515161 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9984e54d-137e-4fdf-b626-97f92536219e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:38.559613 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9984e54d-137e-4fdf-b626-97f92536219e None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:38.582130 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30a86b-d709-4ddd-9cc9-cf50217adb7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:38.583094 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30a86b-d709-4ddd-9cc9-cf50217adb7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:38.587227 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30a86b-d709-4ddd-9cc9-cf50217adb7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:38.587227 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30a86b-d709-4ddd-9cc9-cf50217adb7f admin admin] PATH_INFO: `/v3/projects/1ba4bdf051ff4ff4b902fddea1025438` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:38.587227 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30a86b-d709-4ddd-9cc9-cf50217adb7f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ba4bdf051ff4ff4b902fddea1025438)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:38.587868 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c30a86b-d709-4ddd-9cc9-cf50217adb7f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:38.759358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1c30a86b-d709-4ddd-9cc9-cf50217adb7f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ba4bdf051ff4ff4b902fddea1025438', 'request_id': 'req-1c30a86b-d709-4ddd-9cc9-cf50217adb7f'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:38.784417 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1c30a86b-d709-4ddd-9cc9-cf50217adb7f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ba4bdf051ff4ff4b902fddea1025438', 'request_id': 'req-1c30a86b-d709-4ddd-9cc9-cf50217adb7f'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:38.810202 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1c30a86b-d709-4ddd-9cc9-cf50217adb7f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ba4bdf051ff4ff4b902fddea1025438', 'request_id': 'req-1c30a86b-d709-4ddd-9cc9-cf50217adb7f'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:38.952784 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1c30a86b-d709-4ddd-9cc9-cf50217adb7f admin admin] The token cache is being invalidate because project 1ba4bdf051ff4ff4b902fddea1025438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:38.953222 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1c30a86b-d709-4ddd-9cc9-cf50217adb7f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:38.955306 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1c30a86b-d709-4ddd-9cc9-cf50217adb7f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:38.957461 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 871/1776] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:38 2022] DELETE /identity/v3/projects/1ba4bdf051ff4ff4b902fddea1025438 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:38.964441 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52d33b-9f42-4496-b421-656887f41af5 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:38.979431 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a52d33b-9f42-4496-b421-656887f41af5 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:39.156914 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dd6404-960e-4aa7-bb97-3e710a54f7cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:39.161411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd6404-960e-4aa7-bb97-3e710a54f7cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:39.161411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd6404-960e-4aa7-bb97-3e710a54f7cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:39.161411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dd6404-960e-4aa7-bb97-3e710a54f7cf admin admin] PATH_INFO: `/v3/users/4d054e2d246845878cdd76ce90037112` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:39.161411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd6404-960e-4aa7-bb97-3e710a54f7cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d054e2d246845878cdd76ce90037112)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:39.169205 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dd6404-960e-4aa7-bb97-3e710a54f7cf admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:39.230486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:39.566026 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-00dd6404-960e-4aa7-bb97-3e710a54f7cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d054e2d246845878cdd76ce90037112'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:39.660835 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-00dd6404-960e-4aa7-bb97-3e710a54f7cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d054e2d246845878cdd76ce90037112'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:39.688204 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-00dd6404-960e-4aa7-bb97-3e710a54f7cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d054e2d246845878cdd76ce90037112'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:39.690263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-00dd6404-960e-4aa7-bb97-3e710a54f7cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d054e2d246845878cdd76ce90037112'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:39.700189 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-00dd6404-960e-4aa7-bb97-3e710a54f7cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d054e2d246845878cdd76ce90037112'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:39.728347 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 906/1777] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:38 2022] DELETE /identity/v3/users/4d054e2d246845878cdd76ce90037112 => generated 0 bytes in 764 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:40.819126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30a86b-d709-4ddd-9cc9-cf50217adb7f admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:40.820640 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1c30a86b-d709-4ddd-9cc9-cf50217adb7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:40.862160 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30a86b-d709-4ddd-9cc9-cf50217adb7f admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:40.936342 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:40.945516 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3aa5ee-9970-4e8c-956f-ad12e8180828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:40.962695 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3aa5ee-9970-4e8c-956f-ad12e8180828 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:40.966927 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3aa5ee-9970-4e8c-956f-ad12e8180828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:40.966927 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3aa5ee-9970-4e8c-956f-ad12e8180828 admin admin] PATH_INFO: `/v3/users/e0a4a5401f734432aade04e5d86a8e28` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:40.966927 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3aa5ee-9970-4e8c-956f-ad12e8180828 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0a4a5401f734432aade04e5d86a8e28)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:40.969804 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3aa5ee-9970-4e8c-956f-ad12e8180828 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:41.163126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3e3aa5ee-9970-4e8c-956f-ad12e8180828 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0a4a5401f734432aade04e5d86a8e28'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:41.295605 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3e3aa5ee-9970-4e8c-956f-ad12e8180828 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0a4a5401f734432aade04e5d86a8e28'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:41.330340 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3e3aa5ee-9970-4e8c-956f-ad12e8180828 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0a4a5401f734432aade04e5d86a8e28'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:41.334688 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3e3aa5ee-9970-4e8c-956f-ad12e8180828 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0a4a5401f734432aade04e5d86a8e28'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:41.360139 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3e3aa5ee-9970-4e8c-956f-ad12e8180828 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0a4a5401f734432aade04e5d86a8e28'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:41.375859 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 872/1778] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:40 2022] DELETE /identity/v3/users/e0a4a5401f734432aade04e5d86a8e28 => generated 0 bytes in 557 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:41.381817 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d6e33-7ec4-4afd-9888-cd33393661f6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:41.382341 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d6e33-7ec4-4afd-9888-cd33393661f6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:41.382432 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9d6e33-7ec4-4afd-9888-cd33393661f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:41.429180 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6c9d6e33-7ec4-4afd-9888-cd33393661f6 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:41.430815 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6c9d6e33-7ec4-4afd-9888-cd33393661f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:41.572837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 907/1779] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:41.622627 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3aa5ee-9970-4e8c-956f-ad12e8180828 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:41.624567 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3e3aa5ee-9970-4e8c-956f-ad12e8180828 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:41.741983 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d6e33-7ec4-4afd-9888-cd33393661f6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:41.744015 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6c9d6e33-7ec4-4afd-9888-cd33393661f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:41.806164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9d6e33-7ec4-4afd-9888-cd33393661f6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:41.818027 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b17dd1-ebac-4fc4-b77a-65fb896d546a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:41.819005 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b17dd1-ebac-4fc4-b77a-65fb896d546a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:41.819349 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b17dd1-ebac-4fc4-b77a-65fb896d546a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:41.819743 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b17dd1-ebac-4fc4-b77a-65fb896d546a admin admin] PATH_INFO: `/v3/users/2576ed331bc24639bf81b12b83797272` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:41.821184 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b17dd1-ebac-4fc4-b77a-65fb896d546a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2576ed331bc24639bf81b12b83797272)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:41.823352 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b17dd1-ebac-4fc4-b77a-65fb896d546a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:41.830366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3aa5ee-9970-4e8c-956f-ad12e8180828 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:41.835411 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c3489b-73c8-4ba6-aa0f-ce7076c97ed3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:41.838558 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3489b-73c8-4ba6-aa0f-ce7076c97ed3 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:41.839526 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3489b-73c8-4ba6-aa0f-ce7076c97ed3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:41.840337 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3489b-73c8-4ba6-aa0f-ce7076c97ed3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:41.861548 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3489b-73c8-4ba6-aa0f-ce7076c97ed3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:41.865567 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c3489b-73c8-4ba6-aa0f-ce7076c97ed3 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:41.883950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 873/1780] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:42.015248 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e569e00-2896-4881-a0cf-dc1f1f221f78 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:42.015549 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e569e00-2896-4881-a0cf-dc1f1f221f78 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:42.016047 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e569e00-2896-4881-a0cf-dc1f1f221f78 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:42.018074 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 874/1781] 10.222.0.59 () {54 vars in 921 bytes} [Tue Sep 13 20:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:02:42.037177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ca7c6-86b3-40c8-8f69-377bea3dec3c None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:42.037708 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ca7c6-86b3-40c8-8f69-377bea3dec3c None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:42.038129 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985ca7c6-86b3-40c8-8f69-377bea3dec3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:42.088998 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-985ca7c6-86b3-40c8-8f69-377bea3dec3c None None] MFA Rules not processed for user `3919b24291f54df99a9da0f5d3164ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:42.094225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-985ca7c6-86b3-40c8-8f69-377bea3dec3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:42.104803 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-98b17dd1-ebac-4fc4-b77a-65fb896d546a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2576ed331bc24639bf81b12b83797272'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:42.198670 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-98b17dd1-ebac-4fc4-b77a-65fb896d546a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2576ed331bc24639bf81b12b83797272'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:42.232590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-98b17dd1-ebac-4fc4-b77a-65fb896d546a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2576ed331bc24639bf81b12b83797272'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:42.234238 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-98b17dd1-ebac-4fc4-b77a-65fb896d546a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2576ed331bc24639bf81b12b83797272'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:42.244032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-98b17dd1-ebac-4fc4-b77a-65fb896d546a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2576ed331bc24639bf81b12b83797272'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:42.251258 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 908/1783] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:41 2022] DELETE /identity/v3/users/2576ed331bc24639bf81b12b83797272 => generated 0 bytes in 510 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:42.251484 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 875/1783] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Sep 13 20:02:42 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:02:42.252524 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b17dd1-ebac-4fc4-b77a-65fb896d546a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:42.254050 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-98b17dd1-ebac-4fc4-b77a-65fb896d546a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:42.256918 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d66e1-135d-4051-89bf-d23c37a68cf3 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:42.261218 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d66e1-135d-4051-89bf-d23c37a68cf3 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:42.262467 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d66e1-135d-4051-89bf-d23c37a68cf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:42.263660 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:42.314201 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-4a1d66e1-135d-4051-89bf-d23c37a68cf3 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:42.315517 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4a1d66e1-135d-4051-89bf-d23c37a68cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:42.324274 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:42.440539 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b17dd1-ebac-4fc4-b77a-65fb896d546a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:42.447670 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec66fed-d511-47c9-904d-cfc9fba58a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:42.448343 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec66fed-d511-47c9-904d-cfc9fba58a14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:42.448771 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec66fed-d511-47c9-904d-cfc9fba58a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:42.449247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec66fed-d511-47c9-904d-cfc9fba58a14 admin admin] PATH_INFO: `/v3/projects/1b122518c86c4af48134ee5fc2e89b9e` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:42.450445 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec66fed-d511-47c9-904d-cfc9fba58a14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b122518c86c4af48134ee5fc2e89b9e)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:42.453250 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec66fed-d511-47c9-904d-cfc9fba58a14 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:42.495186 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 876/1784] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:42.607136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d66e1-135d-4051-89bf-d23c37a68cf3 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:42.608669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4a1d66e1-135d-4051-89bf-d23c37a68cf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:42.649289 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3ec66fed-d511-47c9-904d-cfc9fba58a14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b122518c86c4af48134ee5fc2e89b9e', 'request_id': 'req-3ec66fed-d511-47c9-904d-cfc9fba58a14'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:42.711712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d66e1-135d-4051-89bf-d23c37a68cf3 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:42.746003 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3ec66fed-d511-47c9-904d-cfc9fba58a14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b122518c86c4af48134ee5fc2e89b9e', 'request_id': 'req-3ec66fed-d511-47c9-904d-cfc9fba58a14'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:42.755275 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3ec66fed-d511-47c9-904d-cfc9fba58a14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b122518c86c4af48134ee5fc2e89b9e', 'request_id': 'req-3ec66fed-d511-47c9-904d-cfc9fba58a14'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:42.817717 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a802aa2-389a-429c-a342-bb19448e7663 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:42.817933 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3ec66fed-d511-47c9-904d-cfc9fba58a14 admin admin] The token cache is being invalidate because project 1b122518c86c4af48134ee5fc2e89b9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:42.818016 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3ec66fed-d511-47c9-904d-cfc9fba58a14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:42.818875 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3ec66fed-d511-47c9-904d-cfc9fba58a14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:42.824848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a802aa2-389a-429c-a342-bb19448e7663 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:42.824848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a802aa2-389a-429c-a342-bb19448e7663 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:42.824848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a802aa2-389a-429c-a342-bb19448e7663 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:42.825083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 909/1785] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:42 2022] DELETE /identity/v3/projects/1b122518c86c4af48134ee5fc2e89b9e => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:42.825083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec66fed-d511-47c9-904d-cfc9fba58a14 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:42.825219 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6a802aa2-389a-429c-a342-bb19448e7663 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:42.827342 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3ec66fed-d511-47c9-904d-cfc9fba58a14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:42.961316 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a802aa2-389a-429c-a342-bb19448e7663 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:42.962874 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a802aa2-389a-429c-a342-bb19448e7663 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:42.979969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 877/1786] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:02:42.982119 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f643030-c99f-4ae2-850f-161ace411e79 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:42.982729 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f643030-c99f-4ae2-850f-161ace411e79 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:42.983269 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f643030-c99f-4ae2-850f-161ace411e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:43.031717 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-6f643030-c99f-4ae2-850f-161ace411e79 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:43.034774 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6f643030-c99f-4ae2-850f-161ace411e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:43.056431 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 878/1787] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:43.058361 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec66fed-d511-47c9-904d-cfc9fba58a14 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:43.068864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac3624-c020-4bca-91c5-792e6637c74f None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:43.068864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac3624-c020-4bca-91c5-792e6637c74f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:43.068864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acac3624-c020-4bca-91c5-792e6637c74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:43.078802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ad3a4-a8d7-4a0c-9aa3-696a6b2df170 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:43.079693 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ad3a4-a8d7-4a0c-9aa3-696a6b2df170 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:43.080679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ad3a4-a8d7-4a0c-9aa3-696a6b2df170 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:43.080679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1ad3a4-a8d7-4a0c-9aa3-696a6b2df170 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:43.087826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5b1ad3a4-a8d7-4a0c-9aa3-696a6b2df170 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:43.103213 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-acac3624-c020-4bca-91c5-792e6637c74f None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:43.104619 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-acac3624-c020-4bca-91c5-792e6637c74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:43.108925 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ad3a4-a8d7-4a0c-9aa3-696a6b2df170 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:43.110596 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1ad3a4-a8d7-4a0c-9aa3-696a6b2df170 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:43.130912 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 879/1788] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:43.138234 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 910/1789] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:43.138414 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac3624-c020-4bca-91c5-792e6637c74f None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:43.158927 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acac3624-c020-4bca-91c5-792e6637c74f None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:43.168035 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f26d2-900b-4956-aa65-cd866d1ac612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:43.170448 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f26d2-900b-4956-aa65-cd866d1ac612 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:43.170448 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f26d2-900b-4956-aa65-cd866d1ac612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:43.170448 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132f26d2-900b-4956-aa65-cd866d1ac612 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:43.170448 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f26d2-900b-4956-aa65-cd866d1ac612 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:02:43.170448 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f26d2-900b-4956-aa65-cd866d1ac612 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:43.173206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132f26d2-900b-4956-aa65-cd866d1ac612 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:43.207187 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 880/1790] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:02:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:02:43.213826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ad3a4-a8d7-4a0c-9aa3-696a6b2df170 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:43.239865 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1ad3a4-a8d7-4a0c-9aa3-696a6b2df170 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:43.247294 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3434e3d-99e4-4bd6-a578-d2c569e9f54b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:43.248003 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3434e3d-99e4-4bd6-a578-d2c569e9f54b admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:43.248460 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3434e3d-99e4-4bd6-a578-d2c569e9f54b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:43.248885 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3434e3d-99e4-4bd6-a578-d2c569e9f54b admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:43.249676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3434e3d-99e4-4bd6-a578-d2c569e9f54b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:43.254056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3434e3d-99e4-4bd6-a578-d2c569e9f54b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:43.445114 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f26d2-900b-4956-aa65-cd866d1ac612 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:43.454801 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 911/1791] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:02:43 2022] POST /identity/v3/projects => generated 387 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:43.460902 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132f26d2-900b-4956-aa65-cd866d1ac612 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:43.599134 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44133a-0419-45c8-816c-2f43ddc5f2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:43.606115 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44133a-0419-45c8-816c-2f43ddc5f2df admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:43.608240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44133a-0419-45c8-816c-2f43ddc5f2df admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:43.609453 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:43.609944 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44133a-0419-45c8-816c-2f43ddc5f2df admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:43.614050 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44133a-0419-45c8-816c-2f43ddc5f2df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:43.627016 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44133a-0419-45c8-816c-2f43ddc5f2df admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:43.777246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:43.786434 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 881/1792] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:02:43 2022] POST /identity/v3/users => generated 294 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:02:43.790435 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3434e3d-99e4-4bd6-a578-d2c569e9f54b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:43.810405 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3434e3d-99e4-4bd6-a578-d2c569e9f54b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:43.837297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810c849-844d-4ae2-b4e5-a535be563b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:43.847229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810c849-844d-4ae2-b4e5-a535be563b55 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:43.847591 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810c849-844d-4ae2-b4e5-a535be563b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:43.851511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7810c849-844d-4ae2-b4e5-a535be563b55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:43.851732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44133a-0419-45c8-816c-2f43ddc5f2df admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:43.851823 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810c849-844d-4ae2-b4e5-a535be563b55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:43.851917 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5a44133a-0419-45c8-816c-2f43ddc5f2df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:43.852639 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7810c849-844d-4ae2-b4e5-a535be563b55 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:43.892268 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44133a-0419-45c8-816c-2f43ddc5f2df admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:43.901906 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64459da4-3a31-4641-bf12-b6b9f0e1a068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:43.903108 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 912/1793] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:43.903872 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64459da4-3a31-4641-bf12-b6b9f0e1a068 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:43.904187 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810c849-844d-4ae2-b4e5-a535be563b55 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:43.904487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64459da4-3a31-4641-bf12-b6b9f0e1a068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:43.904943 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64459da4-3a31-4641-bf12-b6b9f0e1a068 admin admin] PATH_INFO: `/v3/projects/ac5cdb225de5493da46b32fb79d54005` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:43.914620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64459da4-3a31-4641-bf12-b6b9f0e1a068 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac5cdb225de5493da46b32fb79d54005)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:43.914620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64459da4-3a31-4641-bf12-b6b9f0e1a068 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:43.928768 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7810c849-844d-4ae2-b4e5-a535be563b55 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:43.940019 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59d3c2-86d8-4e30-91d6-5bae7419ba73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:43.940726 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59d3c2-86d8-4e30-91d6-5bae7419ba73 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:43.946764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59d3c2-86d8-4e30-91d6-5bae7419ba73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:43.946764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c59d3c2-86d8-4e30-91d6-5bae7419ba73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:43.946764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59d3c2-86d8-4e30-91d6-5bae7419ba73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:43.946764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c59d3c2-86d8-4e30-91d6-5bae7419ba73 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:43.974441 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 913/1794] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:43 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:43.978933 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59d3c2-86d8-4e30-91d6-5bae7419ba73 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:43.994751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c59d3c2-86d8-4e30-91d6-5bae7419ba73 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:43.996027 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b40acd-fc46-485d-8d80-6bff7077b792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:43.997052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b40acd-fc46-485d-8d80-6bff7077b792 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:43.997208 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b40acd-fc46-485d-8d80-6bff7077b792 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:43.997453 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b40acd-fc46-485d-8d80-6bff7077b792 admin admin] PATH_INFO: `/v3/projects/dcbf8af3c83a47bcbfcb6acdf77b63fc/users/d102aaadad9244fa9027fabb8f42559a/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:44.015599 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b40acd-fc46-485d-8d80-6bff7077b792 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dcbf8af3c83a47bcbfcb6acdf77b63fc, user_id=d102aaadad9244fa9027fabb8f42559a, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:44.019183 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b40acd-fc46-485d-8d80-6bff7077b792 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:44.045804 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-64459da4-3a31-4641-bf12-b6b9f0e1a068 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac5cdb225de5493da46b32fb79d54005', 'request_id': 'req-64459da4-3a31-4641-bf12-b6b9f0e1a068'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:44.052995 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-64459da4-3a31-4641-bf12-b6b9f0e1a068 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac5cdb225de5493da46b32fb79d54005', 'request_id': 'req-64459da4-3a31-4641-bf12-b6b9f0e1a068'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:44.062951 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-64459da4-3a31-4641-bf12-b6b9f0e1a068 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac5cdb225de5493da46b32fb79d54005', 'request_id': 'req-64459da4-3a31-4641-bf12-b6b9f0e1a068'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:44.108584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 914/1795] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:43 2022] PUT /identity/v3/projects/dcbf8af3c83a47bcbfcb6acdf77b63fc/users/d102aaadad9244fa9027fabb8f42559a/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:44.120161 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5be213-8e82-46fe-ae56-c5b638d92cf5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:44.120475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5be213-8e82-46fe-ae56-c5b638d92cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:44.120725 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5be213-8e82-46fe-ae56-c5b638d92cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:44.139234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-64459da4-3a31-4641-bf12-b6b9f0e1a068 admin admin] The token cache is being invalidate because project ac5cdb225de5493da46b32fb79d54005 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:44.139975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-64459da4-3a31-4641-bf12-b6b9f0e1a068 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:44.140854 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-64459da4-3a31-4641-bf12-b6b9f0e1a068 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:44.143234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 882/1796] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:43 2022] DELETE /identity/v3/projects/ac5cdb225de5493da46b32fb79d54005 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:44.148755 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64459da4-3a31-4641-bf12-b6b9f0e1a068 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:44.152046 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-64459da4-3a31-4641-bf12-b6b9f0e1a068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:44.204718 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0c5be213-8e82-46fe-ae56-c5b638d92cf5 None None] MFA Rules not processed for user `d102aaadad9244fa9027fabb8f42559a`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:44.206011 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0c5be213-8e82-46fe-ae56-c5b638d92cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:44.367663 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64459da4-3a31-4641-bf12-b6b9f0e1a068 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:44.394860 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:44.451957 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 915/1797] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:44 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:44.453272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5be213-8e82-46fe-ae56-c5b638d92cf5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:44.455546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0c5be213-8e82-46fe-ae56-c5b638d92cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:44.528082 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e38ff0-f04d-4acd-9328-7c8681c31e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:44.529679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e38ff0-f04d-4acd-9328-7c8681c31e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:44.531789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e38ff0-f04d-4acd-9328-7c8681c31e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:44.532362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e38ff0-f04d-4acd-9328-7c8681c31e07 admin admin] PATH_INFO: `/v3/users/095caa72a91f4d71b58e882459ae86d7` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:44.538487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e38ff0-f04d-4acd-9328-7c8681c31e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=095caa72a91f4d71b58e882459ae86d7)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:44.541976 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e38ff0-f04d-4acd-9328-7c8681c31e07 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:44.570388 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5be213-8e82-46fe-ae56-c5b638d92cf5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:44.596161 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49be05-5660-4eb4-bb44-0fdb3f8ae72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:44.607477 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49be05-5660-4eb4-bb44-0fdb3f8ae72d admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:44.607837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49be05-5660-4eb4-bb44-0fdb3f8ae72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:44.608391 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f49be05-5660-4eb4-bb44-0fdb3f8ae72d admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:44.614248 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49be05-5660-4eb4-bb44-0fdb3f8ae72d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:44.622624 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f49be05-5660-4eb4-bb44-0fdb3f8ae72d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:44.784298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 916/1798] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:02:44 2022] POST /identity/v3/projects => generated 387 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:02:44.790823 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49be05-5660-4eb4-bb44-0fdb3f8ae72d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:44.835394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-63e38ff0-f04d-4acd-9328-7c8681c31e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '095caa72a91f4d71b58e882459ae86d7'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:44.852926 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:44.919528 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-63e38ff0-f04d-4acd-9328-7c8681c31e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '095caa72a91f4d71b58e882459ae86d7'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:44.946989 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-63e38ff0-f04d-4acd-9328-7c8681c31e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '095caa72a91f4d71b58e882459ae86d7'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:44.947677 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f49be05-5660-4eb4-bb44-0fdb3f8ae72d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:44.948242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-63e38ff0-f04d-4acd-9328-7c8681c31e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '095caa72a91f4d71b58e882459ae86d7'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:44.960635 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1d6be-08b8-4974-be34-8e85b3a3f322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:44.964477 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1d6be-08b8-4974-be34-8e85b3a3f322 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:44.964477 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1d6be-08b8-4974-be34-8e85b3a3f322 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:44.964477 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e1d6be-08b8-4974-be34-8e85b3a3f322 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:44.964477 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1d6be-08b8-4974-be34-8e85b3a3f322 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:44.965338 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-63e38ff0-f04d-4acd-9328-7c8681c31e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '095caa72a91f4d71b58e882459ae86d7'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:44.970280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e1d6be-08b8-4974-be34-8e85b3a3f322 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:44.996226 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 883/1799] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:44 2022] DELETE /identity/v3/users/095caa72a91f4d71b58e882459ae86d7 => generated 0 bytes in 848 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:44.998007 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e38ff0-f04d-4acd-9328-7c8681c31e07 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:44.999921 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-63e38ff0-f04d-4acd-9328-7c8681c31e07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:45.096955 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 917/1800] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:02:44 2022] POST /identity/v3/users => generated 300 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:45.100990 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1d6be-08b8-4974-be34-8e85b3a3f322 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:45.103234 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-19e1d6be-08b8-4974-be34-8e85b3a3f322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:45.125531 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e1d6be-08b8-4974-be34-8e85b3a3f322 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:45.134124 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a375f5-c361-4059-8e7e-c3413dddbfaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:45.135102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a375f5-c361-4059-8e7e-c3413dddbfaf admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:45.135621 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a375f5-c361-4059-8e7e-c3413dddbfaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:45.136142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a375f5-c361-4059-8e7e-c3413dddbfaf admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:45.137037 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a375f5-c361-4059-8e7e-c3413dddbfaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:45.139164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a375f5-c361-4059-8e7e-c3413dddbfaf admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:45.156803 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 918/1801] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:45.158445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e38ff0-f04d-4acd-9328-7c8681c31e07 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:45.162278 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a375f5-c361-4059-8e7e-c3413dddbfaf admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:45.181706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2033d-f470-4d40-bbd1-125cfa118bfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:45.182756 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2033d-f470-4d40-bbd1-125cfa118bfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:45.184870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2033d-f470-4d40-bbd1-125cfa118bfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:45.185504 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2033d-f470-4d40-bbd1-125cfa118bfb admin admin] PATH_INFO: `/v3/projects/55d8a8af39de47a382d2a43e1120a438` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:45.190206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2033d-f470-4d40-bbd1-125cfa118bfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=55d8a8af39de47a382d2a43e1120a438)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:45.195400 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2033d-f470-4d40-bbd1-125cfa118bfb admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:45.196473 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a375f5-c361-4059-8e7e-c3413dddbfaf admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:45.212954 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b27fc1-4833-4903-89ae-9771c804b7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:45.214147 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b27fc1-4833-4903-89ae-9771c804b7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:45.214776 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b27fc1-4833-4903-89ae-9771c804b7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:45.215520 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b27fc1-4833-4903-89ae-9771c804b7b5 admin admin] PATH_INFO: `/v3/projects/2340385aca7b49edac58d5b3d9d01123/users/3f259f1b2b454ed898ce4f8f0644e23c/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:45.274591 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b27fc1-4833-4903-89ae-9771c804b7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2340385aca7b49edac58d5b3d9d01123, user_id=3f259f1b2b454ed898ce4f8f0644e23c, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:45.277795 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b27fc1-4833-4903-89ae-9771c804b7b5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:45.400675 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 919/1802] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:45 2022] PUT /identity/v3/projects/2340385aca7b49edac58d5b3d9d01123/users/3f259f1b2b454ed898ce4f8f0644e23c/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:45.404307 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b27fc1-4833-4903-89ae-9771c804b7b5 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:45.421283 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-35b2033d-f470-4d40-bbd1-125cfa118bfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55d8a8af39de47a382d2a43e1120a438', 'request_id': 'req-35b2033d-f470-4d40-bbd1-125cfa118bfb'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:45.456109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-35b2033d-f470-4d40-bbd1-125cfa118bfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55d8a8af39de47a382d2a43e1120a438', 'request_id': 'req-35b2033d-f470-4d40-bbd1-125cfa118bfb'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:45.466035 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-35b2033d-f470-4d40-bbd1-125cfa118bfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55d8a8af39de47a382d2a43e1120a438', 'request_id': 'req-35b2033d-f470-4d40-bbd1-125cfa118bfb'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:45.486711 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:45.552019 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-35b2033d-f470-4d40-bbd1-125cfa118bfb admin admin] The token cache is being invalidate because project 55d8a8af39de47a382d2a43e1120a438 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:45.552632 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-35b2033d-f470-4d40-bbd1-125cfa118bfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:45.568732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-35b2033d-f470-4d40-bbd1-125cfa118bfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:45.574002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 884/1803] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:44 2022] DELETE /identity/v3/projects/55d8a8af39de47a382d2a43e1120a438 => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:45.580791 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2033d-f470-4d40-bbd1-125cfa118bfb admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:45.593730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b27fc1-4833-4903-89ae-9771c804b7b5 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:45.600746 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-35b2033d-f470-4d40-bbd1-125cfa118bfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:45.764614 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f243aa8-0bfc-4caf-ae0e-8f02c62ab1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:45.766249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f243aa8-0bfc-4caf-ae0e-8f02c62ab1ac admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:45.767132 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f243aa8-0bfc-4caf-ae0e-8f02c62ab1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:45.767963 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f243aa8-0bfc-4caf-ae0e-8f02c62ab1ac admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:45.769280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f243aa8-0bfc-4caf-ae0e-8f02c62ab1ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:45.773757 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f243aa8-0bfc-4caf-ae0e-8f02c62ab1ac admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:45.787233 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2033d-f470-4d40-bbd1-125cfa118bfb admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:45.801509 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 920/1804] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:02:45.802077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adb2457-7569-420a-b685-761e60970199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:45.802077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb2457-7569-420a-b685-761e60970199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:45.802077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb2457-7569-420a-b685-761e60970199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:45.802077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adb2457-7569-420a-b685-761e60970199 admin admin] PATH_INFO: `/v3/users/12c0c9f701894fb4806f1e46cba9d808` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:45.803267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb2457-7569-420a-b685-761e60970199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12c0c9f701894fb4806f1e46cba9d808)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:45.803382 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f243aa8-0bfc-4caf-ae0e-8f02c62ab1ac admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:45.805187 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adb2457-7569-420a-b685-761e60970199 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:45.811875 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8f243aa8-0bfc-4caf-ae0e-8f02c62ab1ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:45.857849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f243aa8-0bfc-4caf-ae0e-8f02c62ab1ac admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:45.872898 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06420529-214d-4659-857f-320acea6bddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:45.873651 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06420529-214d-4659-857f-320acea6bddc admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:45.873960 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06420529-214d-4659-857f-320acea6bddc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:45.874235 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06420529-214d-4659-857f-320acea6bddc admin admin] PATH_INFO: `/v3/projects/2340385aca7b49edac58d5b3d9d01123/users/3f259f1b2b454ed898ce4f8f0644e23c/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:45.881587 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06420529-214d-4659-857f-320acea6bddc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2340385aca7b49edac58d5b3d9d01123, user_id=3f259f1b2b454ed898ce4f8f0644e23c, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:45.889431 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06420529-214d-4659-857f-320acea6bddc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:45.906197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 921/1805] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:45 2022] PUT /identity/v3/projects/2340385aca7b49edac58d5b3d9d01123/users/3f259f1b2b454ed898ce4f8f0644e23c/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:45.919638 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a695fe-62a3-48e3-ad6e-438d5e9dc2f5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:45.920270 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a695fe-62a3-48e3-ad6e-438d5e9dc2f5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:45.921597 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a695fe-62a3-48e3-ad6e-438d5e9dc2f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:45.954366 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:45.969251 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e0a695fe-62a3-48e3-ad6e-438d5e9dc2f5 None None] MFA Rules not processed for user `3f259f1b2b454ed898ce4f8f0644e23c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:45.971576 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e0a695fe-62a3-48e3-ad6e-438d5e9dc2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:46.068109 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 922/1806] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:45 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:46.081152 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a695fe-62a3-48e3-ad6e-438d5e9dc2f5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:46.082595 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e0a695fe-62a3-48e3-ad6e-438d5e9dc2f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:46.160082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a695fe-62a3-48e3-ad6e-438d5e9dc2f5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:46.164359 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9977d47-91dd-4c85-8a13-15304e0217ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:46.165004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9977d47-91dd-4c85-8a13-15304e0217ce service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:46.165285 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9977d47-91dd-4c85-8a13-15304e0217ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:46.165558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9977d47-91dd-4c85-8a13-15304e0217ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:46.175901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9977d47-91dd-4c85-8a13-15304e0217ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:46.177336 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9977d47-91dd-4c85-8a13-15304e0217ce service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:46.188066 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 923/1807] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:46 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:46.285160 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9977d47-91dd-4c85-8a13-15304e0217ce service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:46.369625 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9977d47-91dd-4c85-8a13-15304e0217ce service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:46.375206 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fc622-9315-4630-b99f-dc394285fda5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:46.376100 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fc622-9315-4630-b99f-dc394285fda5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:46.376769 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fc622-9315-4630-b99f-dc394285fda5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:46.377122 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fc622-9315-4630-b99f-dc394285fda5 admin admin] PATH_INFO: `/v3/users/d102aaadad9244fa9027fabb8f42559a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:46.379016 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fc622-9315-4630-b99f-dc394285fda5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d102aaadad9244fa9027fabb8f42559a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:46.381492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fc622-9315-4630-b99f-dc394285fda5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:46.396661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6adb2457-7569-420a-b685-761e60970199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12c0c9f701894fb4806f1e46cba9d808'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:46.459730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6adb2457-7569-420a-b685-761e60970199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12c0c9f701894fb4806f1e46cba9d808'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:46.475443 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6adb2457-7569-420a-b685-761e60970199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12c0c9f701894fb4806f1e46cba9d808'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:46.477398 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6adb2457-7569-420a-b685-761e60970199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12c0c9f701894fb4806f1e46cba9d808'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:46.485589 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6adb2457-7569-420a-b685-761e60970199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12c0c9f701894fb4806f1e46cba9d808'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:46.495886 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 885/1808] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:45 2022] DELETE /identity/v3/users/12c0c9f701894fb4806f1e46cba9d808 => generated 0 bytes in 915 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:46.586513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f64fc622-9315-4630-b99f-dc394285fda5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd102aaadad9244fa9027fabb8f42559a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:46.688441 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f64fc622-9315-4630-b99f-dc394285fda5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd102aaadad9244fa9027fabb8f42559a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:46.703477 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f64fc622-9315-4630-b99f-dc394285fda5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd102aaadad9244fa9027fabb8f42559a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:46.704402 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f64fc622-9315-4630-b99f-dc394285fda5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd102aaadad9244fa9027fabb8f42559a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:46.712866 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f64fc622-9315-4630-b99f-dc394285fda5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd102aaadad9244fa9027fabb8f42559a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:46.720687 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 924/1809] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:46 2022] DELETE /identity/v3/users/d102aaadad9244fa9027fabb8f42559a => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:02:46.724937 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b44ac-d7be-4225-b0d3-8c17ae28e0c1 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:46.725477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b44ac-d7be-4225-b0d3-8c17ae28e0c1 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:46.725787 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-208b44ac-d7be-4225-b0d3-8c17ae28e0c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:46.746395 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-208b44ac-d7be-4225-b0d3-8c17ae28e0c1 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:46.747749 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-208b44ac-d7be-4225-b0d3-8c17ae28e0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:46.819433 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 886/1810] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:46.833863 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fc622-9315-4630-b99f-dc394285fda5 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:46.836575 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f64fc622-9315-4630-b99f-dc394285fda5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:46.934135 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fc622-9315-4630-b99f-dc394285fda5 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:46.939573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d4b13-ee97-40ef-833e-f5706d22ac79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:46.940205 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d4b13-ee97-40ef-833e-f5706d22ac79 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:46.941252 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d4b13-ee97-40ef-833e-f5706d22ac79 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:46.941252 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d4b13-ee97-40ef-833e-f5706d22ac79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:46.953115 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d4b13-ee97-40ef-833e-f5706d22ac79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:46.954670 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662d4b13-ee97-40ef-833e-f5706d22ac79 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:46.967896 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 925/1811] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:47.063722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b44ac-d7be-4225-b0d3-8c17ae28e0c1 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:47.065573 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-208b44ac-d7be-4225-b0d3-8c17ae28e0c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:47.083303 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-208b44ac-d7be-4225-b0d3-8c17ae28e0c1 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:47.108711 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1bdeeb-811e-4b83-bce8-6a75810604bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:47.110156 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bdeeb-811e-4b83-bce8-6a75810604bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:47.111972 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bdeeb-811e-4b83-bce8-6a75810604bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:47.112570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1bdeeb-811e-4b83-bce8-6a75810604bd admin admin] PATH_INFO: `/v3/projects/1c8fa310ce9d44088bd13413f02876cb` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:47.123080 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1bdeeb-811e-4b83-bce8-6a75810604bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c8fa310ce9d44088bd13413f02876cb)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:47.126221 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1bdeeb-811e-4b83-bce8-6a75810604bd admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:47.257119 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d4b13-ee97-40ef-833e-f5706d22ac79 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:47.258827 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-662d4b13-ee97-40ef-833e-f5706d22ac79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:47.269385 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3e1bdeeb-811e-4b83-bce8-6a75810604bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c8fa310ce9d44088bd13413f02876cb', 'request_id': 'req-3e1bdeeb-811e-4b83-bce8-6a75810604bd'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:47.275706 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d4b13-ee97-40ef-833e-f5706d22ac79 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:47.280812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3e1bdeeb-811e-4b83-bce8-6a75810604bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c8fa310ce9d44088bd13413f02876cb', 'request_id': 'req-3e1bdeeb-811e-4b83-bce8-6a75810604bd'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:47.287934 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3e1bdeeb-811e-4b83-bce8-6a75810604bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c8fa310ce9d44088bd13413f02876cb', 'request_id': 'req-3e1bdeeb-811e-4b83-bce8-6a75810604bd'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:47.362128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661126f4-46d5-405f-a6b1-39d68f7b906a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:47.362877 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661126f4-46d5-405f-a6b1-39d68f7b906a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:47.363244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661126f4-46d5-405f-a6b1-39d68f7b906a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:47.363588 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661126f4-46d5-405f-a6b1-39d68f7b906a admin admin] PATH_INFO: `/v3/projects/41579ec4a69241a39874b6acb8026a4c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:47.364765 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661126f4-46d5-405f-a6b1-39d68f7b906a admin admin] RBAC: Authorizing `identity:delete_project(project_id=41579ec4a69241a39874b6acb8026a4c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:47.366856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661126f4-46d5-405f-a6b1-39d68f7b906a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:47.384358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3e1bdeeb-811e-4b83-bce8-6a75810604bd admin admin] The token cache is being invalidate because project 1c8fa310ce9d44088bd13413f02876cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:47.384657 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3e1bdeeb-811e-4b83-bce8-6a75810604bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:47.386123 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3e1bdeeb-811e-4b83-bce8-6a75810604bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:47.387788 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 887/1812] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:47 2022] DELETE /identity/v3/projects/1c8fa310ce9d44088bd13413f02876cb => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:47.392568 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6937e-f0e7-4796-948a-30d3a7b06064 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:47.392853 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6937e-f0e7-4796-948a-30d3a7b06064 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:47.393133 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6937e-f0e7-4796-948a-30d3a7b06064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:47.412439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-7df6937e-f0e7-4796-948a-30d3a7b06064 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:47.413649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7df6937e-f0e7-4796-948a-30d3a7b06064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:47.422041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 888/1813] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:02:47.429467 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde6b85-36c9-4d5f-b378-7a84e64468c8 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:47.429779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde6b85-36c9-4d5f-b378-7a84e64468c8 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:47.430055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fde6b85-36c9-4d5f-b378-7a84e64468c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:47.464932 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-5fde6b85-36c9-4d5f-b378-7a84e64468c8 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:47.466240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5fde6b85-36c9-4d5f-b378-7a84e64468c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:47.485958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 889/1814] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:02:47.487097 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde6b85-36c9-4d5f-b378-7a84e64468c8 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:47.489737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5fde6b85-36c9-4d5f-b378-7a84e64468c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:47.492613 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-661126f4-46d5-405f-a6b1-39d68f7b906a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41579ec4a69241a39874b6acb8026a4c', 'request_id': 'req-661126f4-46d5-405f-a6b1-39d68f7b906a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:47.505266 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fde6b85-36c9-4d5f-b378-7a84e64468c8 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:47.545809 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-661126f4-46d5-405f-a6b1-39d68f7b906a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41579ec4a69241a39874b6acb8026a4c', 'request_id': 'req-661126f4-46d5-405f-a6b1-39d68f7b906a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:47.548544 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:47.554595 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-661126f4-46d5-405f-a6b1-39d68f7b906a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41579ec4a69241a39874b6acb8026a4c', 'request_id': 'req-661126f4-46d5-405f-a6b1-39d68f7b906a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:47.567297 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e588c-9e23-4630-af12-330a9aa2f3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:47.568212 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e588c-9e23-4630-af12-330a9aa2f3a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:47.568621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e588c-9e23-4630-af12-330a9aa2f3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:47.568995 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e588c-9e23-4630-af12-330a9aa2f3a6 admin admin] PATH_INFO: `/v3/projects/dcbf8af3c83a47bcbfcb6acdf77b63fc` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:47.570268 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e588c-9e23-4630-af12-330a9aa2f3a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dcbf8af3c83a47bcbfcb6acdf77b63fc)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:47.572693 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e588c-9e23-4630-af12-330a9aa2f3a6 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:47.581422 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-661126f4-46d5-405f-a6b1-39d68f7b906a admin admin] The token cache is being invalidate because project 41579ec4a69241a39874b6acb8026a4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:47.581755 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-661126f4-46d5-405f-a6b1-39d68f7b906a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:47.582845 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-661126f4-46d5-405f-a6b1-39d68f7b906a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:47.584760 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 926/1815] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:47 2022] DELETE /identity/v3/projects/41579ec4a69241a39874b6acb8026a4c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:47.585552 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661126f4-46d5-405f-a6b1-39d68f7b906a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:47.586922 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-661126f4-46d5-405f-a6b1-39d68f7b906a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:47.603892 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661126f4-46d5-405f-a6b1-39d68f7b906a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:47.609866 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4b0867-cf49-489f-80e7-35cceb87b556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:47.610610 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b0867-cf49-489f-80e7-35cceb87b556 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:47.610906 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b0867-cf49-489f-80e7-35cceb87b556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:47.611174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4b0867-cf49-489f-80e7-35cceb87b556 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:47.611855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b0867-cf49-489f-80e7-35cceb87b556 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:02:47.612162 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b0867-cf49-489f-80e7-35cceb87b556 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:47.613785 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4b0867-cf49-489f-80e7-35cceb87b556 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:47.627989 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 927/1816] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:02:47.629047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384ae3f-c980-4d85-9a39-cef0deaf4c69 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:47.629329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384ae3f-c980-4d85-9a39-cef0deaf4c69 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:47.629599 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b384ae3f-c980-4d85-9a39-cef0deaf4c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:47.650762 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b384ae3f-c980-4d85-9a39-cef0deaf4c69 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:47.654414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b384ae3f-c980-4d85-9a39-cef0deaf4c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:47.663200 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 928/1817] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:47.664167 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384ae3f-c980-4d85-9a39-cef0deaf4c69 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:47.674754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b384ae3f-c980-4d85-9a39-cef0deaf4c69 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:47.679617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8022a7b-b8b8-45cc-83fb-520956628702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:47.680389 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8022a7b-b8b8-45cc-83fb-520956628702 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:47.680800 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8022a7b-b8b8-45cc-83fb-520956628702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:47.681172 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8022a7b-b8b8-45cc-83fb-520956628702 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:47.681874 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8022a7b-b8b8-45cc-83fb-520956628702 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:47.684406 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8022a7b-b8b8-45cc-83fb-520956628702 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:47.703977 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-903e588c-9e23-4630-af12-330a9aa2f3a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dcbf8af3c83a47bcbfcb6acdf77b63fc', 'request_id': 'req-903e588c-9e23-4630-af12-330a9aa2f3a6'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:47.709715 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-903e588c-9e23-4630-af12-330a9aa2f3a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dcbf8af3c83a47bcbfcb6acdf77b63fc', 'request_id': 'req-903e588c-9e23-4630-af12-330a9aa2f3a6'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:47.717518 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-903e588c-9e23-4630-af12-330a9aa2f3a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dcbf8af3c83a47bcbfcb6acdf77b63fc', 'request_id': 'req-903e588c-9e23-4630-af12-330a9aa2f3a6'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:47.821776 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 929/1818] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:02:47 2022] POST /identity/v3/projects => generated 367 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:47.823584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a7d7a-f657-493c-bde4-a136c5917d94 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:47.827719 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a7d7a-f657-493c-bde4-a136c5917d94 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:47.827719 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a7d7a-f657-493c-bde4-a136c5917d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:47.844436 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e37a7d7a-f657-493c-bde4-a136c5917d94 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:47.845836 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e37a7d7a-f657-493c-bde4-a136c5917d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:47.848163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-903e588c-9e23-4630-af12-330a9aa2f3a6 admin admin] The token cache is being invalidate because project dcbf8af3c83a47bcbfcb6acdf77b63fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:47.856747 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-903e588c-9e23-4630-af12-330a9aa2f3a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:47.856747 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-903e588c-9e23-4630-af12-330a9aa2f3a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:47.856747 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 890/1819] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:47 2022] DELETE /identity/v3/projects/dcbf8af3c83a47bcbfcb6acdf77b63fc => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:47.856747 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e588c-9e23-4630-af12-330a9aa2f3a6 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:47.856747 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-903e588c-9e23-4630-af12-330a9aa2f3a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:47.922255 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 930/1820] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:47.926815 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a7d7a-f657-493c-bde4-a136c5917d94 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:47.928341 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e37a7d7a-f657-493c-bde4-a136c5917d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:47.940998 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e588c-9e23-4630-af12-330a9aa2f3a6 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:47.942943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a7d7a-f657-493c-bde4-a136c5917d94 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:47.947388 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a350a39-306b-420e-a894-04fb888409da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:47.948025 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a350a39-306b-420e-a894-04fb888409da admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:47.949496 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a350a39-306b-420e-a894-04fb888409da admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:47.949496 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a350a39-306b-420e-a894-04fb888409da admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:47.949496 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a350a39-306b-420e-a894-04fb888409da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:47.951097 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9fc1a-3543-4fc7-b373-7012660ba463 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:47.951384 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a350a39-306b-420e-a894-04fb888409da admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:47.952131 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9fc1a-3543-4fc7-b373-7012660ba463 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:47.952547 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9fc1a-3543-4fc7-b373-7012660ba463 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:47.952965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9fc1a-3543-4fc7-b373-7012660ba463 admin admin] PATH_INFO: `/v3/users/3f259f1b2b454ed898ce4f8f0644e23c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:47.954444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9fc1a-3543-4fc7-b373-7012660ba463 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f259f1b2b454ed898ce4f8f0644e23c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:47.957603 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a9fc1a-3543-4fc7-b373-7012660ba463 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:48.052310 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 891/1821] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:02:47 2022] POST /identity/v3/users => generated 284 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:48.052310 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a350a39-306b-420e-a894-04fb888409da admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:48.063344 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a350a39-306b-420e-a894-04fb888409da admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:48.069018 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8213be-2d10-46f1-9c32-d057bc1f66d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:48.069883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8213be-2d10-46f1-9c32-d057bc1f66d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:48.070396 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8213be-2d10-46f1-9c32-d057bc1f66d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:48.070851 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8213be-2d10-46f1-9c32-d057bc1f66d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:48.072790 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:48.073842 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8213be-2d10-46f1-9c32-d057bc1f66d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:02:48.074161 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8213be-2d10-46f1-9c32-d057bc1f66d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:48.075785 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8213be-2d10-46f1-9c32-d057bc1f66d6 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:48.088651 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 892/1822] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:02:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:02:48.089480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8213be-2d10-46f1-9c32-d057bc1f66d6 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:48.100612 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8213be-2d10-46f1-9c32-d057bc1f66d6 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:48.106557 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b54c5-2ceb-47e8-b85e-5614bb3dba9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:48.107171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b54c5-2ceb-47e8-b85e-5614bb3dba9f admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:48.107446 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b54c5-2ceb-47e8-b85e-5614bb3dba9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:48.113551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b54c5-2ceb-47e8-b85e-5614bb3dba9f admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:48.113551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b54c5-2ceb-47e8-b85e-5614bb3dba9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:48.113551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b54c5-2ceb-47e8-b85e-5614bb3dba9f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:48.120334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 893/1823] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:48.124323 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b54c5-2ceb-47e8-b85e-5614bb3dba9f admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:48.135271 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b54c5-2ceb-47e8-b85e-5614bb3dba9f admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:48.140829 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90705fa2-cddb-4fbc-a242-7d33def7ff8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:48.147299 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90705fa2-cddb-4fbc-a242-7d33def7ff8b admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:48.147299 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90705fa2-cddb-4fbc-a242-7d33def7ff8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:48.147299 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90705fa2-cddb-4fbc-a242-7d33def7ff8b admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:48.147299 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90705fa2-cddb-4fbc-a242-7d33def7ff8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:48.147299 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90705fa2-cddb-4fbc-a242-7d33def7ff8b admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:48.196369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-81a9fc1a-3543-4fc7-b373-7012660ba463 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f259f1b2b454ed898ce4f8f0644e23c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:48.234370 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 894/1824] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:02:48 2022] POST /identity/v3/projects => generated 365 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:48.240084 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90705fa2-cddb-4fbc-a242-7d33def7ff8b admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:48.313327 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-81a9fc1a-3543-4fc7-b373-7012660ba463 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f259f1b2b454ed898ce4f8f0644e23c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:48.313571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90705fa2-cddb-4fbc-a242-7d33def7ff8b admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:48.319790 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a452d9-bc4b-46d0-ad5d-2d28fb7c5522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:48.320924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a452d9-bc4b-46d0-ad5d-2d28fb7c5522 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:48.321090 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a452d9-bc4b-46d0-ad5d-2d28fb7c5522 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:48.321373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a452d9-bc4b-46d0-ad5d-2d28fb7c5522 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:48.322059 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a452d9-bc4b-46d0-ad5d-2d28fb7c5522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:48.323113 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-81a9fc1a-3543-4fc7-b373-7012660ba463 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f259f1b2b454ed898ce4f8f0644e23c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:48.323675 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a452d9-bc4b-46d0-ad5d-2d28fb7c5522 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:48.324018 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-81a9fc1a-3543-4fc7-b373-7012660ba463 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f259f1b2b454ed898ce4f8f0644e23c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:48.332138 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-81a9fc1a-3543-4fc7-b373-7012660ba463 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f259f1b2b454ed898ce4f8f0644e23c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:48.335725 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 895/1825] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:48.336623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a452d9-bc4b-46d0-ad5d-2d28fb7c5522 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:48.338408 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d0a452d9-bc4b-46d0-ad5d-2d28fb7c5522 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:48.343471 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 931/1826] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:47 2022] DELETE /identity/v3/users/3f259f1b2b454ed898ce4f8f0644e23c => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:48.350896 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9fc1a-3543-4fc7-b373-7012660ba463 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:48.350896 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-81a9fc1a-3543-4fc7-b373-7012660ba463 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:48.353182 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a452d9-bc4b-46d0-ad5d-2d28fb7c5522 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:48.447795 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0438d-e630-4e1e-9015-350bddf18f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:48.448613 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0438d-e630-4e1e-9015-350bddf18f0a admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:48.449620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0438d-e630-4e1e-9015-350bddf18f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:48.449987 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df0438d-e630-4e1e-9015-350bddf18f0a admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:48.450702 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0438d-e630-4e1e-9015-350bddf18f0a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:48.454206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df0438d-e630-4e1e-9015-350bddf18f0a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:48.476543 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9fc1a-3543-4fc7-b373-7012660ba463 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:48.491883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c389ab95-ab5b-4fea-8e0b-bdb5ab40c57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:48.493653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389ab95-ab5b-4fea-8e0b-bdb5ab40c57b admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:48.494049 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389ab95-ab5b-4fea-8e0b-bdb5ab40c57b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:48.494406 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c389ab95-ab5b-4fea-8e0b-bdb5ab40c57b admin admin] PATH_INFO: `/v3/projects/19220030ad4f44d3a109d00ee746066a/users/2c38b0340a6747d9be4779d0a21d5ceb/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:48.513103 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389ab95-ab5b-4fea-8e0b-bdb5ab40c57b admin admin] RBAC: Authorizing `identity:create_grant(project_id=19220030ad4f44d3a109d00ee746066a, user_id=2c38b0340a6747d9be4779d0a21d5ceb, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:48.516275 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c389ab95-ab5b-4fea-8e0b-bdb5ab40c57b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:48.556731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 896/1827] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:02:48 2022] POST /identity/v3/users => generated 283 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:48.561024 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0438d-e630-4e1e-9015-350bddf18f0a admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:48.570644 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df0438d-e630-4e1e-9015-350bddf18f0a admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:48.575911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c005e-8097-47b9-9c30-2c33f9f096d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:48.576508 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c005e-8097-47b9-9c30-2c33f9f096d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:48.576787 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c005e-8097-47b9-9c30-2c33f9f096d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:48.577134 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412c005e-8097-47b9-9c30-2c33f9f096d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:48.577918 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c005e-8097-47b9-9c30-2c33f9f096d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:48.579530 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412c005e-8097-47b9-9c30-2c33f9f096d1 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:48.591364 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 897/1828] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:02:48.595426 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c005e-8097-47b9-9c30-2c33f9f096d1 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:48.605577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412c005e-8097-47b9-9c30-2c33f9f096d1 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:48.610220 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918b60e-9341-48ac-aa68-5702f52e996b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:48.610793 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918b60e-9341-48ac-aa68-5702f52e996b admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:48.611071 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918b60e-9341-48ac-aa68-5702f52e996b admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:48.611341 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9918b60e-9341-48ac-aa68-5702f52e996b admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:48.611998 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918b60e-9341-48ac-aa68-5702f52e996b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:48.613567 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9918b60e-9341-48ac-aa68-5702f52e996b admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:48.623772 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 898/1829] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:02:48.627674 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918b60e-9341-48ac-aa68-5702f52e996b admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:48.637623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9918b60e-9341-48ac-aa68-5702f52e996b admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:48.657892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d020070-3ae1-469d-b7fe-1622375f18f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:48.657892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d020070-3ae1-469d-b7fe-1622375f18f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:48.657892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d020070-3ae1-469d-b7fe-1622375f18f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:48.657892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d020070-3ae1-469d-b7fe-1622375f18f8 admin admin] PATH_INFO: `/v3/projects/cb39c579399f4a12b37c91f06ff397ab/users/3f835d20ad754e81be1f58eead35b39e/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:48.658629 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 932/1830] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:48 2022] PUT /identity/v3/projects/19220030ad4f44d3a109d00ee746066a/users/2c38b0340a6747d9be4779d0a21d5ceb/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:48.660723 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d020070-3ae1-469d-b7fe-1622375f18f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb39c579399f4a12b37c91f06ff397ab, user_id=3f835d20ad754e81be1f58eead35b39e, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:48.662411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae5abf-cd69-4e01-8018-ef5d6417f5fa None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:48.662799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae5abf-cd69-4e01-8018-ef5d6417f5fa None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:48.663531 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ae5abf-cd69-4e01-8018-ef5d6417f5fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:48.663747 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d020070-3ae1-469d-b7fe-1622375f18f8 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:48.705929 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d3ae5abf-cd69-4e01-8018-ef5d6417f5fa None None] MFA Rules not processed for user `2c38b0340a6747d9be4779d0a21d5ceb`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:48.707147 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d3ae5abf-cd69-4e01-8018-ef5d6417f5fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:48.776318 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 933/1831] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:48.780831 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae5abf-cd69-4e01-8018-ef5d6417f5fa None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:48.791843 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 899/1832] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:48 2022] PUT /identity/v3/projects/cb39c579399f4a12b37c91f06ff397ab/users/3f835d20ad754e81be1f58eead35b39e/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:02:48.802864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daaa7ac-016e-44e8-a4f1-942ef125369a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:48.803315 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daaa7ac-016e-44e8-a4f1-942ef125369a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:48.803657 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1daaa7ac-016e-44e8-a4f1-942ef125369a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:48.863348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ae5abf-cd69-4e01-8018-ef5d6417f5fa None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:48.863893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-1daaa7ac-016e-44e8-a4f1-942ef125369a None None] MFA Rules not processed for user `3f835d20ad754e81be1f58eead35b39e`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:48.864264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1daaa7ac-016e-44e8-a4f1-942ef125369a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:48.943860 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22793cff-1c17-4ab9-a80a-25853796d960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:48.944609 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22793cff-1c17-4ab9-a80a-25853796d960 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:48.944896 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22793cff-1c17-4ab9-a80a-25853796d960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:48.945175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22793cff-1c17-4ab9-a80a-25853796d960 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:48.945852 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22793cff-1c17-4ab9-a80a-25853796d960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:48.947776 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22793cff-1c17-4ab9-a80a-25853796d960 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:48.982372 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 900/1833] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:48.986733 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daaa7ac-016e-44e8-a4f1-942ef125369a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:48.998869 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1daaa7ac-016e-44e8-a4f1-942ef125369a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:49.009287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3a00e-2503-4a81-8033-0bcb5750cc07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:49.009287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3a00e-2503-4a81-8033-0bcb5750cc07 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:49.009287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3a00e-2503-4a81-8033-0bcb5750cc07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:49.009287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3a00e-2503-4a81-8033-0bcb5750cc07 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:49.009582 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3a00e-2503-4a81-8033-0bcb5750cc07 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:49.009582 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3a00e-2503-4a81-8033-0bcb5750cc07 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:49.081236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 934/1834] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:02:48 2022] POST /identity/v3/projects => generated 367 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:02:49.081236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22793cff-1c17-4ab9-a80a-25853796d960 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:49.081236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-22793cff-1c17-4ab9-a80a-25853796d960 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:49.101858 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 901/1835] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:02:48 2022] POST /identity/v3/projects => generated 363 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:02:49.102566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3a00e-2503-4a81-8033-0bcb5750cc07 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:49.148686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22793cff-1c17-4ab9-a80a-25853796d960 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:49.167178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3a00e-2503-4a81-8033-0bcb5750cc07 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:49.172608 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeda906-89e2-421d-ac9b-fa105ea72087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:49.173217 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeda906-89e2-421d-ac9b-fa105ea72087 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:49.173617 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeda906-89e2-421d-ac9b-fa105ea72087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:49.173933 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeda906-89e2-421d-ac9b-fa105ea72087 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:49.174565 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeda906-89e2-421d-ac9b-fa105ea72087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:49.176492 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeda906-89e2-421d-ac9b-fa105ea72087 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:49.205978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c8385-3c78-4846-a393-6007835ff4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:49.206613 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c8385-3c78-4846-a393-6007835ff4ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:49.206944 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c8385-3c78-4846-a393-6007835ff4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:49.207221 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745c8385-3c78-4846-a393-6007835ff4ff admin admin] PATH_INFO: `/v3/projects/2340385aca7b49edac58d5b3d9d01123` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:49.208330 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c8385-3c78-4846-a393-6007835ff4ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=2340385aca7b49edac58d5b3d9d01123)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:49.210323 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745c8385-3c78-4846-a393-6007835ff4ff admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:49.258492 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 902/1836] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:02:49 2022] POST /identity/v3/users => generated 290 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:49.259339 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeda906-89e2-421d-ac9b-fa105ea72087 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:49.259447 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:49.268702 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeda906-89e2-421d-ac9b-fa105ea72087 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:49.273295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2163afd-f9c1-4da0-83cf-986dc578dcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:49.273945 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2163afd-f9c1-4da0-83cf-986dc578dcab admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:49.274220 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2163afd-f9c1-4da0-83cf-986dc578dcab admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:49.274497 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2163afd-f9c1-4da0-83cf-986dc578dcab admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:49.275112 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2163afd-f9c1-4da0-83cf-986dc578dcab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:49.277568 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2163afd-f9c1-4da0-83cf-986dc578dcab admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:49.351000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-745c8385-3c78-4846-a393-6007835ff4ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2340385aca7b49edac58d5b3d9d01123', 'request_id': 'req-745c8385-3c78-4846-a393-6007835ff4ff'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:49.362203 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 903/1837] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:02:49 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:49.363130 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2163afd-f9c1-4da0-83cf-986dc578dcab admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:49.373017 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2163afd-f9c1-4da0-83cf-986dc578dcab admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:49.434115 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339e5ae-cc6f-498f-a079-8e3b11bcdf07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:49.434767 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339e5ae-cc6f-498f-a079-8e3b11bcdf07 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:49.435935 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339e5ae-cc6f-498f-a079-8e3b11bcdf07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:49.436230 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1339e5ae-cc6f-498f-a079-8e3b11bcdf07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:49.436666 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-745c8385-3c78-4846-a393-6007835ff4ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2340385aca7b49edac58d5b3d9d01123', 'request_id': 'req-745c8385-3c78-4846-a393-6007835ff4ff'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:49.436888 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339e5ae-cc6f-498f-a079-8e3b11bcdf07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:49.438715 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1339e5ae-cc6f-498f-a079-8e3b11bcdf07 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:49.443553 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-745c8385-3c78-4846-a393-6007835ff4ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2340385aca7b49edac58d5b3d9d01123', 'request_id': 'req-745c8385-3c78-4846-a393-6007835ff4ff'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:49.453237 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 904/1838] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:49.453237 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339e5ae-cc6f-498f-a079-8e3b11bcdf07 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:49.459977 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-745c8385-3c78-4846-a393-6007835ff4ff admin admin] The token cache is being invalidate because project 2340385aca7b49edac58d5b3d9d01123 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:49.460355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-745c8385-3c78-4846-a393-6007835ff4ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:49.461114 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-745c8385-3c78-4846-a393-6007835ff4ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:49.463127 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 935/1839] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:49 2022] DELETE /identity/v3/projects/2340385aca7b49edac58d5b3d9d01123 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:49.464223 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c8385-3c78-4846-a393-6007835ff4ff admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:49.465483 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1339e5ae-cc6f-498f-a079-8e3b11bcdf07 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:49.478619 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-745c8385-3c78-4846-a393-6007835ff4ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:49.479085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e7cb89-dbf1-488d-bdb4-6dac079313ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:49.479085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7cb89-dbf1-488d-bdb4-6dac079313ef admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:49.479085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7cb89-dbf1-488d-bdb4-6dac079313ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:49.479085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e7cb89-dbf1-488d-bdb4-6dac079313ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:49.479407 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7cb89-dbf1-488d-bdb4-6dac079313ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:49.479407 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e7cb89-dbf1-488d-bdb4-6dac079313ef admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:49.479601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745c8385-3c78-4846-a393-6007835ff4ff admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:49.485261 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14eb510-de7d-4940-b7ff-cd5b02efc91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:49.496187 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eb510-de7d-4940-b7ff-cd5b02efc91f admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:49.496187 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eb510-de7d-4940-b7ff-cd5b02efc91f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:49.496187 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14eb510-de7d-4940-b7ff-cd5b02efc91f admin admin] PATH_INFO: `/v3/projects/59529b877c044eaea79aed1b6a711008/users/bdccb22ec6c648a4b26e60ae5051c01d/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:49.496423 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 905/1840] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:49.496423 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118e0c9-d62a-49ec-916b-f29657afa89b None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:49.496423 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118e0c9-d62a-49ec-916b-f29657afa89b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:49.496423 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2118e0c9-d62a-49ec-916b-f29657afa89b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:49.514018 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-2118e0c9-d62a-49ec-916b-f29657afa89b None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:49.514903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14eb510-de7d-4940-b7ff-cd5b02efc91f admin admin] RBAC: Authorizing `identity:create_grant(project_id=59529b877c044eaea79aed1b6a711008, user_id=bdccb22ec6c648a4b26e60ae5051c01d, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:49.515327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2118e0c9-d62a-49ec-916b-f29657afa89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:49.517674 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14eb510-de7d-4940-b7ff-cd5b02efc91f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:49.524129 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 906/1841] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:49.527731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118e0c9-d62a-49ec-916b-f29657afa89b None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:49.527731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2118e0c9-d62a-49ec-916b-f29657afa89b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:49.538287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2118e0c9-d62a-49ec-916b-f29657afa89b None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:49.543248 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd873ee8-cd97-494a-8230-779b90e4d623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:49.544022 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd873ee8-cd97-494a-8230-779b90e4d623 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:49.544304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd873ee8-cd97-494a-8230-779b90e4d623 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:49.544582 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd873ee8-cd97-494a-8230-779b90e4d623 admin admin] PATH_INFO: `/v3/projects/84fb41c3d2274a8a8ab08250cb3f331c/users/3e973b51f64d425ab511703c48dbca26/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:49.560374 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd873ee8-cd97-494a-8230-779b90e4d623 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84fb41c3d2274a8a8ab08250cb3f331c, user_id=3e973b51f64d425ab511703c48dbca26, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:49.563386 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd873ee8-cd97-494a-8230-779b90e4d623 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:49.569186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 936/1842] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:49 2022] PUT /identity/v3/projects/59529b877c044eaea79aed1b6a711008/users/bdccb22ec6c648a4b26e60ae5051c01d/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:49.570564 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a62711-1ddb-4b41-b890-261dee966af8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:49.570857 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a62711-1ddb-4b41-b890-261dee966af8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:49.571136 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a62711-1ddb-4b41-b890-261dee966af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:49.592218 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-28a62711-1ddb-4b41-b890-261dee966af8 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:49.593407 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-28a62711-1ddb-4b41-b890-261dee966af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:49.652555 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 907/1843] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:49 2022] PUT /identity/v3/projects/84fb41c3d2274a8a8ab08250cb3f331c/users/3e973b51f64d425ab511703c48dbca26/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:49.653469 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd873ee8-cd97-494a-8230-779b90e4d623 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:49.673603 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 937/1844] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:49.674487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a62711-1ddb-4b41-b890-261dee966af8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:49.685062 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a62711-1ddb-4b41-b890-261dee966af8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:49.735588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd873ee8-cd97-494a-8230-779b90e4d623 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:49.741392 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae72f5-f321-4ab2-ba36-1f188fea1270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:49.742107 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae72f5-f321-4ab2-ba36-1f188fea1270 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:49.742395 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae72f5-f321-4ab2-ba36-1f188fea1270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:49.742675 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae72f5-f321-4ab2-ba36-1f188fea1270 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:49.743332 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae72f5-f321-4ab2-ba36-1f188fea1270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:49.745023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae72f5-f321-4ab2-ba36-1f188fea1270 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:49.745164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a38a93-2be3-4d5a-9ca0-940d09442772 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:49.746132 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a38a93-2be3-4d5a-9ca0-940d09442772 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:49.746132 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a38a93-2be3-4d5a-9ca0-940d09442772 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:49.746339 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a38a93-2be3-4d5a-9ca0-940d09442772 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:49.746918 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a38a93-2be3-4d5a-9ca0-940d09442772 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:49.748560 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a38a93-2be3-4d5a-9ca0-940d09442772 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:49.758955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 908/1845] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:49.758955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae72f5-f321-4ab2-ba36-1f188fea1270 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:49.763594 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 938/1846] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:49.763594 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a38a93-2be3-4d5a-9ca0-940d09442772 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:49.770691 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a38a93-2be3-4d5a-9ca0-940d09442772 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:49.775225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae72f5-f321-4ab2-ba36-1f188fea1270 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:49.775708 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6686662-0b03-4cf1-8f27-8f01087991a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:49.776364 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686662-0b03-4cf1-8f27-8f01087991a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:49.776646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686662-0b03-4cf1-8f27-8f01087991a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:49.777137 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6686662-0b03-4cf1-8f27-8f01087991a2 admin admin] PATH_INFO: `/v3/projects/59529b877c044eaea79aed1b6a711008/users/bdccb22ec6c648a4b26e60ae5051c01d/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:49.779585 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6686662-0b03-4cf1-8f27-8f01087991a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59529b877c044eaea79aed1b6a711008, user_id=bdccb22ec6c648a4b26e60ae5051c01d, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:49.782945 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd9e614-a9a1-4693-8194-445b8840a6f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:49.783329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6686662-0b03-4cf1-8f27-8f01087991a2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:49.783430 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9e614-a9a1-4693-8194-445b8840a6f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:49.783430 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9e614-a9a1-4693-8194-445b8840a6f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:49.783631 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd9e614-a9a1-4693-8194-445b8840a6f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:49.784401 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9e614-a9a1-4693-8194-445b8840a6f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:02:49.784807 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9e614-a9a1-4693-8194-445b8840a6f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:49.786586 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd9e614-a9a1-4693-8194-445b8840a6f7 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:49.798534 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 939/1847] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:49 2022] PUT /identity/v3/projects/59529b877c044eaea79aed1b6a711008/users/bdccb22ec6c648a4b26e60ae5051c01d/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:49.799540 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6686662-0b03-4cf1-8f27-8f01087991a2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:49.809718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 909/1848] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:02:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:02:49.811001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed1202-9722-4b9f-b112-b1f9ba9b71b9 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:49.811550 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed1202-9722-4b9f-b112-b1f9ba9b71b9 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:49.811550 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ed1202-9722-4b9f-b112-b1f9ba9b71b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:49.840249 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-35ed1202-9722-4b9f-b112-b1f9ba9b71b9 None None] MFA Rules not processed for user `bdccb22ec6c648a4b26e60ae5051c01d`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:49.841431 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-35ed1202-9722-4b9f-b112-b1f9ba9b71b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:49.865976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6686662-0b03-4cf1-8f27-8f01087991a2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:49.871815 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cce52-16db-48d7-a896-fc74fd4b2296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:49.872477 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cce52-16db-48d7-a896-fc74fd4b2296 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:49.872763 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cce52-16db-48d7-a896-fc74fd4b2296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:49.873040 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266cce52-16db-48d7-a896-fc74fd4b2296 admin admin] PATH_INFO: `/v3/projects/84fb41c3d2274a8a8ab08250cb3f331c/users/3e973b51f64d425ab511703c48dbca26/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:49.875133 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cce52-16db-48d7-a896-fc74fd4b2296 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84fb41c3d2274a8a8ab08250cb3f331c, user_id=3e973b51f64d425ab511703c48dbca26, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:49.878105 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266cce52-16db-48d7-a896-fc74fd4b2296 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:49.889385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 940/1849] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:49 2022] PUT /identity/v3/projects/84fb41c3d2274a8a8ab08250cb3f331c/users/3e973b51f64d425ab511703c48dbca26/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:49.890215 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cce52-16db-48d7-a896-fc74fd4b2296 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:49.914796 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 910/1850] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:49.916030 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566711e-60f3-400b-b4bd-fc87c1e5e7d4 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:49.916235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566711e-60f3-400b-b4bd-fc87c1e5e7d4 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:49.917065 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b566711e-60f3-400b-b4bd-fc87c1e5e7d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:49.949336 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-b566711e-60f3-400b-b4bd-fc87c1e5e7d4 None None] MFA Rules not processed for user `3e973b51f64d425ab511703c48dbca26`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:49.950736 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b566711e-60f3-400b-b4bd-fc87c1e5e7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:49.967016 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266cce52-16db-48d7-a896-fc74fd4b2296 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:49.974224 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a811d-8868-446b-b808-c8384e3bd4f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:49.975161 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a811d-8868-446b-b808-c8384e3bd4f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:49.975443 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a811d-8868-446b-b808-c8384e3bd4f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:49.975866 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927a811d-8868-446b-b808-c8384e3bd4f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:49.976519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a811d-8868-446b-b808-c8384e3bd4f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:49.978549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927a811d-8868-446b-b808-c8384e3bd4f6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:50.026339 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 911/1851] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:49 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:50.027919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566711e-60f3-400b-b4bd-fc87c1e5e7d4 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:50.029318 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b566711e-60f3-400b-b4bd-fc87c1e5e7d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:50.073877 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 941/1852] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:02:49 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:50.075242 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a811d-8868-446b-b808-c8384e3bd4f6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:50.077099 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-927a811d-8868-446b-b808-c8384e3bd4f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:50.080714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:50.117221 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b566711e-60f3-400b-b4bd-fc87c1e5e7d4 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:50.141468 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927a811d-8868-446b-b808-c8384e3bd4f6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:50.145345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5880d-e73a-45fa-944a-94b8e4bdbc2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:50.145997 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5880d-e73a-45fa-944a-94b8e4bdbc2f service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:50.146414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5880d-e73a-45fa-944a-94b8e4bdbc2f service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:50.146697 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d5880d-e73a-45fa-944a-94b8e4bdbc2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:50.173644 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e450cb-0092-4886-8b52-a54617966dfd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:50.174431 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e450cb-0092-4886-8b52-a54617966dfd service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:50.174713 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e450cb-0092-4886-8b52-a54617966dfd service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:50.174988 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e450cb-0092-4886-8b52-a54617966dfd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:50.216364 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5880d-e73a-45fa-944a-94b8e4bdbc2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:50.217894 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d5880d-e73a-45fa-944a-94b8e4bdbc2f service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:50.228432 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 942/1853] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:50 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:50.229230 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5880d-e73a-45fa-944a-94b8e4bdbc2f service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:50.245635 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e450cb-0092-4886-8b52-a54617966dfd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:50.247532 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e450cb-0092-4886-8b52-a54617966dfd service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:50.258385 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 912/1854] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:50 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:50.296666 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d5880d-e73a-45fa-944a-94b8e4bdbc2f service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:50.301403 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb58716-caae-4548-a829-72c1109dd138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:50.302042 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb58716-caae-4548-a829-72c1109dd138 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:50.302327 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb58716-caae-4548-a829-72c1109dd138 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:50.302617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb58716-caae-4548-a829-72c1109dd138 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:50.303233 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb58716-caae-4548-a829-72c1109dd138 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:50.305194 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb58716-caae-4548-a829-72c1109dd138 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:50.374942 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 943/1855] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:02:50 2022] POST /identity/v3/users => generated 293 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:50.378960 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e450cb-0092-4886-8b52-a54617966dfd service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:50.389577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e450cb-0092-4886-8b52-a54617966dfd service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:50.394575 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83a5f5-144d-4430-a0fa-a3252a133993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:50.395246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83a5f5-144d-4430-a0fa-a3252a133993 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:50.395531 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83a5f5-144d-4430-a0fa-a3252a133993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:50.395809 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83a5f5-144d-4430-a0fa-a3252a133993 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:50.396449 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83a5f5-144d-4430-a0fa-a3252a133993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:50.398149 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83a5f5-144d-4430-a0fa-a3252a133993 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:50.408481 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 913/1856] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:50.412348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb58716-caae-4548-a829-72c1109dd138 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:50.422793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb58716-caae-4548-a829-72c1109dd138 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:50.437804 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e5ef8-b91a-4644-bcf5-22e4497459c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:50.437804 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e5ef8-b91a-4644-bcf5-22e4497459c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:50.437804 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e5ef8-b91a-4644-bcf5-22e4497459c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:50.437804 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552e5ef8-b91a-4644-bcf5-22e4497459c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:50.438381 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e5ef8-b91a-4644-bcf5-22e4497459c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:50.438381 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552e5ef8-b91a-4644-bcf5-22e4497459c6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:50.442958 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 944/1857] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:50.447182 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83a5f5-144d-4430-a0fa-a3252a133993 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:50.461455 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83a5f5-144d-4430-a0fa-a3252a133993 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:50.466906 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196374ed-ac62-4ca5-9d05-3cea025c4d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:50.467611 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196374ed-ac62-4ca5-9d05-3cea025c4d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:50.468018 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196374ed-ac62-4ca5-9d05-3cea025c4d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:50.468307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196374ed-ac62-4ca5-9d05-3cea025c4d1b admin admin] PATH_INFO: `/v3/projects/4e008d4be77240848106e3bc647fd4de/users/30a6a05e4eca4c0c97a836a2c816c742/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:50.472316 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e5ef8-b91a-4644-bcf5-22e4497459c6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:50.483310 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552e5ef8-b91a-4644-bcf5-22e4497459c6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:50.485917 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196374ed-ac62-4ca5-9d05-3cea025c4d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e008d4be77240848106e3bc647fd4de, user_id=30a6a05e4eca4c0c97a836a2c816c742, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:50.487116 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa1126-edf0-4e2d-a883-ac9b1b19097d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:50.489609 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa1126-edf0-4e2d-a883-ac9b1b19097d service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:50.489609 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa1126-edf0-4e2d-a883-ac9b1b19097d service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:50.489609 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fa1126-edf0-4e2d-a883-ac9b1b19097d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:50.489890 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196374ed-ac62-4ca5-9d05-3cea025c4d1b admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:50.490066 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-41fa1126-edf0-4e2d-a883-ac9b1b19097d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:50.550802 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 914/1858] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:50 2022] PUT /identity/v3/projects/4e008d4be77240848106e3bc647fd4de/users/30a6a05e4eca4c0c97a836a2c816c742/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:50.551264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:50.556163 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa1126-edf0-4e2d-a883-ac9b1b19097d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:50.557619 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fa1126-edf0-4e2d-a883-ac9b1b19097d service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:50.562052 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736e738-a95d-4be2-8218-a89e2d800a61 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:50.562408 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736e738-a95d-4be2-8218-a89e2d800a61 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:50.562758 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e736e738-a95d-4be2-8218-a89e2d800a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:50.569281 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 945/1859] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:02:50.598338 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e736e738-a95d-4be2-8218-a89e2d800a61 None None] MFA Rules not processed for user `30a6a05e4eca4c0c97a836a2c816c742`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:50.600564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e736e738-a95d-4be2-8218-a89e2d800a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:50.686400 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 915/1860] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:50.715204 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa1126-edf0-4e2d-a883-ac9b1b19097d service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:50.723847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fa1126-edf0-4e2d-a883-ac9b1b19097d service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:50.774985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60743532-b484-418b-9c45-038e5b13b43c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:50.775604 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60743532-b484-418b-9c45-038e5b13b43c service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:50.775885 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60743532-b484-418b-9c45-038e5b13b43c service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:50.776156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60743532-b484-418b-9c45-038e5b13b43c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:50.785156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60743532-b484-418b-9c45-038e5b13b43c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:50.787049 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60743532-b484-418b-9c45-038e5b13b43c service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:50.796018 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 946/1861] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:51.150175 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:52.585326 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:52.768923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736e738-a95d-4be2-8218-a89e2d800a61 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:52.831178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e736e738-a95d-4be2-8218-a89e2d800a61 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:52.835783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e9d3a-33e8-4a42-ac3e-580bc1197882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:52.836422 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e9d3a-33e8-4a42-ac3e-580bc1197882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:52.836700 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e9d3a-33e8-4a42-ac3e-580bc1197882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:52.836970 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2e9d3a-33e8-4a42-ac3e-580bc1197882 admin admin] PATH_INFO: `/v3/users/3f835d20ad754e81be1f58eead35b39e` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:52.838159 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e9d3a-33e8-4a42-ac3e-580bc1197882 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f835d20ad754e81be1f58eead35b39e)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:52.840770 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2e9d3a-33e8-4a42-ac3e-580bc1197882 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:53.080086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3a2e9d3a-33e8-4a42-ac3e-580bc1197882 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f835d20ad754e81be1f58eead35b39e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:53.162150 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3a2e9d3a-33e8-4a42-ac3e-580bc1197882 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f835d20ad754e81be1f58eead35b39e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:53.176217 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3a2e9d3a-33e8-4a42-ac3e-580bc1197882 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f835d20ad754e81be1f58eead35b39e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:53.177021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3a2e9d3a-33e8-4a42-ac3e-580bc1197882 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f835d20ad754e81be1f58eead35b39e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:53.185353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3a2e9d3a-33e8-4a42-ac3e-580bc1197882 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f835d20ad754e81be1f58eead35b39e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:53.205955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 916/1862] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:52 2022] DELETE /identity/v3/users/3f835d20ad754e81be1f58eead35b39e => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:53.206058 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45a667-c225-4a3a-8c8d-670447dd3a3c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:53.206058 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45a667-c225-4a3a-8c8d-670447dd3a3c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:53.206058 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45a667-c225-4a3a-8c8d-670447dd3a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:53.218419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7e45a667-c225-4a3a-8c8d-670447dd3a3c None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:53.219623 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7e45a667-c225-4a3a-8c8d-670447dd3a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:53.280338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 947/1863] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:02:53.291230 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e9d3a-33e8-4a42-ac3e-580bc1197882 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:53.293906 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3a2e9d3a-33e8-4a42-ac3e-580bc1197882 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:53.363460 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2e9d3a-33e8-4a42-ac3e-580bc1197882 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:53.367095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6033a-afa5-479b-a507-1e4384b54b22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:53.367704 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6033a-afa5-479b-a507-1e4384b54b22 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:53.367981 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6033a-afa5-479b-a507-1e4384b54b22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:53.368250 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6033a-afa5-479b-a507-1e4384b54b22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:53.373554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:53.380056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6033a-afa5-479b-a507-1e4384b54b22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:53.381811 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6033a-afa5-479b-a507-1e4384b54b22 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:53.391271 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 917/1864] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:53.539536 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:53.982033 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45a667-c225-4a3a-8c8d-670447dd3a3c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:53.984474 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7e45a667-c225-4a3a-8c8d-670447dd3a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:53.996324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45a667-c225-4a3a-8c8d-670447dd3a3c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:54.001110 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90031cc0-ba00-498d-b673-e6fd0dd87ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:54.001803 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90031cc0-ba00-498d-b673-e6fd0dd87ad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:54.002085 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90031cc0-ba00-498d-b673-e6fd0dd87ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:54.002359 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90031cc0-ba00-498d-b673-e6fd0dd87ad1 admin admin] PATH_INFO: `/v3/projects/cb39c579399f4a12b37c91f06ff397ab` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:54.003486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90031cc0-ba00-498d-b673-e6fd0dd87ad1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb39c579399f4a12b37c91f06ff397ab)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:54.005525 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90031cc0-ba00-498d-b673-e6fd0dd87ad1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:54.156794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-90031cc0-ba00-498d-b673-e6fd0dd87ad1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb39c579399f4a12b37c91f06ff397ab', 'request_id': 'req-90031cc0-ba00-498d-b673-e6fd0dd87ad1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:54.274885 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-90031cc0-ba00-498d-b673-e6fd0dd87ad1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb39c579399f4a12b37c91f06ff397ab', 'request_id': 'req-90031cc0-ba00-498d-b673-e6fd0dd87ad1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:54.291832 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-90031cc0-ba00-498d-b673-e6fd0dd87ad1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb39c579399f4a12b37c91f06ff397ab', 'request_id': 'req-90031cc0-ba00-498d-b673-e6fd0dd87ad1'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:54.305621 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-90031cc0-ba00-498d-b673-e6fd0dd87ad1 admin admin] The token cache is being invalidate because project cb39c579399f4a12b37c91f06ff397ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:54.306227 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-90031cc0-ba00-498d-b673-e6fd0dd87ad1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:54.307102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-90031cc0-ba00-498d-b673-e6fd0dd87ad1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:54.308799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 948/1865] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:53 2022] DELETE /identity/v3/projects/cb39c579399f4a12b37c91f06ff397ab => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:54.313547 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6033a-afa5-479b-a507-1e4384b54b22 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:54.341160 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6033a-afa5-479b-a507-1e4384b54b22 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:54.417103 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dd58f9-d226-4ca7-bfbd-e7aa45839d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:54.418073 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd58f9-d226-4ca7-bfbd-e7aa45839d35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:54.418438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd58f9-d226-4ca7-bfbd-e7aa45839d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:54.418720 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dd58f9-d226-4ca7-bfbd-e7aa45839d35 admin admin] PATH_INFO: `/v3/users/3e973b51f64d425ab511703c48dbca26` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:54.420084 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd58f9-d226-4ca7-bfbd-e7aa45839d35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e973b51f64d425ab511703c48dbca26)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:54.422125 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dd58f9-d226-4ca7-bfbd-e7aa45839d35 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:54.471949 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:54.636919 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac8df1-0e6d-49d0-a9e4-958fae1d8b9a None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:54.637217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac8df1-0e6d-49d0-a9e4-958fae1d8b9a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:54.637484 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecac8df1-0e6d-49d0-a9e4-958fae1d8b9a None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:54.638867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 949/1866] 10.222.0.59 () {54 vars in 921 bytes} [Tue Sep 13 20:02:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 20:02:54.654730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e32d0c-be20-432d-9761-e29155980ddf None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:54.655282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e32d0c-be20-432d-9761-e29155980ddf None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:54.655750 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e32d0c-be20-432d-9761-e29155980ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:54.657347 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-01dd58f9-d226-4ca7-bfbd-e7aa45839d35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e973b51f64d425ab511703c48dbca26'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:54.676251 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-34e32d0c-be20-432d-9761-e29155980ddf None None] MFA Rules not processed for user `3919b24291f54df99a9da0f5d3164ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:54.678944 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-34e32d0c-be20-432d-9761-e29155980ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:54.744959 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 950/1867] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Sep 13 20:02:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:02:54.758559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e32d0c-be20-432d-9761-e29155980ddf None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:54.760149 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-34e32d0c-be20-432d-9761-e29155980ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:54.774220 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e32d0c-be20-432d-9761-e29155980ddf None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:54.779775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98671b-e722-4ff8-8b9b-35dc6b710032 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:54.780373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98671b-e722-4ff8-8b9b-35dc6b710032 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:54.780650 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98671b-e722-4ff8-8b9b-35dc6b710032 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:54.780922 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad98671b-e722-4ff8-8b9b-35dc6b710032 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:54.791667 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98671b-e722-4ff8-8b9b-35dc6b710032 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:54.795459 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad98671b-e722-4ff8-8b9b-35dc6b710032 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:54.804129 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 951/1868] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:02:54.871105 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-01dd58f9-d226-4ca7-bfbd-e7aa45839d35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e973b51f64d425ab511703c48dbca26'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:54.883650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-01dd58f9-d226-4ca7-bfbd-e7aa45839d35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e973b51f64d425ab511703c48dbca26'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:54.884348 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-01dd58f9-d226-4ca7-bfbd-e7aa45839d35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e973b51f64d425ab511703c48dbca26'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:54.892654 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-01dd58f9-d226-4ca7-bfbd-e7aa45839d35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e973b51f64d425ab511703c48dbca26'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:54.899355 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 918/1869] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:54 2022] DELETE /identity/v3/users/3e973b51f64d425ab511703c48dbca26 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:55.300686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:55.420649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98671b-e722-4ff8-8b9b-35dc6b710032 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:55.426743 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ad98671b-e722-4ff8-8b9b-35dc6b710032 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:55.452599 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad98671b-e722-4ff8-8b9b-35dc6b710032 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:55.533491 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d2470-b9e0-4b93-b1f0-2bfefbe87685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:55.534339 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d2470-b9e0-4b93-b1f0-2bfefbe87685 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:55.534503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d2470-b9e0-4b93-b1f0-2bfefbe87685 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:55.534964 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d2470-b9e0-4b93-b1f0-2bfefbe87685 admin admin] PATH_INFO: `/v3/projects/84fb41c3d2274a8a8ab08250cb3f331c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:55.536122 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d2470-b9e0-4b93-b1f0-2bfefbe87685 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84fb41c3d2274a8a8ab08250cb3f331c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:55.551661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d2470-b9e0-4b93-b1f0-2bfefbe87685 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:55.757720 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:55.762737 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3d5d2470-b9e0-4b93-b1f0-2bfefbe87685 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84fb41c3d2274a8a8ab08250cb3f331c', 'request_id': 'req-3d5d2470-b9e0-4b93-b1f0-2bfefbe87685'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:55.831462 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3d5d2470-b9e0-4b93-b1f0-2bfefbe87685 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84fb41c3d2274a8a8ab08250cb3f331c', 'request_id': 'req-3d5d2470-b9e0-4b93-b1f0-2bfefbe87685'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:55.839685 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3d5d2470-b9e0-4b93-b1f0-2bfefbe87685 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84fb41c3d2274a8a8ab08250cb3f331c', 'request_id': 'req-3d5d2470-b9e0-4b93-b1f0-2bfefbe87685'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:55.864077 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3d5d2470-b9e0-4b93-b1f0-2bfefbe87685 admin admin] The token cache is being invalidate because project 84fb41c3d2274a8a8ab08250cb3f331c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:02:55.865968 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3d5d2470-b9e0-4b93-b1f0-2bfefbe87685 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:55.865968 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3d5d2470-b9e0-4b93-b1f0-2bfefbe87685 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:55.867311 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 952/1870] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:55 2022] DELETE /identity/v3/projects/84fb41c3d2274a8a8ab08250cb3f331c => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:55.872646 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be26d39-8ff8-482d-976e-54818cbbee5b None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:55.873136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be26d39-8ff8-482d-976e-54818cbbee5b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:55.873416 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be26d39-8ff8-482d-976e-54818cbbee5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:55.901673 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-1be26d39-8ff8-482d-976e-54818cbbee5b None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:55.903063 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1be26d39-8ff8-482d-976e-54818cbbee5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:55.974444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 919/1871] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:55.983534 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade45f8-fc8a-4eeb-9cba-c42dc277f627 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:55.983853 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade45f8-fc8a-4eeb-9cba-c42dc277f627 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:55.984130 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ade45f8-fc8a-4eeb-9cba-c42dc277f627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:56.005999 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8ade45f8-fc8a-4eeb-9cba-c42dc277f627 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:56.005999 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8ade45f8-fc8a-4eeb-9cba-c42dc277f627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:56.014404 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 953/1872] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:56.018636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be26d39-8ff8-482d-976e-54818cbbee5b None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:56.028273 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be26d39-8ff8-482d-976e-54818cbbee5b None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:56.033350 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39189bd5-5dc1-4983-b1c7-489fc0d5cc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:56.034010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39189bd5-5dc1-4983-b1c7-489fc0d5cc74 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:56.034365 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39189bd5-5dc1-4983-b1c7-489fc0d5cc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:56.034919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39189bd5-5dc1-4983-b1c7-489fc0d5cc74 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:56.035217 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39189bd5-5dc1-4983-b1c7-489fc0d5cc74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:02:56.035521 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39189bd5-5dc1-4983-b1c7-489fc0d5cc74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:56.037138 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39189bd5-5dc1-4983-b1c7-489fc0d5cc74 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:56.055270 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 920/1873] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:02:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:02:56.060565 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade45f8-fc8a-4eeb-9cba-c42dc277f627 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:56.070395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ade45f8-fc8a-4eeb-9cba-c42dc277f627 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:56.076873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fe63c-346b-410a-a618-f920bdae60a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:56.077659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fe63c-346b-410a-a618-f920bdae60a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:56.081408 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fe63c-346b-410a-a618-f920bdae60a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:56.081408 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71fe63c-346b-410a-a618-f920bdae60a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:56.081408 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fe63c-346b-410a-a618-f920bdae60a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:56.082343 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71fe63c-346b-410a-a618-f920bdae60a2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:56.234243 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 954/1874] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:02:56 2022] POST /identity/v3/projects => generated 377 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:56.238077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39189bd5-5dc1-4983-b1c7-489fc0d5cc74 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:56.251873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39189bd5-5dc1-4983-b1c7-489fc0d5cc74 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:56.334130 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bcdbc-04d3-4a83-9b57-4f9b97e5ad35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:56.334130 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bcdbc-04d3-4a83-9b57-4f9b97e5ad35 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:56.334350 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bcdbc-04d3-4a83-9b57-4f9b97e5ad35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:56.334493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4bcdbc-04d3-4a83-9b57-4f9b97e5ad35 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:56.335060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bcdbc-04d3-4a83-9b57-4f9b97e5ad35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:56.336958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4bcdbc-04d3-4a83-9b57-4f9b97e5ad35 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:56.385187 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:56.429813 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 921/1875] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:02:56 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:02:56.431281 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fe63c-346b-410a-a618-f920bdae60a2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:56.454031 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71fe63c-346b-410a-a618-f920bdae60a2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:56.461261 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c190d0-85af-4d87-9ae6-e1a3a612da64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:56.462481 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c190d0-85af-4d87-9ae6-e1a3a612da64 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:56.463615 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c190d0-85af-4d87-9ae6-e1a3a612da64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:56.464067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c190d0-85af-4d87-9ae6-e1a3a612da64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:56.464725 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c190d0-85af-4d87-9ae6-e1a3a612da64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:56.466571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c190d0-85af-4d87-9ae6-e1a3a612da64 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:56.480314 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 955/1876] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:56.484502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bcdbc-04d3-4a83-9b57-4f9b97e5ad35 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:56.500243 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4bcdbc-04d3-4a83-9b57-4f9b97e5ad35 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:56.507887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573cd819-fa4c-4805-8ad3-d37a88af19a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:56.509439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cd819-fa4c-4805-8ad3-d37a88af19a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:56.509959 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cd819-fa4c-4805-8ad3-d37a88af19a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:56.511085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573cd819-fa4c-4805-8ad3-d37a88af19a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:56.519635 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573cd819-fa4c-4805-8ad3-d37a88af19a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:56.519635 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573cd819-fa4c-4805-8ad3-d37a88af19a0 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:56.527301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 922/1877] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:02:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:02:56.531401 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c190d0-85af-4d87-9ae6-e1a3a612da64 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:56.541589 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c190d0-85af-4d87-9ae6-e1a3a612da64 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:56.546742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89107515-133b-48f8-893a-4767d1bfbfbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:56.548265 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89107515-133b-48f8-893a-4767d1bfbfbe admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:56.548265 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89107515-133b-48f8-893a-4767d1bfbfbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:56.548265 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89107515-133b-48f8-893a-4767d1bfbfbe admin admin] PATH_INFO: `/v3/projects/62d39bbcf123473487ef1a56bfc06da7/users/69cf9201ccbf4835a7aee78176875c7e/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:56.565477 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89107515-133b-48f8-893a-4767d1bfbfbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=62d39bbcf123473487ef1a56bfc06da7, user_id=69cf9201ccbf4835a7aee78176875c7e, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:56.571760 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89107515-133b-48f8-893a-4767d1bfbfbe admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:56.635971 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:56.683203 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 956/1878] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:02:56 2022] PUT /identity/v3/projects/62d39bbcf123473487ef1a56bfc06da7/users/69cf9201ccbf4835a7aee78176875c7e/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:56.693295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48181d-7bd9-4c95-a9a1-c057a919f284 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:56.693604 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48181d-7bd9-4c95-a9a1-c057a919f284 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:56.693909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd48181d-7bd9-4c95-a9a1-c057a919f284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:56.722764 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-dd48181d-7bd9-4c95-a9a1-c057a919f284 None None] MFA Rules not processed for user `69cf9201ccbf4835a7aee78176875c7e`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:56.723973 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-dd48181d-7bd9-4c95-a9a1-c057a919f284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:56.789134 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 923/1879] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:56.805568 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89107515-133b-48f8-893a-4767d1bfbfbe admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:56.808316 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-89107515-133b-48f8-893a-4767d1bfbfbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:56.900783 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89107515-133b-48f8-893a-4767d1bfbfbe admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:56.905885 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05658e0c-5d76-48c6-9df2-d8026655eeb9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44093d63c1aa45b781d2ce30239ed598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:56.906539 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05658e0c-5d76-48c6-9df2-d8026655eeb9 service glance] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:56.908998 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05658e0c-5d76-48c6-9df2-d8026655eeb9 service glance] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:56.908998 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05658e0c-5d76-48c6-9df2-d8026655eeb9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:56.916465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05658e0c-5d76-48c6-9df2-d8026655eeb9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:56.918520 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05658e0c-5d76-48c6-9df2-d8026655eeb9 service glance] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:56.928228 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 957/1880] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:57.214529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:57.282326 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:58.093367 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:58.379186 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:58.573638 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48181d-7bd9-4c95-a9a1-c057a919f284 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:58.575101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-dd48181d-7bd9-4c95-a9a1-c057a919f284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:58.675761 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd48181d-7bd9-4c95-a9a1-c057a919f284 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:58.682426 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53913a62-220b-4c54-9f08-7e3ee5ec5a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:58.683450 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53913a62-220b-4c54-9f08-7e3ee5ec5a7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:58.683805 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53913a62-220b-4c54-9f08-7e3ee5ec5a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:58.684139 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53913a62-220b-4c54-9f08-7e3ee5ec5a7c admin admin] PATH_INFO: `/v3/users/2c38b0340a6747d9be4779d0a21d5ceb` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:58.694641 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53913a62-220b-4c54-9f08-7e3ee5ec5a7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c38b0340a6747d9be4779d0a21d5ceb)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:58.697231 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53913a62-220b-4c54-9f08-7e3ee5ec5a7c admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:58.972766 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-53913a62-220b-4c54-9f08-7e3ee5ec5a7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c38b0340a6747d9be4779d0a21d5ceb'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:58.980049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:59.075862 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-53913a62-220b-4c54-9f08-7e3ee5ec5a7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c38b0340a6747d9be4779d0a21d5ceb'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:59.089362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-53913a62-220b-4c54-9f08-7e3ee5ec5a7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c38b0340a6747d9be4779d0a21d5ceb'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:59.090134 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-53913a62-220b-4c54-9f08-7e3ee5ec5a7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c38b0340a6747d9be4779d0a21d5ceb'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:59.098336 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-53913a62-220b-4c54-9f08-7e3ee5ec5a7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c38b0340a6747d9be4779d0a21d5ceb'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:59.105161 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 924/1881] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:58 2022] DELETE /identity/v3/users/2c38b0340a6747d9be4779d0a21d5ceb => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:02:59.109921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9313b-07d5-468d-8cd1-0c89e4b9267a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:59.110442 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9313b-07d5-468d-8cd1-0c89e4b9267a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:59.110442 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f9313b-07d5-468d-8cd1-0c89e4b9267a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:59.117789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:02:59.131135 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b1f9313b-07d5-468d-8cd1-0c89e4b9267a None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:59.132339 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b1f9313b-07d5-468d-8cd1-0c89e4b9267a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:59.191529 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 958/1882] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:59.202251 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53913a62-220b-4c54-9f08-7e3ee5ec5a7c admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:59.203767 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-53913a62-220b-4c54-9f08-7e3ee5ec5a7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:59.262248 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53913a62-220b-4c54-9f08-7e3ee5ec5a7c admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:59.267960 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7409778-5dee-4f26-9dca-7f73181afb33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:59.268586 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7409778-5dee-4f26-9dca-7f73181afb33 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:59.268892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7409778-5dee-4f26-9dca-7f73181afb33 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:59.269295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7409778-5dee-4f26-9dca-7f73181afb33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:59.277418 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9313b-07d5-468d-8cd1-0c89e4b9267a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:59.278824 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b1f9313b-07d5-468d-8cd1-0c89e4b9267a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:59.280320 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7409778-5dee-4f26-9dca-7f73181afb33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:59.281783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7409778-5dee-4f26-9dca-7f73181afb33 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:59.290552 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f9313b-07d5-468d-8cd1-0c89e4b9267a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:59.296454 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 925/1883] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:59.299037 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4ade0-2b9c-424d-be71-1b140af7f5ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:59.299698 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4ade0-2b9c-424d-be71-1b140af7f5ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:59.300045 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4ade0-2b9c-424d-be71-1b140af7f5ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:59.300385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac4ade0-2b9c-424d-be71-1b140af7f5ca admin admin] PATH_INFO: `/v3/users/30a6a05e4eca4c0c97a836a2c816c742` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:59.301615 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4ade0-2b9c-424d-be71-1b140af7f5ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=30a6a05e4eca4c0c97a836a2c816c742)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:59.303639 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac4ade0-2b9c-424d-be71-1b140af7f5ca admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:59.497559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-aac4ade0-2b9c-424d-be71-1b140af7f5ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30a6a05e4eca4c0c97a836a2c816c742'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:59.567851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-aac4ade0-2b9c-424d-be71-1b140af7f5ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30a6a05e4eca4c0c97a836a2c816c742'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:59.586961 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-aac4ade0-2b9c-424d-be71-1b140af7f5ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30a6a05e4eca4c0c97a836a2c816c742'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:59.587740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-aac4ade0-2b9c-424d-be71-1b140af7f5ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30a6a05e4eca4c0c97a836a2c816c742'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:59.597859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-aac4ade0-2b9c-424d-be71-1b140af7f5ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30a6a05e4eca4c0c97a836a2c816c742'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:59.605533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 959/1884] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:02:59 2022] DELETE /identity/v3/users/30a6a05e4eca4c0c97a836a2c816c742 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:02:59.609938 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67243cf-eac3-4a40-ab88-ef04578253b5 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:59.610417 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67243cf-eac3-4a40-ab88-ef04578253b5 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:59.612442 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67243cf-eac3-4a40-ab88-ef04578253b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:59.632831 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e67243cf-eac3-4a40-ab88-ef04578253b5 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:02:59.634239 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e67243cf-eac3-4a40-ab88-ef04578253b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:59.697433 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 926/1885] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:02:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:02:59.708783 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4ade0-2b9c-424d-be71-1b140af7f5ca admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:59.710660 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-aac4ade0-2b9c-424d-be71-1b140af7f5ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:59.782066 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac4ade0-2b9c-424d-be71-1b140af7f5ca admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:59.787237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa9996-ac22-40e5-8e57-0f7277f14655 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:59.787412 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa9996-ac22-40e5-8e57-0f7277f14655 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:59.787560 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa9996-ac22-40e5-8e57-0f7277f14655 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:59.787981 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa9996-ac22-40e5-8e57-0f7277f14655 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:59.802323 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa9996-ac22-40e5-8e57-0f7277f14655 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:59.806999 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa9996-ac22-40e5-8e57-0f7277f14655 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:59.810103 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67243cf-eac3-4a40-ab88-ef04578253b5 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:02:59.811499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e67243cf-eac3-4a40-ab88-ef04578253b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:02:59.818134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 960/1886] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:02:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:02:59.833182 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67243cf-eac3-4a40-ab88-ef04578253b5 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:02:59.840671 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b17fa-e6be-4374-a60c-f6feec0b6b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:02:59.841327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b17fa-e6be-4374-a60c-f6feec0b6b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:02:59.841659 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b17fa-e6be-4374-a60c-f6feec0b6b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:02:59.841940 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b17fa-e6be-4374-a60c-f6feec0b6b56 admin admin] PATH_INFO: `/v3/projects/19220030ad4f44d3a109d00ee746066a` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:02:59.843597 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b17fa-e6be-4374-a60c-f6feec0b6b56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19220030ad4f44d3a109d00ee746066a)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:02:59.846624 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b17fa-e6be-4374-a60c-f6feec0b6b56 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:02:59.980570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-502b17fa-e6be-4374-a60c-f6feec0b6b56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19220030ad4f44d3a109d00ee746066a', 'request_id': 'req-502b17fa-e6be-4374-a60c-f6feec0b6b56'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:59.986651 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-502b17fa-e6be-4374-a60c-f6feec0b6b56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19220030ad4f44d3a109d00ee746066a', 'request_id': 'req-502b17fa-e6be-4374-a60c-f6feec0b6b56'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:59.995609 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-502b17fa-e6be-4374-a60c-f6feec0b6b56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19220030ad4f44d3a109d00ee746066a', 'request_id': 'req-502b17fa-e6be-4374-a60c-f6feec0b6b56'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:02:59.997598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:INSERT=1,keystone:DELETE=9,keystone:SELECT=90 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:00.085133 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-502b17fa-e6be-4374-a60c-f6feec0b6b56 admin admin] The token cache is being invalidate because project 19220030ad4f44d3a109d00ee746066a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:03:00.085133 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-502b17fa-e6be-4374-a60c-f6feec0b6b56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:00.086700 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-502b17fa-e6be-4374-a60c-f6feec0b6b56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:00.089443 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 927/1887] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:02:59 2022] DELETE /identity/v3/projects/19220030ad4f44d3a109d00ee746066a => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:03:00.094013 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa9996-ac22-40e5-8e57-0f7277f14655 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:00.113720 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa9996-ac22-40e5-8e57-0f7277f14655 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:00.160684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:00.307724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91028053-308c-41db-a05f-114b0687aa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:00.308387 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91028053-308c-41db-a05f-114b0687aa11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:00.308661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91028053-308c-41db-a05f-114b0687aa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:00.308931 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91028053-308c-41db-a05f-114b0687aa11 admin admin] PATH_INFO: `/v3/users/bdccb22ec6c648a4b26e60ae5051c01d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:00.313192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91028053-308c-41db-a05f-114b0687aa11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bdccb22ec6c648a4b26e60ae5051c01d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:00.315187 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91028053-308c-41db-a05f-114b0687aa11 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:00.458577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b17fa-e6be-4374-a60c-f6feec0b6b56 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:00.461234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-502b17fa-e6be-4374-a60c-f6feec0b6b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:00.477105 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b17fa-e6be-4374-a60c-f6feec0b6b56 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:00.482263 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dedc8a-5405-44d5-b6f4-f39a0cb6fb2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:00.482937 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dedc8a-5405-44d5-b6f4-f39a0cb6fb2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:00.483224 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dedc8a-5405-44d5-b6f4-f39a0cb6fb2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:00.483505 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dedc8a-5405-44d5-b6f4-f39a0cb6fb2d admin admin] PATH_INFO: `/v3/projects/4e008d4be77240848106e3bc647fd4de` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:00.484701 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dedc8a-5405-44d5-b6f4-f39a0cb6fb2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e008d4be77240848106e3bc647fd4de)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:00.486700 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dedc8a-5405-44d5-b6f4-f39a0cb6fb2d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:00.582588 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-91028053-308c-41db-a05f-114b0687aa11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bdccb22ec6c648a4b26e60ae5051c01d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:00.631147 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-94dedc8a-5405-44d5-b6f4-f39a0cb6fb2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e008d4be77240848106e3bc647fd4de', 'request_id': 'req-94dedc8a-5405-44d5-b6f4-f39a0cb6fb2d'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:00.642169 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-94dedc8a-5405-44d5-b6f4-f39a0cb6fb2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e008d4be77240848106e3bc647fd4de', 'request_id': 'req-94dedc8a-5405-44d5-b6f4-f39a0cb6fb2d'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:00.653783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-94dedc8a-5405-44d5-b6f4-f39a0cb6fb2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e008d4be77240848106e3bc647fd4de', 'request_id': 'req-94dedc8a-5405-44d5-b6f4-f39a0cb6fb2d'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:00.666689 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-91028053-308c-41db-a05f-114b0687aa11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bdccb22ec6c648a4b26e60ae5051c01d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:00.708121 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-91028053-308c-41db-a05f-114b0687aa11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bdccb22ec6c648a4b26e60ae5051c01d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:00.714469 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-91028053-308c-41db-a05f-114b0687aa11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bdccb22ec6c648a4b26e60ae5051c01d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:00.738326 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-91028053-308c-41db-a05f-114b0687aa11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bdccb22ec6c648a4b26e60ae5051c01d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:00.761886 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 961/1888] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:03:00 2022] DELETE /identity/v3/users/bdccb22ec6c648a4b26e60ae5051c01d => generated 0 bytes in 665 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:00.803890 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-94dedc8a-5405-44d5-b6f4-f39a0cb6fb2d admin admin] The token cache is being invalidate because project 4e008d4be77240848106e3bc647fd4de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:03:00.808920 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-94dedc8a-5405-44d5-b6f4-f39a0cb6fb2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:00.808920 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-94dedc8a-5405-44d5-b6f4-f39a0cb6fb2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:00.808920 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 928/1889] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:03:00 2022] DELETE /identity/v3/projects/4e008d4be77240848106e3bc647fd4de => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:03:00.812860 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e187a6-037a-44c2-88c1-4b95e16091d7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:00.813153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e187a6-037a-44c2-88c1-4b95e16091d7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:00.813434 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e187a6-037a-44c2-88c1-4b95e16091d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:00.855880 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-12e187a6-037a-44c2-88c1-4b95e16091d7 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:00.857855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-12e187a6-037a-44c2-88c1-4b95e16091d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:01.010502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 962/1890] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:01.020721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dd1da-b5ce-4923-a5b3-a296495955c4 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:01.021217 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dd1da-b5ce-4923-a5b3-a296495955c4 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:01.021672 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2dd1da-b5ce-4923-a5b3-a296495955c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:01.067685 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-7f2dd1da-b5ce-4923-a5b3-a296495955c4 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:01.069008 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7f2dd1da-b5ce-4923-a5b3-a296495955c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:01.078957 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 929/1891] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:01.084515 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e187a6-037a-44c2-88c1-4b95e16091d7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:01.106281 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e187a6-037a-44c2-88c1-4b95e16091d7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:01.117305 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba31200-7c80-45ef-af0e-2e45e089ed8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:01.119652 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba31200-7c80-45ef-af0e-2e45e089ed8b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:01.121166 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba31200-7c80-45ef-af0e-2e45e089ed8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:01.121900 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba31200-7c80-45ef-af0e-2e45e089ed8b admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:01.124288 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba31200-7c80-45ef-af0e-2e45e089ed8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:03:01.124778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba31200-7c80-45ef-af0e-2e45e089ed8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:01.127363 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba31200-7c80-45ef-af0e-2e45e089ed8b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:01.157109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2dd1da-b5ce-4923-a5b3-a296495955c4 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:01.163845 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 963/1892] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:03:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:03:01.170072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2dd1da-b5ce-4923-a5b3-a296495955c4 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:01.176626 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c324c32-fddc-42c4-b313-8ded4a85aed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:01.202038 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c324c32-fddc-42c4-b313-8ded4a85aed4 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:01.202397 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c324c32-fddc-42c4-b313-8ded4a85aed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:01.202681 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c324c32-fddc-42c4-b313-8ded4a85aed4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:01.203379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c324c32-fddc-42c4-b313-8ded4a85aed4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:01.212504 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c324c32-fddc-42c4-b313-8ded4a85aed4 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:01.347413 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 930/1893] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:03:01 2022] POST /identity/v3/projects => generated 373 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:03:01.351495 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba31200-7c80-45ef-af0e-2e45e089ed8b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:01.366354 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba31200-7c80-45ef-af0e-2e45e089ed8b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:01.393311 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:01.448969 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321473ef-9bbc-4715-8795-1b44badbb3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:01.449585 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321473ef-9bbc-4715-8795-1b44badbb3dd admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:01.450381 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321473ef-9bbc-4715-8795-1b44badbb3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:01.450381 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321473ef-9bbc-4715-8795-1b44badbb3dd admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:01.450774 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321473ef-9bbc-4715-8795-1b44badbb3dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:01.452723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321473ef-9bbc-4715-8795-1b44badbb3dd admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:01.556656 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 964/1894] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:03:01 2022] POST /identity/v3/users => generated 287 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:03:01.576970 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c324c32-fddc-42c4-b313-8ded4a85aed4 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:01.588695 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c324c32-fddc-42c4-b313-8ded4a85aed4 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:01.592224 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321473ef-9bbc-4715-8795-1b44badbb3dd admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:01.593760 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816e3f0-4516-4591-b829-18c3582f32ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:01.594116 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-321473ef-9bbc-4715-8795-1b44badbb3dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:01.594577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816e3f0-4516-4591-b829-18c3582f32ce admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:01.594880 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816e3f0-4516-4591-b829-18c3582f32ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:01.595225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816e3f0-4516-4591-b829-18c3582f32ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:01.596123 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816e3f0-4516-4591-b829-18c3582f32ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:01.597911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816e3f0-4516-4591-b829-18c3582f32ce admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:01.613736 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321473ef-9bbc-4715-8795-1b44badbb3dd admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:01.618899 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ec7e3f-ed00-4806-9fa5-8d0620ba21ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:01.619431 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec7e3f-ed00-4806-9fa5-8d0620ba21ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:01.620287 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec7e3f-ed00-4806-9fa5-8d0620ba21ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:01.620574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ec7e3f-ed00-4806-9fa5-8d0620ba21ea admin admin] PATH_INFO: `/v3/projects/59529b877c044eaea79aed1b6a711008` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:01.621743 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec7e3f-ed00-4806-9fa5-8d0620ba21ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=59529b877c044eaea79aed1b6a711008)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:01.623665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ec7e3f-ed00-4806-9fa5-8d0620ba21ea admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:01.628663 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 931/1895] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:01.629883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816e3f0-4516-4591-b829-18c3582f32ce admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:01.646885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816e3f0-4516-4591-b829-18c3582f32ce admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:01.654445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78735e-cf16-44c4-93ed-dd46f67ddca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:01.655143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78735e-cf16-44c4-93ed-dd46f67ddca2 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:01.655491 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78735e-cf16-44c4-93ed-dd46f67ddca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:01.655926 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78735e-cf16-44c4-93ed-dd46f67ddca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:01.656716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78735e-cf16-44c4-93ed-dd46f67ddca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:01.658535 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78735e-cf16-44c4-93ed-dd46f67ddca2 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:01.670192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 932/1896] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:01 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:01.674239 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78735e-cf16-44c4-93ed-dd46f67ddca2 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:01.684119 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78735e-cf16-44c4-93ed-dd46f67ddca2 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:01.690430 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739b9582-23cd-4d2a-9297-09793dedca5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:01.691409 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b9582-23cd-4d2a-9297-09793dedca5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:01.691816 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b9582-23cd-4d2a-9297-09793dedca5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:01.692128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739b9582-23cd-4d2a-9297-09793dedca5f admin admin] PATH_INFO: `/v3/projects/b3c71fb9f1ba4220ac4de18c27b89c62/users/edbdc483f930467fbae99f11b1e62496/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:01.708202 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b9582-23cd-4d2a-9297-09793dedca5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3c71fb9f1ba4220ac4de18c27b89c62, user_id=edbdc483f930467fbae99f11b1e62496, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:01.710907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739b9582-23cd-4d2a-9297-09793dedca5f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:01.790882 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 933/1897] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:03:01 2022] PUT /identity/v3/projects/b3c71fb9f1ba4220ac4de18c27b89c62/users/edbdc483f930467fbae99f11b1e62496/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:03:01.798247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-92ec7e3f-ed00-4806-9fa5-8d0620ba21ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59529b877c044eaea79aed1b6a711008', 'request_id': 'req-92ec7e3f-ed00-4806-9fa5-8d0620ba21ea'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:01.802922 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4e255-eb73-4a02-ba60-555950f4f500 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:01.803214 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4e255-eb73-4a02-ba60-555950f4f500 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:01.803693 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa4e255-eb73-4a02-ba60-555950f4f500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:01.833120 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-9aa4e255-eb73-4a02-ba60-555950f4f500 None None] MFA Rules not processed for user `edbdc483f930467fbae99f11b1e62496`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:01.834387 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9aa4e255-eb73-4a02-ba60-555950f4f500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:01.886968 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-92ec7e3f-ed00-4806-9fa5-8d0620ba21ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59529b877c044eaea79aed1b6a711008', 'request_id': 'req-92ec7e3f-ed00-4806-9fa5-8d0620ba21ea'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:01.897710 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-92ec7e3f-ed00-4806-9fa5-8d0620ba21ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59529b877c044eaea79aed1b6a711008', 'request_id': 'req-92ec7e3f-ed00-4806-9fa5-8d0620ba21ea'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:01.907007 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:01.911392 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-92ec7e3f-ed00-4806-9fa5-8d0620ba21ea admin admin] The token cache is being invalidate because project 59529b877c044eaea79aed1b6a711008 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:03:01.911681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-92ec7e3f-ed00-4806-9fa5-8d0620ba21ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:01.912358 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-92ec7e3f-ed00-4806-9fa5-8d0620ba21ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:01.919606 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 965/1898] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:03:01 2022] DELETE /identity/v3/projects/59529b877c044eaea79aed1b6a711008 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:01.921650 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e8147-f6eb-4fab-af0a-047864200166 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:01.921974 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e8147-f6eb-4fab-af0a-047864200166 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:01.922251 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e8147-f6eb-4fab-af0a-047864200166 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:01.937658 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 934/1899] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:03:01.950959 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4e255-eb73-4a02-ba60-555950f4f500 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:01.954117 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9aa4e255-eb73-4a02-ba60-555950f4f500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:01.960168 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a02e8147-f6eb-4fab-af0a-047864200166 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:01.961197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a02e8147-f6eb-4fab-af0a-047864200166 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:02.043415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa4e255-eb73-4a02-ba60-555950f4f500 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:02.048459 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bdede-9410-42ca-ab85-79edce9ac832 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:02.049682 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bdede-9410-42ca-ab85-79edce9ac832 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:02.050056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bdede-9410-42ca-ab85-79edce9ac832 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:02.050472 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1bdede-9410-42ca-ab85-79edce9ac832 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:02.055650 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 966/1900] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:02.061496 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1bdede-9410-42ca-ab85-79edce9ac832 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:02.063210 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1bdede-9410-42ca-ab85-79edce9ac832 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:02.064141 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5a5b5-2236-4ead-a780-faa60932ec66 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:02.064433 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5a5b5-2236-4ead-a780-faa60932ec66 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:02.064783 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5a5b5-2236-4ead-a780-faa60932ec66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:02.083600 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 935/1901] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:03:02.086894 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-02e5a5b5-2236-4ead-a780-faa60932ec66 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:02.088135 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-02e5a5b5-2236-4ead-a780-faa60932ec66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:02.104587 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 967/1902] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:02.109435 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bdede-9410-42ca-ab85-79edce9ac832 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:02.109644 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5a5b5-2236-4ead-a780-faa60932ec66 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:02.111084 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-02e5a5b5-2236-4ead-a780-faa60932ec66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:02.121637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1bdede-9410-42ca-ab85-79edce9ac832 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:02.126350 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5a5b5-2236-4ead-a780-faa60932ec66 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:02.129179 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7a90d-daed-4d36-8c2c-2e2c81b5fd60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:02.129957 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7a90d-daed-4d36-8c2c-2e2c81b5fd60 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:02.130392 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7a90d-daed-4d36-8c2c-2e2c81b5fd60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:02.130967 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a7a90d-daed-4d36-8c2c-2e2c81b5fd60 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:02.131523 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7a90d-daed-4d36-8c2c-2e2c81b5fd60 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:03:02.132288 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7a90d-daed-4d36-8c2c-2e2c81b5fd60 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:02.132405 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a4a91c-9750-46ec-a569-3043a3a86331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:02.132850 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4a91c-9750-46ec-a569-3043a3a86331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:02.133188 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4a91c-9750-46ec-a569-3043a3a86331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:02.133520 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a4a91c-9750-46ec-a569-3043a3a86331 admin admin] PATH_INFO: `/v3/users/edbdc483f930467fbae99f11b1e62496` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:02.134162 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a7a90d-daed-4d36-8c2c-2e2c81b5fd60 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:02.134854 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a4a91c-9750-46ec-a569-3043a3a86331 admin admin] RBAC: Authorizing `identity:delete_user(user_id=edbdc483f930467fbae99f11b1e62496)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:02.137478 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a4a91c-9750-46ec-a569-3043a3a86331 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:02.156012 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 936/1903] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:03:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:03:02.157425 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7a90d-daed-4d36-8c2c-2e2c81b5fd60 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:02.168222 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a7a90d-daed-4d36-8c2c-2e2c81b5fd60 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:02.172980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafca9d2-d2d0-44b6-8d89-822d67f598ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:02.173588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafca9d2-d2d0-44b6-8d89-822d67f598ce admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:02.173895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafca9d2-d2d0-44b6-8d89-822d67f598ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:02.174167 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafca9d2-d2d0-44b6-8d89-822d67f598ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:02.180042 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafca9d2-d2d0-44b6-8d89-822d67f598ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:02.180042 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eafca9d2-d2d0-44b6-8d89-822d67f598ce admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:02.235817 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:02.266175 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 937/1904] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:03:02 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:02.278227 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafca9d2-d2d0-44b6-8d89-822d67f598ce admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:02.357014 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-75a4a91c-9750-46ec-a569-3043a3a86331 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'edbdc483f930467fbae99f11b1e62496'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:02.420446 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafca9d2-d2d0-44b6-8d89-822d67f598ce admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:02.426646 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f0e29-5572-4a26-9c27-9504652c1b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:02.427282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f0e29-5572-4a26-9c27-9504652c1b7a admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:02.427622 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f0e29-5572-4a26-9c27-9504652c1b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:02.428201 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438f0e29-5572-4a26-9c27-9504652c1b7a admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:02.429103 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f0e29-5572-4a26-9c27-9504652c1b7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:02.431451 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438f0e29-5572-4a26-9c27-9504652c1b7a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:02.493328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-75a4a91c-9750-46ec-a569-3043a3a86331 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'edbdc483f930467fbae99f11b1e62496'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:02.508435 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-75a4a91c-9750-46ec-a569-3043a3a86331 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'edbdc483f930467fbae99f11b1e62496'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:02.509181 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-75a4a91c-9750-46ec-a569-3043a3a86331 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'edbdc483f930467fbae99f11b1e62496'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:02.523158 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-75a4a91c-9750-46ec-a569-3043a3a86331 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'edbdc483f930467fbae99f11b1e62496'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:02.532867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 968/1905] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:03:02 2022] DELETE /identity/v3/users/edbdc483f930467fbae99f11b1e62496 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:02.534384 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 938/1906] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:03:02 2022] POST /identity/v3/users => generated 293 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:02.537644 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c90bd-d41a-4d04-89cc-b4498dc64aff None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:02.538026 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c90bd-d41a-4d04-89cc-b4498dc64aff None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:02.538372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865c90bd-d41a-4d04-89cc-b4498dc64aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:02.538565 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f0e29-5572-4a26-9c27-9504652c1b7a admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:02.540915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-438f0e29-5572-4a26-9c27-9504652c1b7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:02.556683 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438f0e29-5572-4a26-9c27-9504652c1b7a admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:02.564169 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-865c90bd-d41a-4d04-89cc-b4498dc64aff None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:02.568971 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-865c90bd-d41a-4d04-89cc-b4498dc64aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:02.638869 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:02.650434 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 969/1907] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:02.660278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e67737-18b4-49eb-b9b5-70bbc4119f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:02.661142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e67737-18b4-49eb-b9b5-70bbc4119f1b admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:02.661516 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e67737-18b4-49eb-b9b5-70bbc4119f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:02.661967 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e67737-18b4-49eb-b9b5-70bbc4119f1b admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:02.662954 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e67737-18b4-49eb-b9b5-70bbc4119f1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:02.665093 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e67737-18b4-49eb-b9b5-70bbc4119f1b admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:02.665308 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c90bd-d41a-4d04-89cc-b4498dc64aff None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:02.667586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-865c90bd-d41a-4d04-89cc-b4498dc64aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:02.691918 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 939/1908] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:02.696461 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e67737-18b4-49eb-b9b5-70bbc4119f1b admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:02.712009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e67737-18b4-49eb-b9b5-70bbc4119f1b admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:02.720998 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4b1a2-5298-4fc9-a6ec-89fd24ae353f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:02.721630 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4b1a2-5298-4fc9-a6ec-89fd24ae353f admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:02.721947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4b1a2-5298-4fc9-a6ec-89fd24ae353f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:02.722584 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c4b1a2-5298-4fc9-a6ec-89fd24ae353f admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:02.723248 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4b1a2-5298-4fc9-a6ec-89fd24ae353f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:02.726237 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c4b1a2-5298-4fc9-a6ec-89fd24ae353f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:02.743338 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 940/1909] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:02 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:02.749884 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4b1a2-5298-4fc9-a6ec-89fd24ae353f admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:02.763418 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c4b1a2-5298-4fc9-a6ec-89fd24ae353f admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:02.768592 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35fb3b-760f-47ac-a2bb-209330cabd13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:02.769447 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35fb3b-760f-47ac-a2bb-209330cabd13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:02.769895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35fb3b-760f-47ac-a2bb-209330cabd13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:02.770136 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865c90bd-d41a-4d04-89cc-b4498dc64aff None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:02.770269 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35fb3b-760f-47ac-a2bb-209330cabd13 admin admin] PATH_INFO: `/v3/projects/7e30ea1ced4145d9b6265ba46b982083/users/397721eb57084f1583f854a15cbfeccb/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:02.783306 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80c4241-9ec8-49d4-a04a-0251a98e77a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:02.784289 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c4241-9ec8-49d4-a04a-0251a98e77a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:02.784701 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c4241-9ec8-49d4-a04a-0251a98e77a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:02.785147 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80c4241-9ec8-49d4-a04a-0251a98e77a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:02.797514 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c4241-9ec8-49d4-a04a-0251a98e77a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:02.805892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35fb3b-760f-47ac-a2bb-209330cabd13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e30ea1ced4145d9b6265ba46b982083, user_id=397721eb57084f1583f854a15cbfeccb, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:02.810325 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b80c4241-9ec8-49d4-a04a-0251a98e77a4 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:02.810521 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35fb3b-760f-47ac-a2bb-209330cabd13 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:02.821787 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 970/1910] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:02.888548 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 941/1911] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:03:02 2022] PUT /identity/v3/projects/7e30ea1ced4145d9b6265ba46b982083/users/397721eb57084f1583f854a15cbfeccb/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:02.900638 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dd577-b596-4444-b7cf-57adcd0a981b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:02.901646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dd577-b596-4444-b7cf-57adcd0a981b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:02.902170 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5dd577-b596-4444-b7cf-57adcd0a981b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:02.934907 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7c5dd577-b596-4444-b7cf-57adcd0a981b None None] MFA Rules not processed for user `397721eb57084f1583f854a15cbfeccb`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:02.936246 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7c5dd577-b596-4444-b7cf-57adcd0a981b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:02.976652 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:03.009299 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 971/1912] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:03.021815 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35fb3b-760f-47ac-a2bb-209330cabd13 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:03.023730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2e35fb3b-760f-47ac-a2bb-209330cabd13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:03.105365 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35fb3b-760f-47ac-a2bb-209330cabd13 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:03.110339 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5acec4d-daff-40c4-81d4-37ca5ed11526 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:03.110969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acec4d-daff-40c4-81d4-37ca5ed11526 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:03.111252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acec4d-daff-40c4-81d4-37ca5ed11526 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:03.111531 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5acec4d-daff-40c4-81d4-37ca5ed11526 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:03.121960 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5acec4d-daff-40c4-81d4-37ca5ed11526 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:03.135898 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5acec4d-daff-40c4-81d4-37ca5ed11526 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:03.143750 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 942/1913] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:03 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:03.166713 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5dd577-b596-4444-b7cf-57adcd0a981b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:03.263730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5dd577-b596-4444-b7cf-57adcd0a981b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:03.268368 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b1992-91c3-471d-a7b5-5b0f12cebf3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:03.268998 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b1992-91c3-471d-a7b5-5b0f12cebf3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:03.269277 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b1992-91c3-471d-a7b5-5b0f12cebf3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:03.269549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b1992-91c3-471d-a7b5-5b0f12cebf3d admin admin] PATH_INFO: `/v3/users/397721eb57084f1583f854a15cbfeccb` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:03.270700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b1992-91c3-471d-a7b5-5b0f12cebf3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=397721eb57084f1583f854a15cbfeccb)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:03.272610 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b1992-91c3-471d-a7b5-5b0f12cebf3d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:03.471905 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b33b1992-91c3-471d-a7b5-5b0f12cebf3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '397721eb57084f1583f854a15cbfeccb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:03.550305 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b33b1992-91c3-471d-a7b5-5b0f12cebf3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '397721eb57084f1583f854a15cbfeccb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:03.564072 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b33b1992-91c3-471d-a7b5-5b0f12cebf3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '397721eb57084f1583f854a15cbfeccb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:03.564834 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b33b1992-91c3-471d-a7b5-5b0f12cebf3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '397721eb57084f1583f854a15cbfeccb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:03.572244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b33b1992-91c3-471d-a7b5-5b0f12cebf3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '397721eb57084f1583f854a15cbfeccb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:03.579571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 972/1914] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:03:03 2022] DELETE /identity/v3/users/397721eb57084f1583f854a15cbfeccb => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:03.584348 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8261b17-a5bb-4ef9-99f4-f5b21273806a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:03.584706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8261b17-a5bb-4ef9-99f4-f5b21273806a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:03.585092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8261b17-a5bb-4ef9-99f4-f5b21273806a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:03.608000 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-b8261b17-a5bb-4ef9-99f4-f5b21273806a None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:03.608184 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b1992-91c3-471d-a7b5-5b0f12cebf3d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:03.609364 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b8261b17-a5bb-4ef9-99f4-f5b21273806a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:03.610655 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b33b1992-91c3-471d-a7b5-5b0f12cebf3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:03.702970 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 943/1915] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:03:03.716614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8261b17-a5bb-4ef9-99f4-f5b21273806a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:03.718045 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:03.718424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b8261b17-a5bb-4ef9-99f4-f5b21273806a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:03.724478 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b1992-91c3-471d-a7b5-5b0f12cebf3d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:03.730771 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946e9467-f253-4a39-8770-e8cad6fa2a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:03.731487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e9467-f253-4a39-8770-e8cad6fa2a52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:03.731914 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e9467-f253-4a39-8770-e8cad6fa2a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:03.732228 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946e9467-f253-4a39-8770-e8cad6fa2a52 admin admin] PATH_INFO: `/v3/projects/b3c71fb9f1ba4220ac4de18c27b89c62` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:03.733545 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e9467-f253-4a39-8770-e8cad6fa2a52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3c71fb9f1ba4220ac4de18c27b89c62)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:03.735791 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946e9467-f253-4a39-8770-e8cad6fa2a52 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:03.790266 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8261b17-a5bb-4ef9-99f4-f5b21273806a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:03.794052 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5079631-fe25-47b9-87c0-4efbaa2838ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:03.794932 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5079631-fe25-47b9-87c0-4efbaa2838ea service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:03.795239 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5079631-fe25-47b9-87c0-4efbaa2838ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:03.795513 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5079631-fe25-47b9-87c0-4efbaa2838ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:03.801970 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:03.806676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5079631-fe25-47b9-87c0-4efbaa2838ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:03.808121 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5079631-fe25-47b9-87c0-4efbaa2838ea service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:03.823201 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 944/1916] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:03:03.860548 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-946e9467-f253-4a39-8770-e8cad6fa2a52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3c71fb9f1ba4220ac4de18c27b89c62', 'request_id': 'req-946e9467-f253-4a39-8770-e8cad6fa2a52'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:03.944679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-946e9467-f253-4a39-8770-e8cad6fa2a52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3c71fb9f1ba4220ac4de18c27b89c62', 'request_id': 'req-946e9467-f253-4a39-8770-e8cad6fa2a52'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:03.951274 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-946e9467-f253-4a39-8770-e8cad6fa2a52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3c71fb9f1ba4220ac4de18c27b89c62', 'request_id': 'req-946e9467-f253-4a39-8770-e8cad6fa2a52'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:03.963093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-946e9467-f253-4a39-8770-e8cad6fa2a52 admin admin] The token cache is being invalidate because project b3c71fb9f1ba4220ac4de18c27b89c62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:03:03.964146 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-946e9467-f253-4a39-8770-e8cad6fa2a52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:03.964822 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-946e9467-f253-4a39-8770-e8cad6fa2a52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:03.970011 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 973/1917] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:03:03 2022] DELETE /identity/v3/projects/b3c71fb9f1ba4220ac4de18c27b89c62 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:03:03.972014 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200c1d4-f361-49bc-aa03-ef7da9eb187a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:03.972304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200c1d4-f361-49bc-aa03-ef7da9eb187a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:03.972587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d200c1d4-f361-49bc-aa03-ef7da9eb187a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:04.004773 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-d200c1d4-f361-49bc-aa03-ef7da9eb187a None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:04.006586 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d200c1d4-f361-49bc-aa03-ef7da9eb187a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:04.071818 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 945/1918] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:04.083669 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686e924-a384-473b-a0f7-5fcee65b947d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:04.084099 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686e924-a384-473b-a0f7-5fcee65b947d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:04.084304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3686e924-a384-473b-a0f7-5fcee65b947d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:04.105749 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3686e924-a384-473b-a0f7-5fcee65b947d None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:04.107076 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3686e924-a384-473b-a0f7-5fcee65b947d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:04.115575 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 974/1919] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:04.120658 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200c1d4-f361-49bc-aa03-ef7da9eb187a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:04.144472 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d200c1d4-f361-49bc-aa03-ef7da9eb187a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:04.150026 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da61ce-2bf3-4911-896a-2c15fef4c3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:04.150678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da61ce-2bf3-4911-896a-2c15fef4c3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:04.150991 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da61ce-2bf3-4911-896a-2c15fef4c3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:04.151431 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7da61ce-2bf3-4911-896a-2c15fef4c3e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:04.152096 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da61ce-2bf3-4911-896a-2c15fef4c3e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:03:04.152399 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da61ce-2bf3-4911-896a-2c15fef4c3e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:04.154044 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7da61ce-2bf3-4911-896a-2c15fef4c3e1 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:04.166465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 946/1920] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:03:04.170748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686e924-a384-473b-a0f7-5fcee65b947d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:04.180069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3686e924-a384-473b-a0f7-5fcee65b947d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:04.185348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957159c-8a97-483b-9a54-6cf125bcc98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:04.185988 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957159c-8a97-483b-9a54-6cf125bcc98f admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:04.186266 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957159c-8a97-483b-9a54-6cf125bcc98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:04.186535 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957159c-8a97-483b-9a54-6cf125bcc98f admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:04.187164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957159c-8a97-483b-9a54-6cf125bcc98f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:04.189265 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957159c-8a97-483b-9a54-6cf125bcc98f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:04.266829 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 975/1921] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:03:04 2022] POST /identity/v3/projects => generated 373 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:04.270741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da61ce-2bf3-4911-896a-2c15fef4c3e1 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:04.281222 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7da61ce-2bf3-4911-896a-2c15fef4c3e1 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:04.338575 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957159c-8a97-483b-9a54-6cf125bcc98f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:04.340559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0957159c-8a97-483b-9a54-6cf125bcc98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:04.356721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c900e-4c3a-4a34-af23-b6d8f9c4b33d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:04.357676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c900e-4c3a-4a34-af23-b6d8f9c4b33d admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:04.358094 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c900e-4c3a-4a34-af23-b6d8f9c4b33d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:04.358495 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7c900e-4c3a-4a34-af23-b6d8f9c4b33d admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:04.359414 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c900e-4c3a-4a34-af23-b6d8f9c4b33d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:04.361541 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7c900e-4c3a-4a34-af23-b6d8f9c4b33d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:04.445589 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957159c-8a97-483b-9a54-6cf125bcc98f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:04.451706 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74dbb3e-7af6-442b-933c-a8a07342d717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:04.452081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dbb3e-7af6-442b-933c-a8a07342d717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:04.452363 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dbb3e-7af6-442b-933c-a8a07342d717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:04.452636 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74dbb3e-7af6-442b-933c-a8a07342d717 admin admin] PATH_INFO: `/v3/projects/7e30ea1ced4145d9b6265ba46b982083` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:04.453817 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74dbb3e-7af6-442b-933c-a8a07342d717 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e30ea1ced4145d9b6265ba46b982083)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:04.455747 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74dbb3e-7af6-442b-933c-a8a07342d717 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:04.475720 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 947/1922] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:03:04 2022] POST /identity/v3/users => generated 287 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:04.479841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c900e-4c3a-4a34-af23-b6d8f9c4b33d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:04.495001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7c900e-4c3a-4a34-af23-b6d8f9c4b33d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:04.501319 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef71cfa-cf43-4784-9f4b-dca5329389ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:04.501968 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef71cfa-cf43-4784-9f4b-dca5329389ae admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:04.505797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef71cfa-cf43-4784-9f4b-dca5329389ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:04.505797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef71cfa-cf43-4784-9f4b-dca5329389ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:04.505797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef71cfa-cf43-4784-9f4b-dca5329389ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:04.505797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef71cfa-cf43-4784-9f4b-dca5329389ae admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:04.516603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 948/1923] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:04.521075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef71cfa-cf43-4784-9f4b-dca5329389ae admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:04.533771 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef71cfa-cf43-4784-9f4b-dca5329389ae admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:04.538896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7dca1-f5a4-4143-b482-c1b98171d559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:04.539532 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7dca1-f5a4-4143-b482-c1b98171d559 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:04.539914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7dca1-f5a4-4143-b482-c1b98171d559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:04.540097 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e7dca1-f5a4-4143-b482-c1b98171d559 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:04.540806 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7dca1-f5a4-4143-b482-c1b98171d559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:04.542962 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e7dca1-f5a4-4143-b482-c1b98171d559 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:04.558063 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 949/1924] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:04 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:03:04.559158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7dca1-f5a4-4143-b482-c1b98171d559 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:04.570196 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e7dca1-f5a4-4143-b482-c1b98171d559 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:04.585924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea42e65-7d10-44f5-ad0e-5473eb3f82f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:04.589850 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea42e65-7d10-44f5-ad0e-5473eb3f82f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:04.589850 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea42e65-7d10-44f5-ad0e-5473eb3f82f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:04.589850 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea42e65-7d10-44f5-ad0e-5473eb3f82f1 admin admin] PATH_INFO: `/v3/projects/9f9ae042993144598ab22cb5194a09ff/users/d7a8381206f54bf395d8bdf2a1e9fc41/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:04.609067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d74dbb3e-7af6-442b-933c-a8a07342d717 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e30ea1ced4145d9b6265ba46b982083', 'request_id': 'req-d74dbb3e-7af6-442b-933c-a8a07342d717'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:04.613714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea42e65-7d10-44f5-ad0e-5473eb3f82f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f9ae042993144598ab22cb5194a09ff, user_id=d7a8381206f54bf395d8bdf2a1e9fc41, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:04.616985 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea42e65-7d10-44f5-ad0e-5473eb3f82f1 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:04.675742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d74dbb3e-7af6-442b-933c-a8a07342d717 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e30ea1ced4145d9b6265ba46b982083', 'request_id': 'req-d74dbb3e-7af6-442b-933c-a8a07342d717'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:04.678250 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:04.683759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d74dbb3e-7af6-442b-933c-a8a07342d717 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e30ea1ced4145d9b6265ba46b982083', 'request_id': 'req-d74dbb3e-7af6-442b-933c-a8a07342d717'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:04.694838 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 950/1925] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:03:04 2022] PUT /identity/v3/projects/9f9ae042993144598ab22cb5194a09ff/users/d7a8381206f54bf395d8bdf2a1e9fc41/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:03:04.701113 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d74dbb3e-7af6-442b-933c-a8a07342d717 admin admin] The token cache is being invalidate because project 7e30ea1ced4145d9b6265ba46b982083 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:03:04.701401 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d74dbb3e-7af6-442b-933c-a8a07342d717 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:04.702092 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d74dbb3e-7af6-442b-933c-a8a07342d717 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:04.703790 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 976/1926] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:03:04 2022] DELETE /identity/v3/projects/7e30ea1ced4145d9b6265ba46b982083 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:04.706352 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e2172-5307-47d2-afb2-f83e418d9fa2 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:04.707547 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e2172-5307-47d2-afb2-f83e418d9fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:04.707837 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056e2172-5307-47d2-afb2-f83e418d9fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:04.708319 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ef6e3-dc43-40e3-915f-fb0952314cec None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:04.708575 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ef6e3-dc43-40e3-915f-fb0952314cec None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:04.708849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329ef6e3-dc43-40e3-915f-fb0952314cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:04.731846 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-329ef6e3-dc43-40e3-915f-fb0952314cec None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:04.733063 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-329ef6e3-dc43-40e3-915f-fb0952314cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:04.744316 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-056e2172-5307-47d2-afb2-f83e418d9fa2 None None] MFA Rules not processed for user `d7a8381206f54bf395d8bdf2a1e9fc41`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:04.745845 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-056e2172-5307-47d2-afb2-f83e418d9fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:04.762111 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:04.849549 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 951/1927] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:04.857076 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e2172-5307-47d2-afb2-f83e418d9fa2 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:04.857227 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 977/1928] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:03:04.858859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b808c2-732d-4386-9415-0b3db6944d4d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:04.859139 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b808c2-732d-4386-9415-0b3db6944d4d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:04.861224 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b808c2-732d-4386-9415-0b3db6944d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:04.861453 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-056e2172-5307-47d2-afb2-f83e418d9fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:04.899925 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-25b808c2-732d-4386-9415-0b3db6944d4d None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:04.901169 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-25b808c2-732d-4386-9415-0b3db6944d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:04.926676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 978/1929] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:04.927631 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b808c2-732d-4386-9415-0b3db6944d4d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:04.938024 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b808c2-732d-4386-9415-0b3db6944d4d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:04.943287 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b81f1-8897-4f0d-9b6a-a2ef72d97bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:04.944097 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b81f1-8897-4f0d-9b6a-a2ef72d97bcd admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:04.944373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b81f1-8897-4f0d-9b6a-a2ef72d97bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:04.944640 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82b81f1-8897-4f0d-9b6a-a2ef72d97bcd admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:04.945288 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b81f1-8897-4f0d-9b6a-a2ef72d97bcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:03:04.945588 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b81f1-8897-4f0d-9b6a-a2ef72d97bcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:04.947300 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82b81f1-8897-4f0d-9b6a-a2ef72d97bcd admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:04.964354 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 979/1930] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:03:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:03:04.965265 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b81f1-8897-4f0d-9b6a-a2ef72d97bcd admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:04.967082 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056e2172-5307-47d2-afb2-f83e418d9fa2 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:04.977562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e351a0-7a68-4eeb-a112-493a60f499cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:04.977562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e351a0-7a68-4eeb-a112-493a60f499cf service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:04.977562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e351a0-7a68-4eeb-a112-493a60f499cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:04.977562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e351a0-7a68-4eeb-a112-493a60f499cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:04.978163 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82b81f1-8897-4f0d-9b6a-a2ef72d97bcd admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:04.981302 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad010b-b474-4ba2-90db-33118b5d69e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:04.981955 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad010b-b474-4ba2-90db-33118b5d69e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:04.982232 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad010b-b474-4ba2-90db-33118b5d69e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:04.982501 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bad010b-b474-4ba2-90db-33118b5d69e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:04.983133 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad010b-b474-4ba2-90db-33118b5d69e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:04.985048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bad010b-b474-4ba2-90db-33118b5d69e3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:04.985581 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e351a0-7a68-4eeb-a112-493a60f499cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:04.987117 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e351a0-7a68-4eeb-a112-493a60f499cf service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:05.000133 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 952/1931] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:04 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:03:05.083541 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 980/1932] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:03:04 2022] POST /identity/v3/projects => generated 371 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:05.087457 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e351a0-7a68-4eeb-a112-493a60f499cf service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:05.104886 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e351a0-7a68-4eeb-a112-493a60f499cf service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:05.200846 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec628f29-2c08-4632-a5bd-ef576f578b0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:05.201550 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec628f29-2c08-4632-a5bd-ef576f578b0e admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:05.201882 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec628f29-2c08-4632-a5bd-ef576f578b0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:05.202163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec628f29-2c08-4632-a5bd-ef576f578b0e admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:05.202965 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec628f29-2c08-4632-a5bd-ef576f578b0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:05.205541 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec628f29-2c08-4632-a5bd-ef576f578b0e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:05.305801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 953/1933] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:03:05 2022] POST /identity/v3/users => generated 286 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:05.312037 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad010b-b474-4ba2-90db-33118b5d69e3 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:05.322762 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bad010b-b474-4ba2-90db-33118b5d69e3 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:05.332548 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3cb601-d31e-460c-9c5f-f7b53665e356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:05.334155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cb601-d31e-460c-9c5f-f7b53665e356 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:05.334730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cb601-d31e-460c-9c5f-f7b53665e356 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:05.335158 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3cb601-d31e-460c-9c5f-f7b53665e356 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:05.336464 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3cb601-d31e-460c-9c5f-f7b53665e356 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:05.339129 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3cb601-d31e-460c-9c5f-f7b53665e356 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:05.353378 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 981/1934] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:05.358052 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec628f29-2c08-4632-a5bd-ef576f578b0e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:05.368514 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec628f29-2c08-4632-a5bd-ef576f578b0e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:05.375680 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0aebc-c257-4a75-aee3-6716f4cbb0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:05.376009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0aebc-c257-4a75-aee3-6716f4cbb0a0 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:05.376296 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0aebc-c257-4a75-aee3-6716f4cbb0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:05.376572 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0aebc-c257-4a75-aee3-6716f4cbb0a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:05.377352 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0aebc-c257-4a75-aee3-6716f4cbb0a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:05.378841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0aebc-c257-4a75-aee3-6716f4cbb0a0 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:05.390231 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 954/1935] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:05.394438 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3cb601-d31e-460c-9c5f-f7b53665e356 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:05.405839 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3cb601-d31e-460c-9c5f-f7b53665e356 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:05.410482 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf81c3-92e0-4a19-9692-71bcb0593a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:05.411147 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf81c3-92e0-4a19-9692-71bcb0593a39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:05.411428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf81c3-92e0-4a19-9692-71bcb0593a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:05.411713 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abf81c3-92e0-4a19-9692-71bcb0593a39 admin admin] PATH_INFO: `/v3/projects/e18bca3151bb4e79b5376a4feebabf34/users/2d6acc1d6b89468ba947bddbbc2c8d69/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:05.433756 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf81c3-92e0-4a19-9692-71bcb0593a39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e18bca3151bb4e79b5376a4feebabf34, user_id=2d6acc1d6b89468ba947bddbbc2c8d69, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:05.433756 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abf81c3-92e0-4a19-9692-71bcb0593a39 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:05.507004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 982/1936] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:03:05 2022] PUT /identity/v3/projects/e18bca3151bb4e79b5376a4feebabf34/users/2d6acc1d6b89468ba947bddbbc2c8d69/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:05.518070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617d833-5b93-4ef2-88db-3f7447509832 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:05.518372 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617d833-5b93-4ef2-88db-3f7447509832 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:05.518666 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7617d833-5b93-4ef2-88db-3f7447509832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:05.556018 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-7617d833-5b93-4ef2-88db-3f7447509832 None None] MFA Rules not processed for user `2d6acc1d6b89468ba947bddbbc2c8d69`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:05.557809 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7617d833-5b93-4ef2-88db-3f7447509832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:05.584451 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:05.662018 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 955/1937] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:05 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:05.882548 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf81c3-92e0-4a19-9692-71bcb0593a39 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:05.884536 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2abf81c3-92e0-4a19-9692-71bcb0593a39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:05.975403 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abf81c3-92e0-4a19-9692-71bcb0593a39 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:05.980489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1a6be4-eea3-4ef5-b139-27f001734a52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:05.981236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a6be4-eea3-4ef5-b139-27f001734a52 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:05.981655 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a6be4-eea3-4ef5-b139-27f001734a52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:05.981999 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1a6be4-eea3-4ef5-b139-27f001734a52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:05.998332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a6be4-eea3-4ef5-b139-27f001734a52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:05.998332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1a6be4-eea3-4ef5-b139-27f001734a52 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:06.005000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 983/1938] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:06.028519 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617d833-5b93-4ef2-88db-3f7447509832 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:06.109829 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7617d833-5b93-4ef2-88db-3f7447509832 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:06.114654 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab61e3c-8ec0-4086-b5e2-bbf07f58da08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:06.115292 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab61e3c-8ec0-4086-b5e2-bbf07f58da08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:06.115575 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab61e3c-8ec0-4086-b5e2-bbf07f58da08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:06.115881 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab61e3c-8ec0-4086-b5e2-bbf07f58da08 admin admin] PATH_INFO: `/v3/users/2d6acc1d6b89468ba947bddbbc2c8d69` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:06.117037 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab61e3c-8ec0-4086-b5e2-bbf07f58da08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d6acc1d6b89468ba947bddbbc2c8d69)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:06.119066 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab61e3c-8ec0-4086-b5e2-bbf07f58da08 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:06.358900 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-8ab61e3c-8ec0-4086-b5e2-bbf07f58da08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d6acc1d6b89468ba947bddbbc2c8d69'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:06.424278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-8ab61e3c-8ec0-4086-b5e2-bbf07f58da08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d6acc1d6b89468ba947bddbbc2c8d69'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:06.439103 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-8ab61e3c-8ec0-4086-b5e2-bbf07f58da08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d6acc1d6b89468ba947bddbbc2c8d69'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:06.439875 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-8ab61e3c-8ec0-4086-b5e2-bbf07f58da08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d6acc1d6b89468ba947bddbbc2c8d69'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:06.448448 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-8ab61e3c-8ec0-4086-b5e2-bbf07f58da08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d6acc1d6b89468ba947bddbbc2c8d69'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:06.458301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 956/1939] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:03:06 2022] DELETE /identity/v3/users/2d6acc1d6b89468ba947bddbbc2c8d69 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:03:06.462435 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fede04a-311e-484a-808c-0e83e1be9286 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:06.462906 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fede04a-311e-484a-808c-0e83e1be9286 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:06.463061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fede04a-311e-484a-808c-0e83e1be9286 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:06.483648 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9fede04a-311e-484a-808c-0e83e1be9286 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:06.484835 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9fede04a-311e-484a-808c-0e83e1be9286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:06.492663 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:06.543646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 984/1940] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:06.553327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab61e3c-8ec0-4086-b5e2-bbf07f58da08 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:06.554787 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8ab61e3c-8ec0-4086-b5e2-bbf07f58da08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:06.602668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:06.612692 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab61e3c-8ec0-4086-b5e2-bbf07f58da08 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:06.616288 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f07985-d1a0-43d5-b2af-96974da4fded service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:06.616889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f07985-d1a0-43d5-b2af-96974da4fded service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:06.617208 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f07985-d1a0-43d5-b2af-96974da4fded service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:06.617481 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f07985-d1a0-43d5-b2af-96974da4fded service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:06.627498 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f07985-d1a0-43d5-b2af-96974da4fded service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:06.629059 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f07985-d1a0-43d5-b2af-96974da4fded service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:06.640723 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 957/1941] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:07.031626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fede04a-311e-484a-808c-0e83e1be9286 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:07.033061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9fede04a-311e-484a-808c-0e83e1be9286 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:07.047052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fede04a-311e-484a-808c-0e83e1be9286 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:07.058741 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753f43ee-ca5d-42e6-b304-1bc5b7700c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:07.059395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f43ee-ca5d-42e6-b304-1bc5b7700c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:07.059686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f43ee-ca5d-42e6-b304-1bc5b7700c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:07.059998 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753f43ee-ca5d-42e6-b304-1bc5b7700c1b admin admin] PATH_INFO: `/v3/projects/e18bca3151bb4e79b5376a4feebabf34` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:07.061723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f43ee-ca5d-42e6-b304-1bc5b7700c1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e18bca3151bb4e79b5376a4feebabf34)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:07.063935 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753f43ee-ca5d-42e6-b304-1bc5b7700c1b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:07.165653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-753f43ee-ca5d-42e6-b304-1bc5b7700c1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e18bca3151bb4e79b5376a4feebabf34', 'request_id': 'req-753f43ee-ca5d-42e6-b304-1bc5b7700c1b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:07.240558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-753f43ee-ca5d-42e6-b304-1bc5b7700c1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e18bca3151bb4e79b5376a4feebabf34', 'request_id': 'req-753f43ee-ca5d-42e6-b304-1bc5b7700c1b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:07.247462 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-753f43ee-ca5d-42e6-b304-1bc5b7700c1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e18bca3151bb4e79b5376a4feebabf34', 'request_id': 'req-753f43ee-ca5d-42e6-b304-1bc5b7700c1b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:07.263493 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-753f43ee-ca5d-42e6-b304-1bc5b7700c1b admin admin] The token cache is being invalidate because project e18bca3151bb4e79b5376a4feebabf34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:03:07.263982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-753f43ee-ca5d-42e6-b304-1bc5b7700c1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:07.264513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-753f43ee-ca5d-42e6-b304-1bc5b7700c1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:07.266561 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 985/1942] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:03:07 2022] DELETE /identity/v3/projects/e18bca3151bb4e79b5376a4feebabf34 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:07.277621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e73a1-a49a-40b2-b2f9-b968f1fe1d8b None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:07.278599 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e73a1-a49a-40b2-b2f9-b968f1fe1d8b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:07.278883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e73a1-a49a-40b2-b2f9-b968f1fe1d8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:07.302314 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-255e73a1-a49a-40b2-b2f9-b968f1fe1d8b None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:07.303690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-255e73a1-a49a-40b2-b2f9-b968f1fe1d8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:07.365297 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 958/1943] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:07.374119 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c078a8f-76b8-4036-82f2-9363247f350d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:07.374408 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c078a8f-76b8-4036-82f2-9363247f350d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:07.374688 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c078a8f-76b8-4036-82f2-9363247f350d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:07.394750 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8c078a8f-76b8-4036-82f2-9363247f350d None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:07.395971 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8c078a8f-76b8-4036-82f2-9363247f350d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:07.404330 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 986/1944] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:07.408568 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e73a1-a49a-40b2-b2f9-b968f1fe1d8b None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:07.419047 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e73a1-a49a-40b2-b2f9-b968f1fe1d8b None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:07.424172 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e56cce-3e61-4307-806f-380a44b51787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:07.424775 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e56cce-3e61-4307-806f-380a44b51787 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:07.425055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e56cce-3e61-4307-806f-380a44b51787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:07.425332 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e56cce-3e61-4307-806f-380a44b51787 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:07.426007 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e56cce-3e61-4307-806f-380a44b51787 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:03:07.426309 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e56cce-3e61-4307-806f-380a44b51787 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:07.427922 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e56cce-3e61-4307-806f-380a44b51787 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:07.440427 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 959/1945] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:03:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:03:07.444811 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c078a8f-76b8-4036-82f2-9363247f350d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:07.454114 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c078a8f-76b8-4036-82f2-9363247f350d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:07.458731 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad434896-4308-4735-800f-be7c1244e36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:07.459325 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad434896-4308-4735-800f-be7c1244e36e admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:07.459604 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad434896-4308-4735-800f-be7c1244e36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:07.459876 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad434896-4308-4735-800f-be7c1244e36e admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:07.460502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad434896-4308-4735-800f-be7c1244e36e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:07.462450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad434896-4308-4735-800f-be7c1244e36e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:07.540100 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 987/1946] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:03:07 2022] POST /identity/v3/projects => generated 369 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:07.545549 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e56cce-3e61-4307-806f-380a44b51787 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:07.556582 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e56cce-3e61-4307-806f-380a44b51787 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:07.615899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f77d75-1a79-41b6-b2a2-7054bb52eb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:07.616514 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f77d75-1a79-41b6-b2a2-7054bb52eb85 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:07.616789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f77d75-1a79-41b6-b2a2-7054bb52eb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:07.617060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f77d75-1a79-41b6-b2a2-7054bb52eb85 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:07.617728 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f77d75-1a79-41b6-b2a2-7054bb52eb85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:07.619688 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f77d75-1a79-41b6-b2a2-7054bb52eb85 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:07.710627 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 960/1947] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:03:07 2022] POST /identity/v3/users => generated 285 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:07.715529 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad434896-4308-4735-800f-be7c1244e36e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:07.726125 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad434896-4308-4735-800f-be7c1244e36e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:07.730724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4455480-e1a9-47db-8c71-e008170bb55d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:07.734354 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4455480-e1a9-47db-8c71-e008170bb55d admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:07.734354 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4455480-e1a9-47db-8c71-e008170bb55d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:07.734354 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4455480-e1a9-47db-8c71-e008170bb55d admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:07.734354 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4455480-e1a9-47db-8c71-e008170bb55d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:07.734354 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4455480-e1a9-47db-8c71-e008170bb55d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:07.744965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 988/1948] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:03:07.749022 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f77d75-1a79-41b6-b2a2-7054bb52eb85 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:07.759702 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f77d75-1a79-41b6-b2a2-7054bb52eb85 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:07.766575 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d0a299-dd5b-40a6-babb-3a1189b3599c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:07.767172 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0a299-dd5b-40a6-babb-3a1189b3599c admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:07.767871 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0a299-dd5b-40a6-babb-3a1189b3599c admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:07.767871 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d0a299-dd5b-40a6-babb-3a1189b3599c admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:07.768372 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0a299-dd5b-40a6-babb-3a1189b3599c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:07.770112 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d0a299-dd5b-40a6-babb-3a1189b3599c admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:07.790857 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 961/1949] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:07 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:07.793717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4455480-e1a9-47db-8c71-e008170bb55d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:07.803919 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4455480-e1a9-47db-8c71-e008170bb55d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:07.808840 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f16be7-a085-46ce-9f05-7d4290572466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:07.809603 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f16be7-a085-46ce-9f05-7d4290572466 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:07.809915 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f16be7-a085-46ce-9f05-7d4290572466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:07.810186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f16be7-a085-46ce-9f05-7d4290572466 admin admin] PATH_INFO: `/v3/projects/b49e811e2bdd4acf9f3b765e68967673/users/73c27834d9624cf3b67d09b32f212611/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:07.825419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f16be7-a085-46ce-9f05-7d4290572466 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b49e811e2bdd4acf9f3b765e68967673, user_id=73c27834d9624cf3b67d09b32f212611, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:07.828084 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f16be7-a085-46ce-9f05-7d4290572466 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:07.894543 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 989/1950] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:03:07 2022] PUT /identity/v3/projects/b49e811e2bdd4acf9f3b765e68967673/users/73c27834d9624cf3b67d09b32f212611/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:07.905185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8c4d4-d2b6-4271-8e92-bb62c4f7a770 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:07.905493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8c4d4-d2b6-4271-8e92-bb62c4f7a770 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:07.905810 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8c4d4-d2b6-4271-8e92-bb62c4f7a770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:07.935364 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-a4d8c4d4-d2b6-4271-8e92-bb62c4f7a770 None None] MFA Rules not processed for user `73c27834d9624cf3b67d09b32f212611`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:07.936622 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a4d8c4d4-d2b6-4271-8e92-bb62c4f7a770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:07.992072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:08.017347 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 962/1951] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:03:08.031417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f16be7-a085-46ce-9f05-7d4290572466 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:08.033290 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e3f16be7-a085-46ce-9f05-7d4290572466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:08.073390 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:08.098279 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f16be7-a085-46ce-9f05-7d4290572466 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:08.102994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd64b23-a781-421e-a88d-e245a58bf141 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44093d63c1aa45b781d2ce30239ed598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:08.104065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd64b23-a781-421e-a88d-e245a58bf141 service glance] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:08.104147 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd64b23-a781-421e-a88d-e245a58bf141 service glance] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:08.104400 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd64b23-a781-421e-a88d-e245a58bf141 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:08.114544 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd64b23-a781-421e-a88d-e245a58bf141 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:08.116117 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd64b23-a781-421e-a88d-e245a58bf141 service glance] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:08.126896 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 990/1952] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:08 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:18.127226 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=8 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:18.236216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=11 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:19.396784 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8c4d4-d2b6-4271-8e92-bb62c4f7a770 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:19.398388 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a4d8c4d4-d2b6-4271-8e92-bb62c4f7a770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:19.468908 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8c4d4-d2b6-4271-8e92-bb62c4f7a770 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:19.473935 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84622c32-d672-4b77-b852-57a425bc8d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:19.474445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84622c32-d672-4b77-b852-57a425bc8d0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:19.474767 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84622c32-d672-4b77-b852-57a425bc8d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:19.475111 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84622c32-d672-4b77-b852-57a425bc8d0f admin admin] PATH_INFO: `/v3/users/d7a8381206f54bf395d8bdf2a1e9fc41` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:19.476329 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84622c32-d672-4b77-b852-57a425bc8d0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7a8381206f54bf395d8bdf2a1e9fc41)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:19.481055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84622c32-d672-4b77-b852-57a425bc8d0f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:19.612074 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-84622c32-d672-4b77-b852-57a425bc8d0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7a8381206f54bf395d8bdf2a1e9fc41'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:19.652486 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-84622c32-d672-4b77-b852-57a425bc8d0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7a8381206f54bf395d8bdf2a1e9fc41'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:19.671547 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-84622c32-d672-4b77-b852-57a425bc8d0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7a8381206f54bf395d8bdf2a1e9fc41'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:19.672380 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-84622c32-d672-4b77-b852-57a425bc8d0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7a8381206f54bf395d8bdf2a1e9fc41'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:19.680432 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-84622c32-d672-4b77-b852-57a425bc8d0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7a8381206f54bf395d8bdf2a1e9fc41'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:19.687842 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 963/1953] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:03:19 2022] DELETE /identity/v3/users/d7a8381206f54bf395d8bdf2a1e9fc41 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:19.692777 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a750e5-e485-4b2c-ab36-3b1104f380cc None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:19.693270 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a750e5-e485-4b2c-ab36-3b1104f380cc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:19.693379 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a750e5-e485-4b2c-ab36-3b1104f380cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:19.717539 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e4a750e5-e485-4b2c-ab36-3b1104f380cc None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:19.718865 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e4a750e5-e485-4b2c-ab36-3b1104f380cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:19.810189 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 991/1954] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:19.820292 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84622c32-d672-4b77-b852-57a425bc8d0f admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:19.821742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-84622c32-d672-4b77-b852-57a425bc8d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:19.892290 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84622c32-d672-4b77-b852-57a425bc8d0f admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:19.896259 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2d15c9-9986-494a-ad12-8df963fc523a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:19.896710 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d15c9-9986-494a-ad12-8df963fc523a service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:19.896991 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d15c9-9986-494a-ad12-8df963fc523a service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:19.897261 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2d15c9-9986-494a-ad12-8df963fc523a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:19.907898 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d15c9-9986-494a-ad12-8df963fc523a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:19.909340 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2d15c9-9986-494a-ad12-8df963fc523a service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:19.922732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 964/1955] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:20.339951 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a750e5-e485-4b2c-ab36-3b1104f380cc None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:20.341409 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e4a750e5-e485-4b2c-ab36-3b1104f380cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:20.365093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a750e5-e485-4b2c-ab36-3b1104f380cc None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:20.370566 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11478d89-7d61-46a0-bac3-2a8b568ca974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:20.371171 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11478d89-7d61-46a0-bac3-2a8b568ca974 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:20.371450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11478d89-7d61-46a0-bac3-2a8b568ca974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:20.371774 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11478d89-7d61-46a0-bac3-2a8b568ca974 admin admin] PATH_INFO: `/v3/projects/9f9ae042993144598ab22cb5194a09ff` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:20.372895 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11478d89-7d61-46a0-bac3-2a8b568ca974 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f9ae042993144598ab22cb5194a09ff)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:20.374878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11478d89-7d61-46a0-bac3-2a8b568ca974 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:20.496520 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-11478d89-7d61-46a0-bac3-2a8b568ca974 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f9ae042993144598ab22cb5194a09ff', 'request_id': 'req-11478d89-7d61-46a0-bac3-2a8b568ca974'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:20.549292 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-11478d89-7d61-46a0-bac3-2a8b568ca974 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f9ae042993144598ab22cb5194a09ff', 'request_id': 'req-11478d89-7d61-46a0-bac3-2a8b568ca974'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:20.555623 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-11478d89-7d61-46a0-bac3-2a8b568ca974 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f9ae042993144598ab22cb5194a09ff', 'request_id': 'req-11478d89-7d61-46a0-bac3-2a8b568ca974'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:20.567389 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-11478d89-7d61-46a0-bac3-2a8b568ca974 admin admin] The token cache is being invalidate because project 9f9ae042993144598ab22cb5194a09ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:03:20.567675 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-11478d89-7d61-46a0-bac3-2a8b568ca974 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:20.568353 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-11478d89-7d61-46a0-bac3-2a8b568ca974 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:20.569962 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 992/1956] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:03:20 2022] DELETE /identity/v3/projects/9f9ae042993144598ab22cb5194a09ff => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:20.575592 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631705c7-8d4b-4d32-93fb-e087bcdc29ee None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:20.576141 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631705c7-8d4b-4d32-93fb-e087bcdc29ee None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:20.576141 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631705c7-8d4b-4d32-93fb-e087bcdc29ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:20.596263 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-631705c7-8d4b-4d32-93fb-e087bcdc29ee None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:20.597509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-631705c7-8d4b-4d32-93fb-e087bcdc29ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:20.614377 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:20.659513 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 965/1957] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:03:20.667716 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0f0a1-d1c9-401c-863f-3a1ce0b5f108 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:20.668003 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0f0a1-d1c9-401c-863f-3a1ce0b5f108 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:20.668274 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb0f0a1-d1c9-401c-863f-3a1ce0b5f108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:20.688661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5eb0f0a1-d1c9-401c-863f-3a1ce0b5f108 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:20.689937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5eb0f0a1-d1c9-401c-863f-3a1ce0b5f108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:20.699776 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 993/1958] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:20.704276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631705c7-8d4b-4d32-93fb-e087bcdc29ee None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:20.716487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631705c7-8d4b-4d32-93fb-e087bcdc29ee None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:20.722180 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a97af0-a8ea-4cb9-9f68-3e9619707812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:20.722802 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a97af0-a8ea-4cb9-9f68-3e9619707812 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:20.723083 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a97af0-a8ea-4cb9-9f68-3e9619707812 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:20.723614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a97af0-a8ea-4cb9-9f68-3e9619707812 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:20.724265 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a97af0-a8ea-4cb9-9f68-3e9619707812 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:03:20.724708 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a97af0-a8ea-4cb9-9f68-3e9619707812 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:20.726607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a97af0-a8ea-4cb9-9f68-3e9619707812 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:20.743027 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 966/1959] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:03:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:03:20.744858 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0f0a1-d1c9-401c-863f-3a1ce0b5f108 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:20.755194 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb0f0a1-d1c9-401c-863f-3a1ce0b5f108 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:20.767767 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388952e0-3272-4573-b508-9adb118e8714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:20.767767 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388952e0-3272-4573-b508-9adb118e8714 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:20.767767 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388952e0-3272-4573-b508-9adb118e8714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:20.767767 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388952e0-3272-4573-b508-9adb118e8714 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:20.768142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388952e0-3272-4573-b508-9adb118e8714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:20.768142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388952e0-3272-4573-b508-9adb118e8714 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:20.852177 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 994/1960] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:03:20 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:20.855221 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a97af0-a8ea-4cb9-9f68-3e9619707812 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:20.865678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a97af0-a8ea-4cb9-9f68-3e9619707812 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:20.930341 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95636f37-36ea-4133-be22-eb7b0af3f35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:20.931598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95636f37-36ea-4133-be22-eb7b0af3f35f admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:20.931878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95636f37-36ea-4133-be22-eb7b0af3f35f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:20.932149 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95636f37-36ea-4133-be22-eb7b0af3f35f admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:20.932858 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95636f37-36ea-4133-be22-eb7b0af3f35f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:20.934979 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95636f37-36ea-4133-be22-eb7b0af3f35f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:21.119326 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 967/1961] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:03:20 2022] POST /identity/v3/users => generated 292 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:21.121415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388952e0-3272-4573-b508-9adb118e8714 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:21.131651 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388952e0-3272-4573-b508-9adb118e8714 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:21.136597 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd058b5f-27ff-4e4f-8ec3-162293e7d793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:21.137208 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd058b5f-27ff-4e4f-8ec3-162293e7d793 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:21.137490 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd058b5f-27ff-4e4f-8ec3-162293e7d793 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:21.137817 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd058b5f-27ff-4e4f-8ec3-162293e7d793 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:21.138585 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd058b5f-27ff-4e4f-8ec3-162293e7d793 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:21.140207 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd058b5f-27ff-4e4f-8ec3-162293e7d793 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:21.152250 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 995/1962] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:21.156672 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95636f37-36ea-4133-be22-eb7b0af3f35f admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:21.168569 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95636f37-36ea-4133-be22-eb7b0af3f35f admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:21.173592 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca9132-c579-4e32-bbdc-343e5776d025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:21.176736 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca9132-c579-4e32-bbdc-343e5776d025 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:21.176736 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca9132-c579-4e32-bbdc-343e5776d025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:21.176736 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca9132-c579-4e32-bbdc-343e5776d025 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:21.176736 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca9132-c579-4e32-bbdc-343e5776d025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:21.177156 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eca9132-c579-4e32-bbdc-343e5776d025 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:21.189084 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 968/1963] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:21.193484 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd058b5f-27ff-4e4f-8ec3-162293e7d793 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:21.205521 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd058b5f-27ff-4e4f-8ec3-162293e7d793 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:21.210302 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51f1f9-9bf8-4bc8-97e2-3662664eda0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:21.210957 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51f1f9-9bf8-4bc8-97e2-3662664eda0d admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:21.211238 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51f1f9-9bf8-4bc8-97e2-3662664eda0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:21.211510 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51f1f9-9bf8-4bc8-97e2-3662664eda0d admin admin] PATH_INFO: `/v3/projects/d395559e5cf1480a99c70428f6f94689/users/23226bd83acd46a8812632c0a117f9bc/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:21.232689 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51f1f9-9bf8-4bc8-97e2-3662664eda0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d395559e5cf1480a99c70428f6f94689, user_id=23226bd83acd46a8812632c0a117f9bc, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:21.235477 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51f1f9-9bf8-4bc8-97e2-3662664eda0d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:21.327998 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 996/1964] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:03:21 2022] PUT /identity/v3/projects/d395559e5cf1480a99c70428f6f94689/users/23226bd83acd46a8812632c0a117f9bc/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:21.333278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be40ee-9195-4886-97d2-33438517d174 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:21.337424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be40ee-9195-4886-97d2-33438517d174 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:21.337424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9be40ee-9195-4886-97d2-33438517d174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:21.357566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-f9be40ee-9195-4886-97d2-33438517d174 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:21.358903 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f9be40ee-9195-4886-97d2-33438517d174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:21.432375 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 969/1965] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:21.438770 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51f1f9-9bf8-4bc8-97e2-3662664eda0d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:21.441748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6e51f1f9-9bf8-4bc8-97e2-3662664eda0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:21.464190 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:21.505512 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51f1f9-9bf8-4bc8-97e2-3662664eda0d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:21.510343 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f78eac4-65a8-474b-9ca6-ec70d927af4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:21.510682 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78eac4-65a8-474b-9ca6-ec70d927af4e service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:21.510962 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78eac4-65a8-474b-9ca6-ec70d927af4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:21.511408 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f78eac4-65a8-474b-9ca6-ec70d927af4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:21.521116 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be40ee-9195-4886-97d2-33438517d174 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:21.521469 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78eac4-65a8-474b-9ca6-ec70d927af4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:21.522662 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f9be40ee-9195-4886-97d2-33438517d174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:21.523213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f78eac4-65a8-474b-9ca6-ec70d927af4e service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:21.534600 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 997/1966] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:21.543465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9be40ee-9195-4886-97d2-33438517d174 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:21.552766 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9654a1-d77c-43fe-9fc3-f1800f5acd34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:21.552923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9654a1-d77c-43fe-9fc3-f1800f5acd34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:21.553203 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9654a1-d77c-43fe-9fc3-f1800f5acd34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:21.553474 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9654a1-d77c-43fe-9fc3-f1800f5acd34 admin admin] PATH_INFO: `/v3/users/69cf9201ccbf4835a7aee78176875c7e` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:21.554678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9654a1-d77c-43fe-9fc3-f1800f5acd34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69cf9201ccbf4835a7aee78176875c7e)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:21.556643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9654a1-d77c-43fe-9fc3-f1800f5acd34 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:21.580871 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:21.734489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1e9654a1-d77c-43fe-9fc3-f1800f5acd34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69cf9201ccbf4835a7aee78176875c7e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:21.856668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1e9654a1-d77c-43fe-9fc3-f1800f5acd34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69cf9201ccbf4835a7aee78176875c7e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:21.873218 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1e9654a1-d77c-43fe-9fc3-f1800f5acd34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69cf9201ccbf4835a7aee78176875c7e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:21.886823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1e9654a1-d77c-43fe-9fc3-f1800f5acd34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69cf9201ccbf4835a7aee78176875c7e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:21.932951 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1e9654a1-d77c-43fe-9fc3-f1800f5acd34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69cf9201ccbf4835a7aee78176875c7e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:21.947857 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 970/1967] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:03:21 2022] DELETE /identity/v3/users/69cf9201ccbf4835a7aee78176875c7e => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:03:21.949862 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef988c-6221-4f9b-9de4-4ce048690653 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:21.951396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef988c-6221-4f9b-9de4-4ce048690653 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:21.951730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ef988c-6221-4f9b-9de4-4ce048690653 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:21.981821 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f2ef988c-6221-4f9b-9de4-4ce048690653 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:21.984870 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f2ef988c-6221-4f9b-9de4-4ce048690653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:22.088920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 998/1968] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:22.109650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9654a1-d77c-43fe-9fc3-f1800f5acd34 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:22.109650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1e9654a1-d77c-43fe-9fc3-f1800f5acd34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:22.208575 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9654a1-d77c-43fe-9fc3-f1800f5acd34 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:22.211835 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d630b1a2-db0f-408f-970b-e032830dd250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:22.212517 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630b1a2-db0f-408f-970b-e032830dd250 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:22.212800 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630b1a2-db0f-408f-970b-e032830dd250 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:22.213126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d630b1a2-db0f-408f-970b-e032830dd250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:22.223693 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630b1a2-db0f-408f-970b-e032830dd250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:22.230984 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d630b1a2-db0f-408f-970b-e032830dd250 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:22.235835 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 971/1969] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:22.757548 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef988c-6221-4f9b-9de4-4ce048690653 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:22.761028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f2ef988c-6221-4f9b-9de4-4ce048690653 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:22.797254 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ef988c-6221-4f9b-9de4-4ce048690653 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:22.802163 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e977596c-dd02-413f-8207-eefb115943d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:22.803013 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977596c-dd02-413f-8207-eefb115943d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:22.803120 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977596c-dd02-413f-8207-eefb115943d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:22.803309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e977596c-dd02-413f-8207-eefb115943d0 admin admin] PATH_INFO: `/v3/projects/62d39bbcf123473487ef1a56bfc06da7` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:22.804483 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977596c-dd02-413f-8207-eefb115943d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=62d39bbcf123473487ef1a56bfc06da7)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:22.807355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e977596c-dd02-413f-8207-eefb115943d0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:22.984424 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e977596c-dd02-413f-8207-eefb115943d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62d39bbcf123473487ef1a56bfc06da7', 'request_id': 'req-e977596c-dd02-413f-8207-eefb115943d0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:23.074971 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e977596c-dd02-413f-8207-eefb115943d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62d39bbcf123473487ef1a56bfc06da7', 'request_id': 'req-e977596c-dd02-413f-8207-eefb115943d0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:23.083208 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e977596c-dd02-413f-8207-eefb115943d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62d39bbcf123473487ef1a56bfc06da7', 'request_id': 'req-e977596c-dd02-413f-8207-eefb115943d0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:23.117651 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e977596c-dd02-413f-8207-eefb115943d0 admin admin] The token cache is being invalidate because project 62d39bbcf123473487ef1a56bfc06da7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:03:23.117954 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e977596c-dd02-413f-8207-eefb115943d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:23.118671 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e977596c-dd02-413f-8207-eefb115943d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:23.121198 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 999/1970] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:03:22 2022] DELETE /identity/v3/projects/62d39bbcf123473487ef1a56bfc06da7 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:23.126046 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d3919-3658-467a-acf5-ebf4e0572b04 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:23.126555 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d3919-3658-467a-acf5-ebf4e0572b04 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:23.126666 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821d3919-3658-467a-acf5-ebf4e0572b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:23.151982 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-821d3919-3658-467a-acf5-ebf4e0572b04 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:23.153357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-821d3919-3658-467a-acf5-ebf4e0572b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:23.240682 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 972/1971] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:23.252776 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fdfdb-701d-40b8-8744-cff4698814e3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:23.253021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fdfdb-701d-40b8-8744-cff4698814e3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:23.254612 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169fdfdb-701d-40b8-8744-cff4698814e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:23.280469 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-169fdfdb-701d-40b8-8744-cff4698814e3 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:23.281740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-169fdfdb-701d-40b8-8744-cff4698814e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:23.291074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1000/1972] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:23.295462 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d3919-3658-467a-acf5-ebf4e0572b04 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:23.306469 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821d3919-3658-467a-acf5-ebf4e0572b04 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:23.313536 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bed68-043f-40a8-ace0-0f99bb6dafc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:23.314328 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bed68-043f-40a8-ace0-0f99bb6dafc6 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:23.314674 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bed68-043f-40a8-ace0-0f99bb6dafc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:23.315240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307bed68-043f-40a8-ace0-0f99bb6dafc6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:23.316070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bed68-043f-40a8-ace0-0f99bb6dafc6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:03:23.316432 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bed68-043f-40a8-ace0-0f99bb6dafc6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:23.318767 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307bed68-043f-40a8-ace0-0f99bb6dafc6 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:23.332758 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 973/1973] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:03:23.337836 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169fdfdb-701d-40b8-8744-cff4698814e3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:23.347525 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169fdfdb-701d-40b8-8744-cff4698814e3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:23.353526 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa83b43-e61d-4169-9caf-87952038a8e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:23.354324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa83b43-e61d-4169-9caf-87952038a8e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:23.354675 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa83b43-e61d-4169-9caf-87952038a8e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:23.354950 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa83b43-e61d-4169-9caf-87952038a8e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:23.355866 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa83b43-e61d-4169-9caf-87952038a8e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:23.357914 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa83b43-e61d-4169-9caf-87952038a8e6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:23.493788 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1001/1974] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:03:23 2022] POST /identity/v3/projects => generated 375 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:23.498118 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bed68-043f-40a8-ace0-0f99bb6dafc6 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:23.508447 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307bed68-043f-40a8-ace0-0f99bb6dafc6 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:23.543258 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:23.589887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56551977-98f6-43ae-8dc0-1be61637cfa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:23.590648 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56551977-98f6-43ae-8dc0-1be61637cfa8 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:23.591006 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56551977-98f6-43ae-8dc0-1be61637cfa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:23.591355 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56551977-98f6-43ae-8dc0-1be61637cfa8 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:23.592108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56551977-98f6-43ae-8dc0-1be61637cfa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:23.594519 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56551977-98f6-43ae-8dc0-1be61637cfa8 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:23.693335 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 974/1975] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:03:23 2022] POST /identity/v3/users => generated 288 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:03:23.698149 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa83b43-e61d-4169-9caf-87952038a8e6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:23.709628 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa83b43-e61d-4169-9caf-87952038a8e6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:23.716874 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e704a60-c6ac-4500-9ee1-44f67879ae4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:23.716874 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e704a60-c6ac-4500-9ee1-44f67879ae4e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:23.716874 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e704a60-c6ac-4500-9ee1-44f67879ae4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:23.716874 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e704a60-c6ac-4500-9ee1-44f67879ae4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:23.717506 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e704a60-c6ac-4500-9ee1-44f67879ae4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:23.719167 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e704a60-c6ac-4500-9ee1-44f67879ae4e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:23.730377 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1002/1976] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:23.734025 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56551977-98f6-43ae-8dc0-1be61637cfa8 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:23.746192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56551977-98f6-43ae-8dc0-1be61637cfa8 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:23.751437 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a07d89-83c9-44d4-9edd-861eb180d779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:23.752058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a07d89-83c9-44d4-9edd-861eb180d779 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:23.752340 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a07d89-83c9-44d4-9edd-861eb180d779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:23.752617 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a07d89-83c9-44d4-9edd-861eb180d779 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:23.753270 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a07d89-83c9-44d4-9edd-861eb180d779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:23.754920 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a07d89-83c9-44d4-9edd-861eb180d779 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:23.770774 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 975/1977] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:03:23.771879 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e704a60-c6ac-4500-9ee1-44f67879ae4e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:23.782508 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e704a60-c6ac-4500-9ee1-44f67879ae4e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:23.787340 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c43b4b-d44e-4b96-ab17-c5fe05171587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:23.788007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c43b4b-d44e-4b96-ab17-c5fe05171587 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:23.788289 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c43b4b-d44e-4b96-ab17-c5fe05171587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:23.788565 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c43b4b-d44e-4b96-ab17-c5fe05171587 admin admin] PATH_INFO: `/v3/projects/bba7da8c59f34465b1db46e7c6628664/users/be2c0032f0774d6fae985165cdfa4759/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:23.791111 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:23.806272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c43b4b-d44e-4b96-ab17-c5fe05171587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bba7da8c59f34465b1db46e7c6628664, user_id=be2c0032f0774d6fae985165cdfa4759, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:23.808950 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c43b4b-d44e-4b96-ab17-c5fe05171587 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:23.904301 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1003/1978] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:03:23 2022] PUT /identity/v3/projects/bba7da8c59f34465b1db46e7c6628664/users/be2c0032f0774d6fae985165cdfa4759/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:03:23.921763 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81129d-5606-4b79-9c44-cab3c52daf57 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:23.921763 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81129d-5606-4b79-9c44-cab3c52daf57 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:23.921763 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81129d-5606-4b79-9c44-cab3c52daf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:23.958093 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-1b81129d-5606-4b79-9c44-cab3c52daf57 None None] MFA Rules not processed for user `be2c0032f0774d6fae985165cdfa4759`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:23.959309 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1b81129d-5606-4b79-9c44-cab3c52daf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:24.036284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 976/1979] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:24.041256 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c43b4b-d44e-4b96-ab17-c5fe05171587 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:24.192030 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c43b4b-d44e-4b96-ab17-c5fe05171587 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:24.198632 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9383aa1-67cd-4833-9d7f-2e8f1df4039e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:24.199265 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9383aa1-67cd-4833-9d7f-2e8f1df4039e admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:24.199546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9383aa1-67cd-4833-9d7f-2e8f1df4039e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:24.200007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9383aa1-67cd-4833-9d7f-2e8f1df4039e admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:24.200806 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9383aa1-67cd-4833-9d7f-2e8f1df4039e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:24.203058 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9383aa1-67cd-4833-9d7f-2e8f1df4039e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:24.308513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1004/1980] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:03:24 2022] POST /identity/v3/projects => generated 375 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:24.312961 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81129d-5606-4b79-9c44-cab3c52daf57 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:24.328975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81129d-5606-4b79-9c44-cab3c52daf57 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:24.398644 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246f5a1-e785-44bf-84dc-710400c91c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:24.399895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246f5a1-e785-44bf-84dc-710400c91c04 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:24.400045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246f5a1-e785-44bf-84dc-710400c91c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:24.400542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f246f5a1-e785-44bf-84dc-710400c91c04 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:24.401192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246f5a1-e785-44bf-84dc-710400c91c04 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:24.403470 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f246f5a1-e785-44bf-84dc-710400c91c04 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:24.489731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 977/1981] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:03:24 2022] POST /identity/v3/users => generated 294 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:03:24.493734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9383aa1-67cd-4833-9d7f-2e8f1df4039e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:24.510677 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9383aa1-67cd-4833-9d7f-2e8f1df4039e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:24.513063 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6809b5-ee41-480b-bf56-87fc73e6f19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:24.513942 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6809b5-ee41-480b-bf56-87fc73e6f19a admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:24.514442 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6809b5-ee41-480b-bf56-87fc73e6f19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:24.514922 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6809b5-ee41-480b-bf56-87fc73e6f19a admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:24.515736 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6809b5-ee41-480b-bf56-87fc73e6f19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:24.518015 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6809b5-ee41-480b-bf56-87fc73e6f19a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:24.530507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1005/1982] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:24.535773 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246f5a1-e785-44bf-84dc-710400c91c04 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:24.562415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f246f5a1-e785-44bf-84dc-710400c91c04 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:24.566165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d463b4-8304-4d39-8b75-cf3ff5e49868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:24.567009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d463b4-8304-4d39-8b75-cf3ff5e49868 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:24.567443 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d463b4-8304-4d39-8b75-cf3ff5e49868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:24.567887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d463b4-8304-4d39-8b75-cf3ff5e49868 admin admin] PATH_INFO: `/v3/projects/b5beecf969bb4fc3b57ba6dd44557226/users/afd7a6070bfa43d0bdbd00cbd3595abb/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:24.585238 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d463b4-8304-4d39-8b75-cf3ff5e49868 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5beecf969bb4fc3b57ba6dd44557226, user_id=afd7a6070bfa43d0bdbd00cbd3595abb, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:24.588903 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d463b4-8304-4d39-8b75-cf3ff5e49868 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:24.672647 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 978/1983] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:03:24 2022] PUT /identity/v3/projects/b5beecf969bb4fc3b57ba6dd44557226/users/afd7a6070bfa43d0bdbd00cbd3595abb/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:24.676851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6809b5-ee41-480b-bf56-87fc73e6f19a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:24.687916 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6809b5-ee41-480b-bf56-87fc73e6f19a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:24.762263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfad0a17-b5e4-4ddc-a3e1-a109f77852d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:24.763213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad0a17-b5e4-4ddc-a3e1-a109f77852d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:24.763505 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad0a17-b5e4-4ddc-a3e1-a109f77852d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:24.763782 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfad0a17-b5e4-4ddc-a3e1-a109f77852d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:24.764476 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad0a17-b5e4-4ddc-a3e1-a109f77852d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:24.766296 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfad0a17-b5e4-4ddc-a3e1-a109f77852d3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:24.781442 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1006/1984] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:24 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:03:24.785959 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d463b4-8304-4d39-8b75-cf3ff5e49868 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:24.794808 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:24.801004 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d463b4-8304-4d39-8b75-cf3ff5e49868 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:24.808545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a9208-ab43-4020-8205-f59424c91bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:24.809944 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a9208-ab43-4020-8205-f59424c91bdb admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:24.810263 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a9208-ab43-4020-8205-f59424c91bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:24.810543 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6a9208-ab43-4020-8205-f59424c91bdb admin admin] PATH_INFO: `/v3/projects/b5beecf969bb4fc3b57ba6dd44557226/users/afd7a6070bfa43d0bdbd00cbd3595abb/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:24.815139 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a9208-ab43-4020-8205-f59424c91bdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5beecf969bb4fc3b57ba6dd44557226, user_id=afd7a6070bfa43d0bdbd00cbd3595abb, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:24.819397 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6a9208-ab43-4020-8205-f59424c91bdb admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:24.837490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 979/1985] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:03:24 2022] PUT /identity/v3/projects/b5beecf969bb4fc3b57ba6dd44557226/users/afd7a6070bfa43d0bdbd00cbd3595abb/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:24.848320 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd94c47-9cfe-4b9f-89f8-65f418f31027 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:24.848983 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd94c47-9cfe-4b9f-89f8-65f418f31027 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:24.849468 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd94c47-9cfe-4b9f-89f8-65f418f31027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:24.884110 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-bdd94c47-9cfe-4b9f-89f8-65f418f31027 None None] MFA Rules not processed for user `afd7a6070bfa43d0bdbd00cbd3595abb`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:24.885360 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bdd94c47-9cfe-4b9f-89f8-65f418f31027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:24.944175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:24.976295 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1007/1986] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:24.987373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a9208-ab43-4020-8205-f59424c91bdb admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:24.989219 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9f6a9208-ab43-4020-8205-f59424c91bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:25.059560 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6a9208-ab43-4020-8205-f59424c91bdb admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:25.063374 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9c90e-91a9-4031-85a5-75d676970639 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:25.064250 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9c90e-91a9-4031-85a5-75d676970639 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:25.064537 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9c90e-91a9-4031-85a5-75d676970639 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:25.064812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c9c90e-91a9-4031-85a5-75d676970639 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:25.135461 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9c90e-91a9-4031-85a5-75d676970639 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:25.137306 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c9c90e-91a9-4031-85a5-75d676970639 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:25.151936 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 980/1987] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:27.721215 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4eca1-84a6-45c9-b006-7da4c67f0750 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:27.721215 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4eca1-84a6-45c9-b006-7da4c67f0750 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:27.721215 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed4eca1-84a6-45c9-b006-7da4c67f0750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:27.770933 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8ed4eca1-84a6-45c9-b006-7da4c67f0750 None None] MFA Rules not processed for user `23226bd83acd46a8812632c0a117f9bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:27.778457 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8ed4eca1-84a6-45c9-b006-7da4c67f0750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:27.858256 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1008/1988] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:27.862878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9c90e-91a9-4031-85a5-75d676970639 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:27.865048 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-46c9c90e-91a9-4031-85a5-75d676970639 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:27.983147 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c9c90e-91a9-4031-85a5-75d676970639 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:27.989294 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c329b-96a6-4cb0-a078-dbae2de737ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:27.990379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c329b-96a6-4cb0-a078-dbae2de737ad admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:27.998173 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c329b-96a6-4cb0-a078-dbae2de737ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:27.998173 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c329b-96a6-4cb0-a078-dbae2de737ad admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:27.998173 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c329b-96a6-4cb0-a078-dbae2de737ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:27.998173 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c329b-96a6-4cb0-a078-dbae2de737ad admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:28.094178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 981/1989] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:03:27 2022] POST /identity/v3/projects => generated 383 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:03:28.098644 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4eca1-84a6-45c9-b006-7da4c67f0750 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:28.111250 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed4eca1-84a6-45c9-b006-7da4c67f0750 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:28.183752 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ac87e-8f3f-4772-bc92-f5c8402d69f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:28.184377 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ac87e-8f3f-4772-bc92-f5c8402d69f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:28.184659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ac87e-8f3f-4772-bc92-f5c8402d69f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:28.184931 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ac87e-8f3f-4772-bc92-f5c8402d69f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:28.185571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ac87e-8f3f-4772-bc92-f5c8402d69f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:28.187583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240ac87e-8f3f-4772-bc92-f5c8402d69f0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:28.282233 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1009/1990] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:03:28 2022] POST /identity/v3/users => generated 298 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:28.286038 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c329b-96a6-4cb0-a078-dbae2de737ad admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:28.299454 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c329b-96a6-4cb0-a078-dbae2de737ad admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:28.305578 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9fb6e-5967-4b7d-9d61-0fe72b1674c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:28.305993 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9fb6e-5967-4b7d-9d61-0fe72b1674c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:28.306642 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9fb6e-5967-4b7d-9d61-0fe72b1674c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:28.311881 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce9fb6e-5967-4b7d-9d61-0fe72b1674c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:28.311881 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9fb6e-5967-4b7d-9d61-0fe72b1674c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:28.311881 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce9fb6e-5967-4b7d-9d61-0fe72b1674c7 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:28.325057 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 982/1991] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:28.328586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ac87e-8f3f-4772-bc92-f5c8402d69f0 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:28.343273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ac87e-8f3f-4772-bc92-f5c8402d69f0 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:28.351345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca359a-9603-400c-a4fb-23c1ca36d887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:28.353402 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca359a-9603-400c-a4fb-23c1ca36d887 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:28.353704 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca359a-9603-400c-a4fb-23c1ca36d887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:28.354018 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ca359a-9603-400c-a4fb-23c1ca36d887 admin admin] PATH_INFO: `/v3/projects/c5ccd92e67d84c4fa94686fc1fcb80b3/users/a2241fcd4464459b81ca304b29cb5196/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:28.374552 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca359a-9603-400c-a4fb-23c1ca36d887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ccd92e67d84c4fa94686fc1fcb80b3, user_id=a2241fcd4464459b81ca304b29cb5196, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:28.378810 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ca359a-9603-400c-a4fb-23c1ca36d887 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:28.461223 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1010/1992] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:03:28 2022] PUT /identity/v3/projects/c5ccd92e67d84c4fa94686fc1fcb80b3/users/a2241fcd4464459b81ca304b29cb5196/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:28.469156 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9fb6e-5967-4b7d-9d61-0fe72b1674c7 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:28.486998 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce9fb6e-5967-4b7d-9d61-0fe72b1674c7 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:28.524672 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:28.576586 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4b4dd-3c02-451f-ab77-012532d2a93e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:28.577256 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4b4dd-3c02-451f-ab77-012532d2a93e admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:28.577543 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4b4dd-3c02-451f-ab77-012532d2a93e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:28.577895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa4b4dd-3c02-451f-ab77-012532d2a93e admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:28.578555 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4b4dd-3c02-451f-ab77-012532d2a93e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:28.580177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa4b4dd-3c02-451f-ab77-012532d2a93e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:28.608672 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 983/1993] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:28 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:28.610237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca359a-9603-400c-a4fb-23c1ca36d887 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:28.615315 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4b4dd-3c02-451f-ab77-012532d2a93e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:28.624554 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ca359a-9603-400c-a4fb-23c1ca36d887 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:28.634500 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db13da6-75ab-4365-a5a0-f2d3c4738d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:28.635342 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db13da6-75ab-4365-a5a0-f2d3c4738d13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:28.635814 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db13da6-75ab-4365-a5a0-f2d3c4738d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:28.636216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db13da6-75ab-4365-a5a0-f2d3c4738d13 admin admin] PATH_INFO: `/v3/projects/c5ccd92e67d84c4fa94686fc1fcb80b3/users/a2241fcd4464459b81ca304b29cb5196/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:28.644980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa4b4dd-3c02-451f-ab77-012532d2a93e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:28.645265 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db13da6-75ab-4365-a5a0-f2d3c4738d13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5ccd92e67d84c4fa94686fc1fcb80b3, user_id=a2241fcd4464459b81ca304b29cb5196, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:28.645265 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db13da6-75ab-4365-a5a0-f2d3c4738d13 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:28.649802 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8587855-a229-42b5-a310-2aa4f7c6fdee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:28.651331 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8587855-a229-42b5-a310-2aa4f7c6fdee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:28.651668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8587855-a229-42b5-a310-2aa4f7c6fdee admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:28.651972 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8587855-a229-42b5-a310-2aa4f7c6fdee admin admin] PATH_INFO: `/v3/users/be2c0032f0774d6fae985165cdfa4759` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:28.653902 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8587855-a229-42b5-a310-2aa4f7c6fdee admin admin] RBAC: Authorizing `identity:delete_user(user_id=be2c0032f0774d6fae985165cdfa4759)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:28.658855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1011/1994] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:03:28 2022] PUT /identity/v3/projects/c5ccd92e67d84c4fa94686fc1fcb80b3/users/a2241fcd4464459b81ca304b29cb5196/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:03:28.659025 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8587855-a229-42b5-a310-2aa4f7c6fdee admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:28.843277 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f8587855-a229-42b5-a310-2aa4f7c6fdee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be2c0032f0774d6fae985165cdfa4759'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:28.926124 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f8587855-a229-42b5-a310-2aa4f7c6fdee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be2c0032f0774d6fae985165cdfa4759'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:28.953469 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f8587855-a229-42b5-a310-2aa4f7c6fdee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be2c0032f0774d6fae985165cdfa4759'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:28.955838 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f8587855-a229-42b5-a310-2aa4f7c6fdee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be2c0032f0774d6fae985165cdfa4759'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:28.970146 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f8587855-a229-42b5-a310-2aa4f7c6fdee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be2c0032f0774d6fae985165cdfa4759'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:28.982651 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 984/1995] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:03:28 2022] DELETE /identity/v3/users/be2c0032f0774d6fae985165cdfa4759 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:28.987801 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca156a1-a4db-40c4-932c-ab80b782deb4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:28.987801 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca156a1-a4db-40c4-932c-ab80b782deb4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:28.988321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca156a1-a4db-40c4-932c-ab80b782deb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:29.026810 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3ca156a1-a4db-40c4-932c-ab80b782deb4 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:29.035054 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3ca156a1-a4db-40c4-932c-ab80b782deb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:29.048826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:29.119556 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1012/1996] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:03:29.129167 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8587855-a229-42b5-a310-2aa4f7c6fdee admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:29.130808 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f8587855-a229-42b5-a310-2aa4f7c6fdee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:29.265711 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8587855-a229-42b5-a310-2aa4f7c6fdee admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:29.270780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5fd48-a790-4d92-9fac-9dae4d7c89af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:29.272096 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5fd48-a790-4d92-9fac-9dae4d7c89af service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:29.272390 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5fd48-a790-4d92-9fac-9dae4d7c89af service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:29.272692 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e5fd48-a790-4d92-9fac-9dae4d7c89af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:29.297994 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5fd48-a790-4d92-9fac-9dae4d7c89af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:29.299931 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e5fd48-a790-4d92-9fac-9dae4d7c89af service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:29.312481 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 985/1997] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:29.887794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca156a1-a4db-40c4-932c-ab80b782deb4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:29.892825 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3ca156a1-a4db-40c4-932c-ab80b782deb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:29.923427 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca156a1-a4db-40c4-932c-ab80b782deb4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:29.923788 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee98082-ad3d-491a-9291-854791f634cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:29.924441 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee98082-ad3d-491a-9291-854791f634cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:29.924904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee98082-ad3d-491a-9291-854791f634cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:29.925142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee98082-ad3d-491a-9291-854791f634cc admin admin] PATH_INFO: `/v3/projects/bba7da8c59f34465b1db46e7c6628664` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:29.929536 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee98082-ad3d-491a-9291-854791f634cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bba7da8c59f34465b1db46e7c6628664)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:29.932129 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee98082-ad3d-491a-9291-854791f634cc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:30.114791 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4ee98082-ad3d-491a-9291-854791f634cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bba7da8c59f34465b1db46e7c6628664', 'request_id': 'req-4ee98082-ad3d-491a-9291-854791f634cc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:30.183425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4ee98082-ad3d-491a-9291-854791f634cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bba7da8c59f34465b1db46e7c6628664', 'request_id': 'req-4ee98082-ad3d-491a-9291-854791f634cc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:30.195290 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4ee98082-ad3d-491a-9291-854791f634cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bba7da8c59f34465b1db46e7c6628664', 'request_id': 'req-4ee98082-ad3d-491a-9291-854791f634cc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:30.212146 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4ee98082-ad3d-491a-9291-854791f634cc admin admin] The token cache is being invalidate because project bba7da8c59f34465b1db46e7c6628664 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:03:30.212683 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4ee98082-ad3d-491a-9291-854791f634cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:30.213725 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4ee98082-ad3d-491a-9291-854791f634cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:30.217500 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1013/1998] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:03:29 2022] DELETE /identity/v3/projects/bba7da8c59f34465b1db46e7c6628664 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:30.220897 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5fd48-a790-4d92-9fac-9dae4d7c89af service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:30.236878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e5fd48-a790-4d92-9fac-9dae4d7c89af service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:30.281518 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:30.317399 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9c92d-9e7e-4c23-b8a9-504c68613a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:30.318213 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9c92d-9e7e-4c23-b8a9-504c68613a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:30.318672 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9c92d-9e7e-4c23-b8a9-504c68613a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:30.319053 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9c92d-9e7e-4c23-b8a9-504c68613a8a admin admin] PATH_INFO: `/v3/users/afd7a6070bfa43d0bdbd00cbd3595abb` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:30.321085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9c92d-9e7e-4c23-b8a9-504c68613a8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=afd7a6070bfa43d0bdbd00cbd3595abb)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:30.323441 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e9c92d-9e7e-4c23-b8a9-504c68613a8a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:30.523485 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a2e9c92d-9e7e-4c23-b8a9-504c68613a8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afd7a6070bfa43d0bdbd00cbd3595abb'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:30.603244 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a2e9c92d-9e7e-4c23-b8a9-504c68613a8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afd7a6070bfa43d0bdbd00cbd3595abb'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:30.623854 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a2e9c92d-9e7e-4c23-b8a9-504c68613a8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afd7a6070bfa43d0bdbd00cbd3595abb'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:30.624888 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a2e9c92d-9e7e-4c23-b8a9-504c68613a8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afd7a6070bfa43d0bdbd00cbd3595abb'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:30.636690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-a2e9c92d-9e7e-4c23-b8a9-504c68613a8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afd7a6070bfa43d0bdbd00cbd3595abb'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:30.649409 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 986/1999] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:03:30 2022] DELETE /identity/v3/users/afd7a6070bfa43d0bdbd00cbd3595abb => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:31.225992 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee98082-ad3d-491a-9291-854791f634cc admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:31.228731 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4ee98082-ad3d-491a-9291-854791f634cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:31.264941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee98082-ad3d-491a-9291-854791f634cc admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:31.392021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347a528-c835-49ce-b87e-57e620e4d98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:31.392692 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347a528-c835-49ce-b87e-57e620e4d98f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:31.393014 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347a528-c835-49ce-b87e-57e620e4d98f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:31.393320 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b347a528-c835-49ce-b87e-57e620e4d98f admin admin] PATH_INFO: `/v3/projects/b5beecf969bb4fc3b57ba6dd44557226` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:31.394491 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347a528-c835-49ce-b87e-57e620e4d98f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5beecf969bb4fc3b57ba6dd44557226)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:31.396700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b347a528-c835-49ce-b87e-57e620e4d98f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:31.513832 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:31.528743 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b347a528-c835-49ce-b87e-57e620e4d98f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5beecf969bb4fc3b57ba6dd44557226', 'request_id': 'req-b347a528-c835-49ce-b87e-57e620e4d98f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:31.636580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b347a528-c835-49ce-b87e-57e620e4d98f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5beecf969bb4fc3b57ba6dd44557226', 'request_id': 'req-b347a528-c835-49ce-b87e-57e620e4d98f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:31.646531 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b347a528-c835-49ce-b87e-57e620e4d98f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5beecf969bb4fc3b57ba6dd44557226', 'request_id': 'req-b347a528-c835-49ce-b87e-57e620e4d98f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:31.662657 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b347a528-c835-49ce-b87e-57e620e4d98f admin admin] The token cache is being invalidate because project b5beecf969bb4fc3b57ba6dd44557226 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:03:31.662951 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b347a528-c835-49ce-b87e-57e620e4d98f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:31.665744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b347a528-c835-49ce-b87e-57e620e4d98f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:31.670880 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1014/2000] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:03:31 2022] DELETE /identity/v3/projects/b5beecf969bb4fc3b57ba6dd44557226 => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:31.675369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44e0bf-8b56-4f01-9b2c-3b3bf44cdd09 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:31.675889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44e0bf-8b56-4f01-9b2c-3b3bf44cdd09 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:31.676306 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b44e0bf-8b56-4f01-9b2c-3b3bf44cdd09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:31.717966 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347a528-c835-49ce-b87e-57e620e4d98f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:31.720909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b347a528-c835-49ce-b87e-57e620e4d98f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:31.745494 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-0b44e0bf-8b56-4f01-9b2c-3b3bf44cdd09 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:31.755188 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0b44e0bf-8b56-4f01-9b2c-3b3bf44cdd09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:31.864181 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b347a528-c835-49ce-b87e-57e620e4d98f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:31.879122 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee7b7a-cf51-40d9-85b6-0af8c810b6a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:31.880745 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee7b7a-cf51-40d9-85b6-0af8c810b6a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:31.881718 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee7b7a-cf51-40d9-85b6-0af8c810b6a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:31.884256 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ee7b7a-cf51-40d9-85b6-0af8c810b6a9 admin admin] PATH_INFO: `/v3/users/148bba2e6a824ae7b3528b6db9ea141c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:31.887184 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee7b7a-cf51-40d9-85b6-0af8c810b6a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=148bba2e6a824ae7b3528b6db9ea141c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:31.891743 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ee7b7a-cf51-40d9-85b6-0af8c810b6a9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:31.952670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 987/2001] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:31.963753 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ac5f2-0dc4-4225-b725-529a394ad843 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:31.964040 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ac5f2-0dc4-4225-b725-529a394ad843 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:31.964316 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347ac5f2-0dc4-4225-b725-529a394ad843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:31.991226 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-347ac5f2-0dc4-4225-b725-529a394ad843 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:31.996685 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-347ac5f2-0dc4-4225-b725-529a394ad843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:32.016306 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 988/2002] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:32.029106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ac5f2-0dc4-4225-b725-529a394ad843 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:32.034800 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347ac5f2-0dc4-4225-b725-529a394ad843 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:32.043715 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f8ceb-1c6b-4aa7-a44b-c440ddfb6169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:32.044407 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f8ceb-1c6b-4aa7-a44b-c440ddfb6169 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:32.044693 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f8ceb-1c6b-4aa7-a44b-c440ddfb6169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:32.044964 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12f8ceb-1c6b-4aa7-a44b-c440ddfb6169 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:32.045624 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f8ceb-1c6b-4aa7-a44b-c440ddfb6169 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:03:32.046001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f8ceb-1c6b-4aa7-a44b-c440ddfb6169 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:32.047637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12f8ceb-1c6b-4aa7-a44b-c440ddfb6169 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:32.062169 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 989/2003] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:03:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:03:32.067174 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f8ceb-1c6b-4aa7-a44b-c440ddfb6169 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:32.081898 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12f8ceb-1c6b-4aa7-a44b-c440ddfb6169 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:32.088079 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26671abb-2ca2-4460-a7df-11d729eac59d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:32.088079 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26671abb-2ca2-4460-a7df-11d729eac59d admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:32.088287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26671abb-2ca2-4460-a7df-11d729eac59d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:32.088557 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26671abb-2ca2-4460-a7df-11d729eac59d admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:32.089319 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26671abb-2ca2-4460-a7df-11d729eac59d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:32.091333 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26671abb-2ca2-4460-a7df-11d729eac59d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:32.132463 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-82ee7b7a-cf51-40d9-85b6-0af8c810b6a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '148bba2e6a824ae7b3528b6db9ea141c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:32.204017 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 990/2004] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:03:32 2022] POST /identity/v3/projects => generated 383 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:32.208106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26671abb-2ca2-4460-a7df-11d729eac59d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:32.218267 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-82ee7b7a-cf51-40d9-85b6-0af8c810b6a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '148bba2e6a824ae7b3528b6db9ea141c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:32.219701 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:32.249020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-82ee7b7a-cf51-40d9-85b6-0af8c810b6a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '148bba2e6a824ae7b3528b6db9ea141c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:32.250709 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-82ee7b7a-cf51-40d9-85b6-0af8c810b6a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '148bba2e6a824ae7b3528b6db9ea141c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:32.265986 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-82ee7b7a-cf51-40d9-85b6-0af8c810b6a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '148bba2e6a824ae7b3528b6db9ea141c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:32.277863 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1015/2005] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:03:31 2022] DELETE /identity/v3/users/148bba2e6a824ae7b3528b6db9ea141c => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:32.311716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26671abb-2ca2-4460-a7df-11d729eac59d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:32.394067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f362d8-ba93-44c3-ae2e-1ca7eb2887ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:32.394689 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f362d8-ba93-44c3-ae2e-1ca7eb2887ec admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:32.398129 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f362d8-ba93-44c3-ae2e-1ca7eb2887ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:32.398440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f362d8-ba93-44c3-ae2e-1ca7eb2887ec admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:32.399730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f362d8-ba93-44c3-ae2e-1ca7eb2887ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:32.402231 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f362d8-ba93-44c3-ae2e-1ca7eb2887ec admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:32.535567 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 991/2006] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:03:32 2022] POST /identity/v3/users => generated 292 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:03:32.538030 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee7b7a-cf51-40d9-85b6-0af8c810b6a9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:32.540067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-82ee7b7a-cf51-40d9-85b6-0af8c810b6a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:32.556996 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ee7b7a-cf51-40d9-85b6-0af8c810b6a9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:32.563440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e827ceb6-55d7-4360-a621-7a2caa8f1018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:32.564111 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827ceb6-55d7-4360-a621-7a2caa8f1018 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:32.564386 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827ceb6-55d7-4360-a621-7a2caa8f1018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:32.564655 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e827ceb6-55d7-4360-a621-7a2caa8f1018 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:32.565301 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e827ceb6-55d7-4360-a621-7a2caa8f1018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:32.567066 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e827ceb6-55d7-4360-a621-7a2caa8f1018 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:32.581025 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1016/2007] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:32.585991 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f362d8-ba93-44c3-ae2e-1ca7eb2887ec admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:32.613214 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f362d8-ba93-44c3-ae2e-1ca7eb2887ec admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:32.619298 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4a9f9-ef5b-4b08-bdd7-40f8788b67f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:32.620006 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4a9f9-ef5b-4b08-bdd7-40f8788b67f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:32.620282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4a9f9-ef5b-4b08-bdd7-40f8788b67f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:32.620552 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4a9f9-ef5b-4b08-bdd7-40f8788b67f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:32.621204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4a9f9-ef5b-4b08-bdd7-40f8788b67f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:32.622874 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4a9f9-ef5b-4b08-bdd7-40f8788b67f5 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:32.634663 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 992/2008] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:32 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:32.638668 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e827ceb6-55d7-4360-a621-7a2caa8f1018 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:32.650246 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e827ceb6-55d7-4360-a621-7a2caa8f1018 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:32.655269 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa09964-62fe-4800-8f4b-a672a5557daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:32.656450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa09964-62fe-4800-8f4b-a672a5557daf admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:32.656733 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa09964-62fe-4800-8f4b-a672a5557daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:32.656999 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa09964-62fe-4800-8f4b-a672a5557daf admin admin] PATH_INFO: `/v3/projects/ebb1926d35be43bf87052e0e8f1f2fba/users/8eb55a161f774f82825904a413b81472/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:32.677936 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa09964-62fe-4800-8f4b-a672a5557daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ebb1926d35be43bf87052e0e8f1f2fba, user_id=8eb55a161f774f82825904a413b81472, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:32.681034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa09964-62fe-4800-8f4b-a672a5557daf admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:32.693491 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4a9f9-ef5b-4b08-bdd7-40f8788b67f5 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:32.695651 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d9a4a9f9-ef5b-4b08-bdd7-40f8788b67f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:32.709276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4a9f9-ef5b-4b08-bdd7-40f8788b67f5 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:32.714963 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f011a186-fb20-4fb5-8231-84d8c545e3d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:32.715616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011a186-fb20-4fb5-8231-84d8c545e3d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:32.716236 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011a186-fb20-4fb5-8231-84d8c545e3d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:32.716651 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f011a186-fb20-4fb5-8231-84d8c545e3d5 admin admin] PATH_INFO: `/v3/projects/2758e645d42148f5a43581d3cd435c50` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:32.718356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011a186-fb20-4fb5-8231-84d8c545e3d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2758e645d42148f5a43581d3cd435c50)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:32.720681 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f011a186-fb20-4fb5-8231-84d8c545e3d5 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:32.805846 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1017/2009] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:03:32 2022] PUT /identity/v3/projects/ebb1926d35be43bf87052e0e8f1f2fba/users/8eb55a161f774f82825904a413b81472/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:03:32.812727 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef226879-5b6d-49d5-9f33-60730a07e458 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:32.813221 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef226879-5b6d-49d5-9f33-60730a07e458 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:32.813509 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef226879-5b6d-49d5-9f33-60730a07e458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:32.846223 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ef226879-5b6d-49d5-9f33-60730a07e458 None None] MFA Rules not processed for user `8eb55a161f774f82825904a413b81472`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:32.848487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ef226879-5b6d-49d5-9f33-60730a07e458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:32.853503 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f011a186-fb20-4fb5-8231-84d8c545e3d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2758e645d42148f5a43581d3cd435c50', 'request_id': 'req-f011a186-fb20-4fb5-8231-84d8c545e3d5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:32.857229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:32.866708 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f011a186-fb20-4fb5-8231-84d8c545e3d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2758e645d42148f5a43581d3cd435c50', 'request_id': 'req-f011a186-fb20-4fb5-8231-84d8c545e3d5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:32.893753 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f011a186-fb20-4fb5-8231-84d8c545e3d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2758e645d42148f5a43581d3cd435c50', 'request_id': 'req-f011a186-fb20-4fb5-8231-84d8c545e3d5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:32.943401 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1018/2010] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:03:32.948371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef226879-5b6d-49d5-9f33-60730a07e458 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:32.989087 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f011a186-fb20-4fb5-8231-84d8c545e3d5 admin admin] The token cache is being invalidate because project 2758e645d42148f5a43581d3cd435c50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:03:32.989859 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f011a186-fb20-4fb5-8231-84d8c545e3d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:32.990721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f011a186-fb20-4fb5-8231-84d8c545e3d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:32.993723 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 993/2011] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:03:32 2022] DELETE /identity/v3/projects/2758e645d42148f5a43581d3cd435c50 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:03:32.998740 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718c377-ab1a-4680-9242-cdbfed297695 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:32.999269 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718c377-ab1a-4680-9242-cdbfed297695 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:33.000317 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a718c377-ab1a-4680-9242-cdbfed297695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:33.046168 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-a718c377-ab1a-4680-9242-cdbfed297695 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:33.048448 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a718c377-ab1a-4680-9242-cdbfed297695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:33.059041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef226879-5b6d-49d5-9f33-60730a07e458 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:33.059352 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 994/2012] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:33.064230 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051f4ee-0d41-4bfe-aa44-e12f28309ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:33.064993 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051f4ee-0d41-4bfe-aa44-e12f28309ead admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:33.065387 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051f4ee-0d41-4bfe-aa44-e12f28309ead admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:33.065922 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f051f4ee-0d41-4bfe-aa44-e12f28309ead admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:33.066743 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051f4ee-0d41-4bfe-aa44-e12f28309ead admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:33.069019 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9de6c-3881-4468-a6bf-6fb6c3dd28c9 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:33.069019 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9de6c-3881-4468-a6bf-6fb6c3dd28c9 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:33.069198 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f051f4ee-0d41-4bfe-aa44-e12f28309ead admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:33.069309 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b9de6c-3881-4468-a6bf-6fb6c3dd28c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:33.108104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-68b9de6c-3881-4468-a6bf-6fb6c3dd28c9 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:33.109369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-68b9de6c-3881-4468-a6bf-6fb6c3dd28c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:33.119511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 995/2013] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:33.123810 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9de6c-3881-4468-a6bf-6fb6c3dd28c9 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:33.130618 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:33.135371 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b9de6c-3881-4468-a6bf-6fb6c3dd28c9 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:33.140612 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5c1f5-1619-4750-8475-6c9947b00ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:33.141264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5c1f5-1619-4750-8475-6c9947b00ab3 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:33.141537 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5c1f5-1619-4750-8475-6c9947b00ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:33.141845 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef5c1f5-1619-4750-8475-6c9947b00ab3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:33.142500 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5c1f5-1619-4750-8475-6c9947b00ab3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:03:33.142826 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5c1f5-1619-4750-8475-6c9947b00ab3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:33.144494 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef5c1f5-1619-4750-8475-6c9947b00ab3 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:33.164012 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 996/2014] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:03:33.166733 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5c1f5-1619-4750-8475-6c9947b00ab3 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:33.181976 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef5c1f5-1619-4750-8475-6c9947b00ab3 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:33.190156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1019/2015] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:03:32 2022] POST /identity/v3/projects => generated 385 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:33.190349 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabf9d2-d8f6-4c5f-9997-dce3423d963a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:33.190605 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabf9d2-d8f6-4c5f-9997-dce3423d963a admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:33.191268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051f4ee-0d41-4bfe-aa44-e12f28309ead admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:33.191439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabf9d2-d8f6-4c5f-9997-dce3423d963a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:33.191877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdabf9d2-d8f6-4c5f-9997-dce3423d963a admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:33.192839 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdabf9d2-d8f6-4c5f-9997-dce3423d963a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:33.192991 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f051f4ee-0d41-4bfe-aa44-e12f28309ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:33.196821 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdabf9d2-d8f6-4c5f-9997-dce3423d963a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:33.313715 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f051f4ee-0d41-4bfe-aa44-e12f28309ead admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:33.321705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b07ef3-af27-481d-af19-bd544c322ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:33.322325 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b07ef3-af27-481d-af19-bd544c322ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:33.322608 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b07ef3-af27-481d-af19-bd544c322ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:33.322932 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b07ef3-af27-481d-af19-bd544c322ce8 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:33.323592 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b07ef3-af27-481d-af19-bd544c322ce8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:33.325598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b07ef3-af27-481d-af19-bd544c322ce8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:33.381554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 997/2016] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:03:33 2022] POST /identity/v3/projects => generated 383 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:33.381910 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabf9d2-d8f6-4c5f-9997-dce3423d963a admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:33.438272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1020/2017] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:03:33 2022] POST /identity/v3/users => generated 293 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:33.439412 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b07ef3-af27-481d-af19-bd544c322ce8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:33.450984 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdabf9d2-d8f6-4c5f-9997-dce3423d963a admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:33.451622 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b07ef3-af27-481d-af19-bd544c322ce8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:33.457548 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe4034-37bd-45af-b480-8796bbb8d480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:33.458376 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe4034-37bd-45af-b480-8796bbb8d480 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:33.458641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed3e09-4a6c-413f-8d70-bccea5d18e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:33.458860 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe4034-37bd-45af-b480-8796bbb8d480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:33.459239 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fe4034-37bd-45af-b480-8796bbb8d480 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:33.459792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed3e09-4a6c-413f-8d70-bccea5d18e7d admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:33.460093 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe4034-37bd-45af-b480-8796bbb8d480 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:33.460386 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed3e09-4a6c-413f-8d70-bccea5d18e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:33.460813 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ed3e09-4a6c-413f-8d70-bccea5d18e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:33.461939 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed3e09-4a6c-413f-8d70-bccea5d18e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:33.462977 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fe4034-37bd-45af-b480-8796bbb8d480 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:33.464319 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ed3e09-4a6c-413f-8d70-bccea5d18e7d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:33.478261 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1021/2018] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:33.483392 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed3e09-4a6c-413f-8d70-bccea5d18e7d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:33.510107 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ed3e09-4a6c-413f-8d70-bccea5d18e7d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:33.523043 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e583166-fd19-4bb9-9de3-77cfdc188f64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:33.523985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e583166-fd19-4bb9-9de3-77cfdc188f64 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:33.526379 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e583166-fd19-4bb9-9de3-77cfdc188f64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:33.526379 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e583166-fd19-4bb9-9de3-77cfdc188f64 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:33.526379 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e583166-fd19-4bb9-9de3-77cfdc188f64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:33.528780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e583166-fd19-4bb9-9de3-77cfdc188f64 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:33.537547 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:33.546083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1022/2019] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:33.550752 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e583166-fd19-4bb9-9de3-77cfdc188f64 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:33.566592 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e583166-fd19-4bb9-9de3-77cfdc188f64 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:33.567977 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 998/2020] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:03:33 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:03:33.572809 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe4034-37bd-45af-b480-8796bbb8d480 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:33.573640 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402aa70-408b-4ab3-9203-e447d840b0a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:33.574548 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402aa70-408b-4ab3-9203-e447d840b0a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:33.574984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402aa70-408b-4ab3-9203-e447d840b0a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:33.575476 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402aa70-408b-4ab3-9203-e447d840b0a0 admin admin] PATH_INFO: `/v3/projects/219db09a65ad47199e987a45e6ce46f9/users/f9dda726a470499997d122d688632fe6/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:33.603593 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fe4034-37bd-45af-b480-8796bbb8d480 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:33.618614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01227b-fcdc-48e9-a78c-254aefb7b589 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:33.619380 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01227b-fcdc-48e9-a78c-254aefb7b589 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:33.619727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01227b-fcdc-48e9-a78c-254aefb7b589 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:33.620316 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01227b-fcdc-48e9-a78c-254aefb7b589 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:33.621258 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402aa70-408b-4ab3-9203-e447d840b0a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=219db09a65ad47199e987a45e6ce46f9, user_id=f9dda726a470499997d122d688632fe6, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:33.621754 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01227b-fcdc-48e9-a78c-254aefb7b589 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:33.626352 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402aa70-408b-4ab3-9203-e447d840b0a0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:33.626725 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01227b-fcdc-48e9-a78c-254aefb7b589 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:33.649191 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 999/2021] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:03:33.650628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01227b-fcdc-48e9-a78c-254aefb7b589 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:33.661931 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01227b-fcdc-48e9-a78c-254aefb7b589 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:33.667561 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19ac39-ed78-46c4-9b32-b94026015a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:33.668568 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19ac39-ed78-46c4-9b32-b94026015a4e admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:33.668958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19ac39-ed78-46c4-9b32-b94026015a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:33.669335 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c19ac39-ed78-46c4-9b32-b94026015a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:33.670138 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19ac39-ed78-46c4-9b32-b94026015a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:33.671950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c19ac39-ed78-46c4-9b32-b94026015a4e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:33.689547 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1000/2022] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:03:33.691057 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19ac39-ed78-46c4-9b32-b94026015a4e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:33.704566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c19ac39-ed78-46c4-9b32-b94026015a4e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:33.710836 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7c1c32-18d6-4607-9726-ba6742cca9d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:33.711678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c1c32-18d6-4607-9726-ba6742cca9d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:33.712063 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c1c32-18d6-4607-9726-ba6742cca9d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:33.712556 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7c1c32-18d6-4607-9726-ba6742cca9d5 admin admin] PATH_INFO: `/v3/projects/ede8f92dedc34d73a9d5b52e287a27d4/users/553378bd741a4a2dab169870d4bddeb2/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:33.732040 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c1c32-18d6-4607-9726-ba6742cca9d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ede8f92dedc34d73a9d5b52e287a27d4, user_id=553378bd741a4a2dab169870d4bddeb2, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:33.735148 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7c1c32-18d6-4607-9726-ba6742cca9d5 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:33.755881 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1023/2023] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:03:33 2022] PUT /identity/v3/projects/219db09a65ad47199e987a45e6ce46f9/users/f9dda726a470499997d122d688632fe6/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:33.769102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94d276-e88b-47e2-9ccd-9fddb61e4288 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:33.769799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94d276-e88b-47e2-9ccd-9fddb61e4288 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:33.769984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac94d276-e88b-47e2-9ccd-9fddb61e4288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:33.811954 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ac94d276-e88b-47e2-9ccd-9fddb61e4288 None None] MFA Rules not processed for user `f9dda726a470499997d122d688632fe6`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:33.813734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ac94d276-e88b-47e2-9ccd-9fddb61e4288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:33.831763 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1001/2024] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:03:33 2022] PUT /identity/v3/projects/ede8f92dedc34d73a9d5b52e287a27d4/users/553378bd741a4a2dab169870d4bddeb2/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:33.842553 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1e29c-16c4-47bd-8e1b-34d1b13d7c32 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:33.842835 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1e29c-16c4-47bd-8e1b-34d1b13d7c32 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:33.843102 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e1e29c-16c4-47bd-8e1b-34d1b13d7c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:33.887482 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-84e1e29c-16c4-47bd-8e1b-34d1b13d7c32 None None] MFA Rules not processed for user `553378bd741a4a2dab169870d4bddeb2`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:33.897597 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-84e1e29c-16c4-47bd-8e1b-34d1b13d7c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:33.938241 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1024/2025] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:33.944244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94d276-e88b-47e2-9ccd-9fddb61e4288 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:33.994030 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1002/2026] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:34.002495 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1e29c-16c4-47bd-8e1b-34d1b13d7c32 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:34.004404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-84e1e29c-16c4-47bd-8e1b-34d1b13d7c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:34.012501 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:34.053504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac94d276-e88b-47e2-9ccd-9fddb61e4288 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:34.106161 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e1e29c-16c4-47bd-8e1b-34d1b13d7c32 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:34.112256 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fd4b2-18f3-44bb-aff3-51e30e5b11b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:34.112935 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fd4b2-18f3-44bb-aff3-51e30e5b11b6 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:34.113222 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fd4b2-18f3-44bb-aff3-51e30e5b11b6 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:34.113601 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1fd4b2-18f3-44bb-aff3-51e30e5b11b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:34.126491 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1fd4b2-18f3-44bb-aff3-51e30e5b11b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:34.128410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1fd4b2-18f3-44bb-aff3-51e30e5b11b6 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:34.140478 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1003/2027] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:34 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:34.159730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132fd84-29b6-4963-b41a-ccce69f061da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:34.161026 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132fd84-29b6-4963-b41a-ccce69f061da admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:34.161879 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132fd84-29b6-4963-b41a-ccce69f061da admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:34.162913 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132fd84-29b6-4963-b41a-ccce69f061da admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:34.163693 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132fd84-29b6-4963-b41a-ccce69f061da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:34.167858 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132fd84-29b6-4963-b41a-ccce69f061da admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:34.256937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:34.271986 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1025/2028] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:03:33 2022] POST /identity/v3/projects => generated 385 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:34.275121 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fd4b2-18f3-44bb-aff3-51e30e5b11b6 service nova] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:34.286984 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1fd4b2-18f3-44bb-aff3-51e30e5b11b6 service nova] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:34.379339 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fa60a-8fdf-484f-9667-016abd747696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:34.380190 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fa60a-8fdf-484f-9667-016abd747696 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:34.380483 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fa60a-8fdf-484f-9667-016abd747696 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:34.380813 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591fa60a-8fdf-484f-9667-016abd747696 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:34.381527 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591fa60a-8fdf-484f-9667-016abd747696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:34.383739 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591fa60a-8fdf-484f-9667-016abd747696 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:34.503763 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1004/2029] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:03:34 2022] POST /identity/v3/users => generated 299 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:03:34.507825 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132fd84-29b6-4963-b41a-ccce69f061da admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:34.525951 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132fd84-29b6-4963-b41a-ccce69f061da admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:34.568993 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52549c42-046a-433b-a224-7d6cf818a64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:34.570142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52549c42-046a-433b-a224-7d6cf818a64e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:34.570929 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52549c42-046a-433b-a224-7d6cf818a64e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:34.576573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52549c42-046a-433b-a224-7d6cf818a64e admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:34.576573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52549c42-046a-433b-a224-7d6cf818a64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:34.576861 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52549c42-046a-433b-a224-7d6cf818a64e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:34.607297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1026/2030] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:34.607895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fa60a-8fdf-484f-9667-016abd747696 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:34.622616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591fa60a-8fdf-484f-9667-016abd747696 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:34.628106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841bed7-e4b3-47d1-8299-ab63e2538b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:34.629141 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841bed7-e4b3-47d1-8299-ab63e2538b79 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:34.629587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841bed7-e4b3-47d1-8299-ab63e2538b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:34.630054 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5841bed7-e4b3-47d1-8299-ab63e2538b79 admin admin] PATH_INFO: `/v3/projects/448a47d87b42447085579e24a709472e/users/adc2de8cd21a4c9ba2efe8f5fcad3e54/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:34.647288 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841bed7-e4b3-47d1-8299-ab63e2538b79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=448a47d87b42447085579e24a709472e, user_id=adc2de8cd21a4c9ba2efe8f5fcad3e54, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:34.652310 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5841bed7-e4b3-47d1-8299-ab63e2538b79 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:34.817705 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1005/2031] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:03:34 2022] PUT /identity/v3/projects/448a47d87b42447085579e24a709472e/users/adc2de8cd21a4c9ba2efe8f5fcad3e54/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:34.822313 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52549c42-046a-433b-a224-7d6cf818a64e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:34.851010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52549c42-046a-433b-a224-7d6cf818a64e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:34.991901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7dec33-c7af-4e88-bb01-6d68c2ab9262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:34.993275 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7dec33-c7af-4e88-bb01-6d68c2ab9262 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:34.993555 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7dec33-c7af-4e88-bb01-6d68c2ab9262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:34.993930 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7dec33-c7af-4e88-bb01-6d68c2ab9262 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:34.994958 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7dec33-c7af-4e88-bb01-6d68c2ab9262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:34.996654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7dec33-c7af-4e88-bb01-6d68c2ab9262 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:35.012541 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1027/2032] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:34 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:35.015010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841bed7-e4b3-47d1-8299-ab63e2538b79 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:35.029908 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5841bed7-e4b3-47d1-8299-ab63e2538b79 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:35.044711 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1f713-3c14-450b-ba47-4dfc3d3c070d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:35.044711 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1f713-3c14-450b-ba47-4dfc3d3c070d admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:35.044711 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1f713-3c14-450b-ba47-4dfc3d3c070d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:35.044711 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb1f713-3c14-450b-ba47-4dfc3d3c070d admin admin] PATH_INFO: `/v3/projects/448a47d87b42447085579e24a709472e/users/adc2de8cd21a4c9ba2efe8f5fcad3e54/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:35.046498 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1f713-3c14-450b-ba47-4dfc3d3c070d admin admin] RBAC: Authorizing `identity:create_grant(project_id=448a47d87b42447085579e24a709472e, user_id=adc2de8cd21a4c9ba2efe8f5fcad3e54, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:35.049419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb1f713-3c14-450b-ba47-4dfc3d3c070d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:35.062445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1006/2033] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:03:35 2022] PUT /identity/v3/projects/448a47d87b42447085579e24a709472e/users/adc2de8cd21a4c9ba2efe8f5fcad3e54/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:35.073622 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fca98-fb69-4069-b7a3-cdec71ae4edd None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:35.073988 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fca98-fb69-4069-b7a3-cdec71ae4edd None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:35.074212 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786fca98-fb69-4069-b7a3-cdec71ae4edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:35.119700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-786fca98-fb69-4069-b7a3-cdec71ae4edd None None] MFA Rules not processed for user `adc2de8cd21a4c9ba2efe8f5fcad3e54`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:35.122603 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-786fca98-fb69-4069-b7a3-cdec71ae4edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:35.236295 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1028/2034] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:35 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:35.249904 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1f713-3c14-450b-ba47-4dfc3d3c070d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:35.251632 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-feb1f713-3c14-450b-ba47-4dfc3d3c070d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:35.331824 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:35.342258 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb1f713-3c14-450b-ba47-4dfc3d3c070d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:35.348214 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18c92a-431b-426c-8257-99783036c488 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:35.348859 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18c92a-431b-426c-8257-99783036c488 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:35.349137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18c92a-431b-426c-8257-99783036c488 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:35.349407 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e18c92a-431b-426c-8257-99783036c488 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:35.351392 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3e18c92a-431b-426c-8257-99783036c488 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:35.423350 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18c92a-431b-426c-8257-99783036c488 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:35.425098 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e18c92a-431b-426c-8257-99783036c488 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:35.448794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1007/2035] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:35.922324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5de40-4236-4598-87cd-51c613a54637 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:35.922833 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5de40-4236-4598-87cd-51c613a54637 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:35.922926 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5de40-4236-4598-87cd-51c613a54637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:35.966433 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-dbd5de40-4236-4598-87cd-51c613a54637 None None] MFA Rules not processed for user `a2241fcd4464459b81ca304b29cb5196`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:35.966433 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dbd5de40-4236-4598-87cd-51c613a54637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:36.027944 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:36.039760 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1029/2036] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:35 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:36.054274 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18c92a-431b-426c-8257-99783036c488 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:36.055709 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3e18c92a-431b-426c-8257-99783036c488 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:36.130522 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e18c92a-431b-426c-8257-99783036c488 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:36.135891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b3edf-bd51-49b2-8ad0-f424c6b8f9ee service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44093d63c1aa45b781d2ce30239ed598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:36.138294 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b3edf-bd51-49b2-8ad0-f424c6b8f9ee service glance] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:36.138618 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b3edf-bd51-49b2-8ad0-f424c6b8f9ee service glance] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:36.138900 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469b3edf-bd51-49b2-8ad0-f424c6b8f9ee service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:36.141260 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-469b3edf-bd51-49b2-8ad0-f424c6b8f9ee service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:36.219110 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b3edf-bd51-49b2-8ad0-f424c6b8f9ee service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:36.220665 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469b3edf-bd51-49b2-8ad0-f424c6b8f9ee service glance] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:36.230446 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1008/2037] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:36 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:36.645159 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38622599-2043-43ef-a4a2-dd683eb35e9d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:36.645514 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38622599-2043-43ef-a4a2-dd683eb35e9d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:36.645888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38622599-2043-43ef-a4a2-dd683eb35e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:36.667343 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-38622599-2043-43ef-a4a2-dd683eb35e9d None None] MFA Rules not processed for user `9fd7a80714874e73bf64dfa392632391`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:36.668749 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-38622599-2043-43ef-a4a2-dd683eb35e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:36.736541 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1030/2038] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Sep 13 20:03:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:36.782017 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b3edf-bd51-49b2-8ad0-f424c6b8f9ee service glance] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:36.783899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-469b3edf-bd51-49b2-8ad0-f424c6b8f9ee service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:36.835667 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:36.855526 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469b3edf-bd51-49b2-8ad0-f424c6b8f9ee service glance] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:36.860552 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ff82d-1d00-4418-9994-dbe05dde27de service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00e78bf5e5c4db29c47dce1e87f3f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:36.861157 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ff82d-1d00-4418-9994-dbe05dde27de service swift] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:36.861441 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ff82d-1d00-4418-9994-dbe05dde27de service swift] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:36.861745 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ff82d-1d00-4418-9994-dbe05dde27de service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:36.870249 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ff82d-1d00-4418-9994-dbe05dde27de service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:36.871920 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ff82d-1d00-4418-9994-dbe05dde27de service swift] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:36.880058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1009/2039] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Sep 13 20:03:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:03:38.021593 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38622599-2043-43ef-a4a2-dd683eb35e9d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:38.030102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38622599-2043-43ef-a4a2-dd683eb35e9d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:38.034065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd84fbb-8cc5-4232-89df-926b0f0bd7a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:38.034797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd84fbb-8cc5-4232-89df-926b0f0bd7a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:38.035087 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd84fbb-8cc5-4232-89df-926b0f0bd7a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:38.035392 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd84fbb-8cc5-4232-89df-926b0f0bd7a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:38.134192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd84fbb-8cc5-4232-89df-926b0f0bd7a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:38.135691 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd84fbb-8cc5-4232-89df-926b0f0bd7a9 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:38.149444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1031/2040] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:38 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:39.809204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ff82d-1d00-4418-9994-dbe05dde27de service swift] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:39.816992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ce9ff82d-1d00-4418-9994-dbe05dde27de service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:39.828372 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ff82d-1d00-4418-9994-dbe05dde27de service swift] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:39.832335 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb41e41-505d-4b1f-835f-2deaca1d61b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:39.835929 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb41e41-505d-4b1f-835f-2deaca1d61b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:39.836398 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb41e41-505d-4b1f-835f-2deaca1d61b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:39.836803 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb41e41-505d-4b1f-835f-2deaca1d61b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:39.866539 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb41e41-505d-4b1f-835f-2deaca1d61b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:39.870970 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb41e41-505d-4b1f-835f-2deaca1d61b3 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:39.896632 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1010/2041] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:39 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:42.192316 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd84fbb-8cc5-4232-89df-926b0f0bd7a9 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:42.281295 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd84fbb-8cc5-4232-89df-926b0f0bd7a9 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:42.286868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d8b4e-516f-44d9-9464-8bc792f508d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:42.287503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d8b4e-516f-44d9-9464-8bc792f508d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:42.287783 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d8b4e-516f-44d9-9464-8bc792f508d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:42.288061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818d8b4e-516f-44d9-9464-8bc792f508d8 admin admin] PATH_INFO: `/v3/users/553378bd741a4a2dab169870d4bddeb2` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:42.289727 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d8b4e-516f-44d9-9464-8bc792f508d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=553378bd741a4a2dab169870d4bddeb2)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:42.291764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818d8b4e-516f-44d9-9464-8bc792f508d8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:42.438408 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:42.445269 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-818d8b4e-516f-44d9-9464-8bc792f508d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '553378bd741a4a2dab169870d4bddeb2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:42.525822 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-818d8b4e-516f-44d9-9464-8bc792f508d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '553378bd741a4a2dab169870d4bddeb2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:42.549993 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-818d8b4e-516f-44d9-9464-8bc792f508d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '553378bd741a4a2dab169870d4bddeb2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:42.551309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-818d8b4e-516f-44d9-9464-8bc792f508d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '553378bd741a4a2dab169870d4bddeb2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:42.561878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-818d8b4e-516f-44d9-9464-8bc792f508d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '553378bd741a4a2dab169870d4bddeb2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:42.568362 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1032/2042] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:03:42 2022] DELETE /identity/v3/users/553378bd741a4a2dab169870d4bddeb2 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:42.572914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc15cd-8964-40c2-a175-c3f1be278100 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:42.573401 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc15cd-8964-40c2-a175-c3f1be278100 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:42.573511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fc15cd-8964-40c2-a175-c3f1be278100 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:42.595191 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-70fc15cd-8964-40c2-a175-c3f1be278100 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:42.597244 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-70fc15cd-8964-40c2-a175-c3f1be278100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:42.684138 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1011/2043] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:42.694435 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d8b4e-516f-44d9-9464-8bc792f508d8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:42.699221 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-818d8b4e-516f-44d9-9464-8bc792f508d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:42.772275 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818d8b4e-516f-44d9-9464-8bc792f508d8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:42.777263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f935a7e1-acd6-4e09-9dce-03e5a271a254 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:42.778370 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935a7e1-acd6-4e09-9dce-03e5a271a254 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:42.778844 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935a7e1-acd6-4e09-9dce-03e5a271a254 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:42.779117 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f935a7e1-acd6-4e09-9dce-03e5a271a254 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:42.799930 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f935a7e1-acd6-4e09-9dce-03e5a271a254 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:42.801840 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f935a7e1-acd6-4e09-9dce-03e5a271a254 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:42.827995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1033/2044] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:43.372751 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc15cd-8964-40c2-a175-c3f1be278100 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:43.374328 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-70fc15cd-8964-40c2-a175-c3f1be278100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:43.392877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fc15cd-8964-40c2-a175-c3f1be278100 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:43.405314 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79275c-08c6-4f36-a288-e891b883c7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:43.412801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79275c-08c6-4f36-a288-e891b883c7b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:43.413200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79275c-08c6-4f36-a288-e891b883c7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:43.414151 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79275c-08c6-4f36-a288-e891b883c7b5 admin admin] PATH_INFO: `/v3/projects/ede8f92dedc34d73a9d5b52e287a27d4` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:43.417638 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79275c-08c6-4f36-a288-e891b883c7b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ede8f92dedc34d73a9d5b52e287a27d4)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:43.420682 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79275c-08c6-4f36-a288-e891b883c7b5 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:43.553681 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2d79275c-08c6-4f36-a288-e891b883c7b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ede8f92dedc34d73a9d5b52e287a27d4', 'request_id': 'req-2d79275c-08c6-4f36-a288-e891b883c7b5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:43.565202 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2d79275c-08c6-4f36-a288-e891b883c7b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ede8f92dedc34d73a9d5b52e287a27d4', 'request_id': 'req-2d79275c-08c6-4f36-a288-e891b883c7b5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:43.575411 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2d79275c-08c6-4f36-a288-e891b883c7b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ede8f92dedc34d73a9d5b52e287a27d4', 'request_id': 'req-2d79275c-08c6-4f36-a288-e891b883c7b5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:43.674511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2d79275c-08c6-4f36-a288-e891b883c7b5 admin admin] The token cache is being invalidate because project ede8f92dedc34d73a9d5b52e287a27d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:03:43.674809 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2d79275c-08c6-4f36-a288-e891b883c7b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:43.675505 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2d79275c-08c6-4f36-a288-e891b883c7b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:43.677068 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1012/2045] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:03:43 2022] DELETE /identity/v3/projects/ede8f92dedc34d73a9d5b52e287a27d4 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:43.685742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50111e9-5d2e-4c6b-aa63-196b0f92e94b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:43.685742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50111e9-5d2e-4c6b-aa63-196b0f92e94b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:43.685742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50111e9-5d2e-4c6b-aa63-196b0f92e94b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:43.709274 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e50111e9-5d2e-4c6b-aa63-196b0f92e94b None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:43.711278 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e50111e9-5d2e-4c6b-aa63-196b0f92e94b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:43.798040 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1034/2046] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:43.807179 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a63b04-bca3-4aff-9a01-b9d28eff543b None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:43.807461 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a63b04-bca3-4aff-9a01-b9d28eff543b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:43.807740 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a63b04-bca3-4aff-9a01-b9d28eff543b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:43.840920 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e7a63b04-bca3-4aff-9a01-b9d28eff543b None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:43.842136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e7a63b04-bca3-4aff-9a01-b9d28eff543b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:43.850983 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1013/2047] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:43.855426 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50111e9-5d2e-4c6b-aa63-196b0f92e94b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:43.869810 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50111e9-5d2e-4c6b-aa63-196b0f92e94b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:43.874514 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b02c3-5116-42ac-945b-2ec8eeaeba62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:43.875160 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b02c3-5116-42ac-945b-2ec8eeaeba62 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:43.875436 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b02c3-5116-42ac-945b-2ec8eeaeba62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:43.877842 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b02c3-5116-42ac-945b-2ec8eeaeba62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:43.877842 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b02c3-5116-42ac-945b-2ec8eeaeba62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:03:43.877842 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b02c3-5116-42ac-945b-2ec8eeaeba62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:43.879919 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b02c3-5116-42ac-945b-2ec8eeaeba62 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:43.896206 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1035/2048] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:03:43.897597 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a63b04-bca3-4aff-9a01-b9d28eff543b None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:43.912288 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a63b04-bca3-4aff-9a01-b9d28eff543b None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:43.921023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b6ab5-7d64-4f9b-b12e-bb756c9e1da4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:43.921929 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b6ab5-7d64-4f9b-b12e-bb756c9e1da4 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:43.922361 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b6ab5-7d64-4f9b-b12e-bb756c9e1da4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:43.922861 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0b6ab5-7d64-4f9b-b12e-bb756c9e1da4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:43.923699 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b6ab5-7d64-4f9b-b12e-bb756c9e1da4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:43.925868 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0b6ab5-7d64-4f9b-b12e-bb756c9e1da4 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:44.447531 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1014/2049] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:03:43 2022] POST /identity/v3/projects => generated 371 bytes in 549 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:44.452752 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b02c3-5116-42ac-945b-2ec8eeaeba62 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:44.465472 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b02c3-5116-42ac-945b-2ec8eeaeba62 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:44.513582 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:44.535981 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f70424-13ea-4cec-a46f-345e109ee025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:44.536731 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f70424-13ea-4cec-a46f-345e109ee025 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:44.536881 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f70424-13ea-4cec-a46f-345e109ee025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:44.537280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f70424-13ea-4cec-a46f-345e109ee025 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:44.537973 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f70424-13ea-4cec-a46f-345e109ee025 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:44.540675 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f70424-13ea-4cec-a46f-345e109ee025 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:44.640143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1036/2050] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:03:44 2022] POST /identity/v3/users => generated 286 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:44.644497 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b6ab5-7d64-4f9b-b12e-bb756c9e1da4 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:44.660635 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0b6ab5-7d64-4f9b-b12e-bb756c9e1da4 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:44.671423 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb6937-7fbc-4038-960b-3bdd883bec75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:44.671423 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb6937-7fbc-4038-960b-3bdd883bec75 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:44.671423 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb6937-7fbc-4038-960b-3bdd883bec75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:44.671423 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb6937-7fbc-4038-960b-3bdd883bec75 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:44.671780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb6937-7fbc-4038-960b-3bdd883bec75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:44.671865 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb6937-7fbc-4038-960b-3bdd883bec75 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:44.686144 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1015/2051] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:44.690271 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f70424-13ea-4cec-a46f-345e109ee025 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:44.703826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f70424-13ea-4cec-a46f-345e109ee025 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:44.718935 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22280da0-00f6-4575-b630-2327ba5dbbb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:44.719561 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22280da0-00f6-4575-b630-2327ba5dbbb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:44.719834 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22280da0-00f6-4575-b630-2327ba5dbbb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:44.720106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22280da0-00f6-4575-b630-2327ba5dbbb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:44.720790 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22280da0-00f6-4575-b630-2327ba5dbbb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:44.726868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22280da0-00f6-4575-b630-2327ba5dbbb4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:44.748811 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1037/2052] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:44 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:44.753162 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb6937-7fbc-4038-960b-3bdd883bec75 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:44.766947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb6937-7fbc-4038-960b-3bdd883bec75 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:44.782699 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a1fd1-fd79-4c18-a19a-b9d46c1c96f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:44.783457 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a1fd1-fd79-4c18-a19a-b9d46c1c96f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:44.783811 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a1fd1-fd79-4c18-a19a-b9d46c1c96f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:44.784182 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956a1fd1-fd79-4c18-a19a-b9d46c1c96f1 admin admin] PATH_INFO: `/v3/projects/8403a62eb4584ae2afd07b10614904b6/users/931dfd24ba4f47238de47cd7df30fb51/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:44.791357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:44.815554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a1fd1-fd79-4c18-a19a-b9d46c1c96f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8403a62eb4584ae2afd07b10614904b6, user_id=931dfd24ba4f47238de47cd7df30fb51, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:44.819161 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956a1fd1-fd79-4c18-a19a-b9d46c1c96f1 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:44.932958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1016/2053] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:03:44 2022] PUT /identity/v3/projects/8403a62eb4584ae2afd07b10614904b6/users/931dfd24ba4f47238de47cd7df30fb51/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:03:44.948737 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67920bd4-7810-446f-84c9-988dc0fec9f9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:44.949234 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67920bd4-7810-446f-84c9-988dc0fec9f9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:44.949519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67920bd4-7810-446f-84c9-988dc0fec9f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:44.986789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-67920bd4-7810-446f-84c9-988dc0fec9f9 None None] MFA Rules not processed for user `931dfd24ba4f47238de47cd7df30fb51`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:44.988274 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-67920bd4-7810-446f-84c9-988dc0fec9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:45.069296 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1038/2054] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:45.080582 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a1fd1-fd79-4c18-a19a-b9d46c1c96f1 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:45.082880 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-956a1fd1-fd79-4c18-a19a-b9d46c1c96f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:45.188132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956a1fd1-fd79-4c18-a19a-b9d46c1c96f1 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:45.196221 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4371a2d1-fb5e-4f13-bac2-f83c283347ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:45.196881 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371a2d1-fb5e-4f13-bac2-f83c283347ff service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:45.197165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371a2d1-fb5e-4f13-bac2-f83c283347ff service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:45.197554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4371a2d1-fb5e-4f13-bac2-f83c283347ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:45.208506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371a2d1-fb5e-4f13-bac2-f83c283347ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:45.211371 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4371a2d1-fb5e-4f13-bac2-f83c283347ff service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:45.222157 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1017/2055] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:45.720502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67920bd4-7810-446f-84c9-988dc0fec9f9 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:45.723097 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-67920bd4-7810-446f-84c9-988dc0fec9f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:45.807338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67920bd4-7810-446f-84c9-988dc0fec9f9 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:45.812310 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243620b-dd5a-43e6-98df-58041247aac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:45.812948 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243620b-dd5a-43e6-98df-58041247aac6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:45.813229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243620b-dd5a-43e6-98df-58041247aac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:45.813501 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c243620b-dd5a-43e6-98df-58041247aac6 admin admin] PATH_INFO: `/v3/users/73c27834d9624cf3b67d09b32f212611` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:45.814746 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243620b-dd5a-43e6-98df-58041247aac6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73c27834d9624cf3b67d09b32f212611)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:45.818216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c243620b-dd5a-43e6-98df-58041247aac6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:46.020756 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c243620b-dd5a-43e6-98df-58041247aac6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73c27834d9624cf3b67d09b32f212611'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:46.102331 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c243620b-dd5a-43e6-98df-58041247aac6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73c27834d9624cf3b67d09b32f212611'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:46.105217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:46.126306 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c243620b-dd5a-43e6-98df-58041247aac6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73c27834d9624cf3b67d09b32f212611'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:46.127065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c243620b-dd5a-43e6-98df-58041247aac6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73c27834d9624cf3b67d09b32f212611'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:46.146643 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c243620b-dd5a-43e6-98df-58041247aac6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73c27834d9624cf3b67d09b32f212611'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:46.163304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1039/2056] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:03:45 2022] DELETE /identity/v3/users/73c27834d9624cf3b67d09b32f212611 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:46.165110 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c4101-6f8d-4068-b752-1b09fa1f9c71 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:46.165568 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c4101-6f8d-4068-b752-1b09fa1f9c71 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:46.165674 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c4101-6f8d-4068-b752-1b09fa1f9c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:46.190332 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-ea3c4101-6f8d-4068-b752-1b09fa1f9c71 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:46.191889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ea3c4101-6f8d-4068-b752-1b09fa1f9c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:46.214060 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243620b-dd5a-43e6-98df-58041247aac6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:46.215555 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c243620b-dd5a-43e6-98df-58041247aac6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:46.296893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1018/2057] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:46.307579 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c243620b-dd5a-43e6-98df-58041247aac6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:46.308599 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c4101-6f8d-4068-b752-1b09fa1f9c71 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:46.311396 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ea3c4101-6f8d-4068-b752-1b09fa1f9c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:46.312867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35afcd3-cd90-4cd4-bba2-e305141c1848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:46.313513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35afcd3-cd90-4cd4-bba2-e305141c1848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:46.313826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35afcd3-cd90-4cd4-bba2-e305141c1848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:46.314237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35afcd3-cd90-4cd4-bba2-e305141c1848 admin admin] PATH_INFO: `/v3/users/8eb55a161f774f82825904a413b81472` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:46.315604 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35afcd3-cd90-4cd4-bba2-e305141c1848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8eb55a161f774f82825904a413b81472)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:46.317865 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35afcd3-cd90-4cd4-bba2-e305141c1848 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:46.395113 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c4101-6f8d-4068-b752-1b09fa1f9c71 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:46.400114 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3e936-7778-494f-8963-e17e247a76a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:46.400743 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3e936-7778-494f-8963-e17e247a76a3 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:46.406103 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3e936-7778-494f-8963-e17e247a76a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:46.406103 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3e936-7778-494f-8963-e17e247a76a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:46.415505 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3e936-7778-494f-8963-e17e247a76a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:46.416945 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3e936-7778-494f-8963-e17e247a76a3 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:46.428939 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1019/2058] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:46.522333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b35afcd3-cd90-4cd4-bba2-e305141c1848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8eb55a161f774f82825904a413b81472'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:46.616773 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b35afcd3-cd90-4cd4-bba2-e305141c1848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8eb55a161f774f82825904a413b81472'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:46.637833 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b35afcd3-cd90-4cd4-bba2-e305141c1848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8eb55a161f774f82825904a413b81472'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:46.638637 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b35afcd3-cd90-4cd4-bba2-e305141c1848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8eb55a161f774f82825904a413b81472'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:46.646755 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b35afcd3-cd90-4cd4-bba2-e305141c1848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8eb55a161f774f82825904a413b81472'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:46.659069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1040/2059] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:03:46 2022] DELETE /identity/v3/users/8eb55a161f774f82825904a413b81472 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:03:46.661343 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381a304-4ed7-407d-ad79-b687e20d911d None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:46.661343 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381a304-4ed7-407d-ad79-b687e20d911d None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:46.661343 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9381a304-4ed7-407d-ad79-b687e20d911d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:46.683311 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-9381a304-4ed7-407d-ad79-b687e20d911d None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:46.686261 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9381a304-4ed7-407d-ad79-b687e20d911d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:46.695985 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:46.785001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1020/2060] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:03:46.805097 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35afcd3-cd90-4cd4-bba2-e305141c1848 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:46.807338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b35afcd3-cd90-4cd4-bba2-e305141c1848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:46.925186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35afcd3-cd90-4cd4-bba2-e305141c1848 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:46.929582 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b84cb-5e71-4966-93ce-b25884c1f033 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:46.930297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b84cb-5e71-4966-93ce-b25884c1f033 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:46.930640 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b84cb-5e71-4966-93ce-b25884c1f033 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:46.930974 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b84cb-5e71-4966-93ce-b25884c1f033 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:46.939211 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:46.942212 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b84cb-5e71-4966-93ce-b25884c1f033 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:46.943834 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b84cb-5e71-4966-93ce-b25884c1f033 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:46.958029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1041/2061] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:03:47.016020 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381a304-4ed7-407d-ad79-b687e20d911d None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:47.018027 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9381a304-4ed7-407d-ad79-b687e20d911d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:47.037366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9381a304-4ed7-407d-ad79-b687e20d911d None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:47.049075 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a28ea8-95d0-465c-9d9f-c109b80ff697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:47.049975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a28ea8-95d0-465c-9d9f-c109b80ff697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:47.050279 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a28ea8-95d0-465c-9d9f-c109b80ff697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:47.050636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a28ea8-95d0-465c-9d9f-c109b80ff697 admin admin] PATH_INFO: `/v3/projects/b49e811e2bdd4acf9f3b765e68967673` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:47.053240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a28ea8-95d0-465c-9d9f-c109b80ff697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b49e811e2bdd4acf9f3b765e68967673)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:47.056188 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a28ea8-95d0-465c-9d9f-c109b80ff697 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:47.225350 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e8a28ea8-95d0-465c-9d9f-c109b80ff697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b49e811e2bdd4acf9f3b765e68967673', 'request_id': 'req-e8a28ea8-95d0-465c-9d9f-c109b80ff697'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:47.232164 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e8a28ea8-95d0-465c-9d9f-c109b80ff697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b49e811e2bdd4acf9f3b765e68967673', 'request_id': 'req-e8a28ea8-95d0-465c-9d9f-c109b80ff697'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:47.239351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e8a28ea8-95d0-465c-9d9f-c109b80ff697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b49e811e2bdd4acf9f3b765e68967673', 'request_id': 'req-e8a28ea8-95d0-465c-9d9f-c109b80ff697'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:47.327814 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e8a28ea8-95d0-465c-9d9f-c109b80ff697 admin admin] The token cache is being invalidate because project b49e811e2bdd4acf9f3b765e68967673 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:03:47.328113 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e8a28ea8-95d0-465c-9d9f-c109b80ff697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:47.329225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e8a28ea8-95d0-465c-9d9f-c109b80ff697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:47.331655 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1021/2062] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:03:47 2022] DELETE /identity/v3/projects/b49e811e2bdd4acf9f3b765e68967673 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:47.595512 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b84cb-5e71-4966-93ce-b25884c1f033 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:47.606342 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f45b84cb-5e71-4966-93ce-b25884c1f033 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:47.615545 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b84cb-5e71-4966-93ce-b25884c1f033 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:47.722664 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07331b-f763-4855-8757-f06aeb3d0e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:47.723408 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07331b-f763-4855-8757-f06aeb3d0e65 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:47.723686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07331b-f763-4855-8757-f06aeb3d0e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:47.723985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e07331b-f763-4855-8757-f06aeb3d0e65 admin admin] PATH_INFO: `/v3/projects/ebb1926d35be43bf87052e0e8f1f2fba` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:47.725149 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07331b-f763-4855-8757-f06aeb3d0e65 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ebb1926d35be43bf87052e0e8f1f2fba)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:47.727942 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e07331b-f763-4855-8757-f06aeb3d0e65 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:48.343607 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1e07331b-f763-4855-8757-f06aeb3d0e65 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ebb1926d35be43bf87052e0e8f1f2fba', 'request_id': 'req-1e07331b-f763-4855-8757-f06aeb3d0e65'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:48.439043 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1e07331b-f763-4855-8757-f06aeb3d0e65 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ebb1926d35be43bf87052e0e8f1f2fba', 'request_id': 'req-1e07331b-f763-4855-8757-f06aeb3d0e65'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:48.446026 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1e07331b-f763-4855-8757-f06aeb3d0e65 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ebb1926d35be43bf87052e0e8f1f2fba', 'request_id': 'req-1e07331b-f763-4855-8757-f06aeb3d0e65'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:48.468722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1e07331b-f763-4855-8757-f06aeb3d0e65 admin admin] The token cache is being invalidate because project ebb1926d35be43bf87052e0e8f1f2fba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:03:48.470089 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1e07331b-f763-4855-8757-f06aeb3d0e65 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:48.471176 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1e07331b-f763-4855-8757-f06aeb3d0e65 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:48.473043 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1042/2063] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:03:47 2022] DELETE /identity/v3/projects/ebb1926d35be43bf87052e0e8f1f2fba => generated 0 bytes in 878 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:48.477242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a28ea8-95d0-465c-9d9f-c109b80ff697 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:48.479177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e8a28ea8-95d0-465c-9d9f-c109b80ff697 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:48.494502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a28ea8-95d0-465c-9d9f-c109b80ff697 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:48.566869 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35ac29f-faa3-4e43-87dd-cb26bfd4a67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:48.566869 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ac29f-faa3-4e43-87dd-cb26bfd4a67e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:48.566869 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ac29f-faa3-4e43-87dd-cb26bfd4a67e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:48.566869 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35ac29f-faa3-4e43-87dd-cb26bfd4a67e admin admin] PATH_INFO: `/v3/users/f9dda726a470499997d122d688632fe6` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:48.567913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ac29f-faa3-4e43-87dd-cb26bfd4a67e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9dda726a470499997d122d688632fe6)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:48.570618 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35ac29f-faa3-4e43-87dd-cb26bfd4a67e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:48.766310 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07331b-f763-4855-8757-f06aeb3d0e65 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:48.766310 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1e07331b-f763-4855-8757-f06aeb3d0e65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:48.775550 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:48.776747 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e07331b-f763-4855-8757-f06aeb3d0e65 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:48.781676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef2ba5-626b-40bd-8dad-ff4d3db2122f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:48.782365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef2ba5-626b-40bd-8dad-ff4d3db2122f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:48.782619 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef2ba5-626b-40bd-8dad-ff4d3db2122f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:48.782893 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ef2ba5-626b-40bd-8dad-ff4d3db2122f admin admin] PATH_INFO: `/v3/users/931dfd24ba4f47238de47cd7df30fb51` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:48.784012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef2ba5-626b-40bd-8dad-ff4d3db2122f admin admin] RBAC: Authorizing `identity:delete_user(user_id=931dfd24ba4f47238de47cd7df30fb51)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:48.784527 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e35ac29f-faa3-4e43-87dd-cb26bfd4a67e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9dda726a470499997d122d688632fe6'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:48.786075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ef2ba5-626b-40bd-8dad-ff4d3db2122f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:49.063837 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e35ac29f-faa3-4e43-87dd-cb26bfd4a67e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9dda726a470499997d122d688632fe6'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:49.077280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e35ac29f-faa3-4e43-87dd-cb26bfd4a67e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9dda726a470499997d122d688632fe6'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:49.077998 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e35ac29f-faa3-4e43-87dd-cb26bfd4a67e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9dda726a470499997d122d688632fe6'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:49.084861 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e35ac29f-faa3-4e43-87dd-cb26bfd4a67e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9dda726a470499997d122d688632fe6'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:49.094688 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1022/2064] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:03:48 2022] DELETE /identity/v3/users/f9dda726a470499997d122d688632fe6 => generated 0 bytes in 614 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:49.180511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b6ef2ba5-626b-40bd-8dad-ff4d3db2122f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '931dfd24ba4f47238de47cd7df30fb51'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:49.261642 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b6ef2ba5-626b-40bd-8dad-ff4d3db2122f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '931dfd24ba4f47238de47cd7df30fb51'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:49.274856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b6ef2ba5-626b-40bd-8dad-ff4d3db2122f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '931dfd24ba4f47238de47cd7df30fb51'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:49.275503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b6ef2ba5-626b-40bd-8dad-ff4d3db2122f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '931dfd24ba4f47238de47cd7df30fb51'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:49.282416 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b6ef2ba5-626b-40bd-8dad-ff4d3db2122f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '931dfd24ba4f47238de47cd7df30fb51'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:49.283813 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:49.294613 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1043/2065] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:03:48 2022] DELETE /identity/v3/users/931dfd24ba4f47238de47cd7df30fb51 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:03:49.299024 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a32d60-4697-48f6-b23f-23c085d66561 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:49.300595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a32d60-4697-48f6-b23f-23c085d66561 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:49.300595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a32d60-4697-48f6-b23f-23c085d66561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:49.319868 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-55a32d60-4697-48f6-b23f-23c085d66561 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:49.321076 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-55a32d60-4697-48f6-b23f-23c085d66561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:49.396223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1023/2066] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:03:49.407188 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef2ba5-626b-40bd-8dad-ff4d3db2122f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:49.408809 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b6ef2ba5-626b-40bd-8dad-ff4d3db2122f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:49.476579 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ef2ba5-626b-40bd-8dad-ff4d3db2122f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:49.480255 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c21647-4116-470c-bf09-e9a41567ff18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:49.481088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c21647-4116-470c-bf09-e9a41567ff18 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:49.481184 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c21647-4116-470c-bf09-e9a41567ff18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:49.481503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c21647-4116-470c-bf09-e9a41567ff18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:49.490723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c21647-4116-470c-bf09-e9a41567ff18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:49.492320 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c21647-4116-470c-bf09-e9a41567ff18 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:49.505763 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1044/2067] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:03:49.507958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e41fc6-8913-4697-8b68-e84322197e00 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:49.508486 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e41fc6-8913-4697-8b68-e84322197e00 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:49.508723 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e41fc6-8913-4697-8b68-e84322197e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:49.521193 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c21647-4116-470c-bf09-e9a41567ff18 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:49.526269 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-25c21647-4116-470c-bf09-e9a41567ff18 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:49.547387 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c21647-4116-470c-bf09-e9a41567ff18 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:49.552167 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09738a6-828a-4963-afe8-b3fd24d5c02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:49.552866 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09738a6-828a-4963-afe8-b3fd24d5c02e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:49.553214 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09738a6-828a-4963-afe8-b3fd24d5c02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:49.553555 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09738a6-828a-4963-afe8-b3fd24d5c02e admin admin] PATH_INFO: `/v3/projects/219db09a65ad47199e987a45e6ce46f9` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:49.555007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09738a6-828a-4963-afe8-b3fd24d5c02e admin admin] RBAC: Authorizing `identity:delete_project(project_id=219db09a65ad47199e987a45e6ce46f9)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:49.557028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09738a6-828a-4963-afe8-b3fd24d5c02e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:49.557326 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-84e41fc6-8913-4697-8b68-e84322197e00 None None] MFA Rules not processed for user `23226bd83acd46a8812632c0a117f9bc`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:49.558654 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-84e41fc6-8913-4697-8b68-e84322197e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:49.622300 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1024/2068] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:49.674314 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f09738a6-828a-4963-afe8-b3fd24d5c02e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '219db09a65ad47199e987a45e6ce46f9', 'request_id': 'req-f09738a6-828a-4963-afe8-b3fd24d5c02e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:49.753453 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f09738a6-828a-4963-afe8-b3fd24d5c02e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '219db09a65ad47199e987a45e6ce46f9', 'request_id': 'req-f09738a6-828a-4963-afe8-b3fd24d5c02e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:49.761094 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f09738a6-828a-4963-afe8-b3fd24d5c02e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '219db09a65ad47199e987a45e6ce46f9', 'request_id': 'req-f09738a6-828a-4963-afe8-b3fd24d5c02e'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:49.773633 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f09738a6-828a-4963-afe8-b3fd24d5c02e admin admin] The token cache is being invalidate because project 219db09a65ad47199e987a45e6ce46f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:03:49.774254 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f09738a6-828a-4963-afe8-b3fd24d5c02e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:49.774974 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-f09738a6-828a-4963-afe8-b3fd24d5c02e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:49.776702 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1045/2069] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:03:49 2022] DELETE /identity/v3/projects/219db09a65ad47199e987a45e6ce46f9 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:49.780951 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e41fc6-8913-4697-8b68-e84322197e00 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:49.794208 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e41fc6-8913-4697-8b68-e84322197e00 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:49.866920 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e2a601-e12c-467e-8c2e-a9a87bd89817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:49.867188 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2a601-e12c-467e-8c2e-a9a87bd89817 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:49.867466 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2a601-e12c-467e-8c2e-a9a87bd89817 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:49.867739 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e2a601-e12c-467e-8c2e-a9a87bd89817 admin admin] PATH_INFO: `/v3/users/adc2de8cd21a4c9ba2efe8f5fcad3e54` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:49.868886 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2a601-e12c-467e-8c2e-a9a87bd89817 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adc2de8cd21a4c9ba2efe8f5fcad3e54)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:49.870899 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e2a601-e12c-467e-8c2e-a9a87bd89817 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:49.881615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:49.991895 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09738a6-828a-4963-afe8-b3fd24d5c02e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:49.993954 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f09738a6-828a-4963-afe8-b3fd24d5c02e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:50.019631 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09738a6-828a-4963-afe8-b3fd24d5c02e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:50.024112 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeff47b0-6243-4e28-a775-19e6478c96ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:50.025066 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff47b0-6243-4e28-a775-19e6478c96ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:50.025350 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff47b0-6243-4e28-a775-19e6478c96ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:50.025650 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeff47b0-6243-4e28-a775-19e6478c96ce admin admin] PATH_INFO: `/v3/projects/8403a62eb4584ae2afd07b10614904b6` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:50.026882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff47b0-6243-4e28-a775-19e6478c96ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=8403a62eb4584ae2afd07b10614904b6)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:50.028968 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeff47b0-6243-4e28-a775-19e6478c96ce admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:50.082588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c9e2a601-e12c-467e-8c2e-a9a87bd89817 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adc2de8cd21a4c9ba2efe8f5fcad3e54'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:50.155467 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c9e2a601-e12c-467e-8c2e-a9a87bd89817 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adc2de8cd21a4c9ba2efe8f5fcad3e54'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:50.170046 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c9e2a601-e12c-467e-8c2e-a9a87bd89817 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adc2de8cd21a4c9ba2efe8f5fcad3e54'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:50.170897 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c9e2a601-e12c-467e-8c2e-a9a87bd89817 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adc2de8cd21a4c9ba2efe8f5fcad3e54'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:50.179986 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c9e2a601-e12c-467e-8c2e-a9a87bd89817 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adc2de8cd21a4c9ba2efe8f5fcad3e54'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:50.190235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1025/2070] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:03:49 2022] DELETE /identity/v3/users/adc2de8cd21a4c9ba2efe8f5fcad3e54 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:50.205631 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-eeff47b0-6243-4e28-a775-19e6478c96ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8403a62eb4584ae2afd07b10614904b6', 'request_id': 'req-eeff47b0-6243-4e28-a775-19e6478c96ce'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:50.313229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-eeff47b0-6243-4e28-a775-19e6478c96ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8403a62eb4584ae2afd07b10614904b6', 'request_id': 'req-eeff47b0-6243-4e28-a775-19e6478c96ce'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:50.320032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-eeff47b0-6243-4e28-a775-19e6478c96ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8403a62eb4584ae2afd07b10614904b6', 'request_id': 'req-eeff47b0-6243-4e28-a775-19e6478c96ce'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:50.332923 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-eeff47b0-6243-4e28-a775-19e6478c96ce admin admin] The token cache is being invalidate because project 8403a62eb4584ae2afd07b10614904b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:03:50.333145 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-eeff47b0-6243-4e28-a775-19e6478c96ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:50.333824 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-eeff47b0-6243-4e28-a775-19e6478c96ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:50.335307 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1046/2071] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:03:49 2022] DELETE /identity/v3/projects/8403a62eb4584ae2afd07b10614904b6 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:03:50.340207 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1f3b9-ab63-4ad8-b50e-3ed1233a8df4 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:50.340585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1f3b9-ab63-4ad8-b50e-3ed1233a8df4 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:50.340946 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db1f3b9-ab63-4ad8-b50e-3ed1233a8df4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:50.361953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-4db1f3b9-ab63-4ad8-b50e-3ed1233a8df4 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:50.363224 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4db1f3b9-ab63-4ad8-b50e-3ed1233a8df4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:50.484992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1026/2072] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:50.493518 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c7e71-aedc-4cf2-bbcb-a73ea9fda6ed None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:50.494057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c7e71-aedc-4cf2-bbcb-a73ea9fda6ed None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:50.494057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46c7e71-aedc-4cf2-bbcb-a73ea9fda6ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:50.508250 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:50.515076 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a46c7e71-aedc-4cf2-bbcb-a73ea9fda6ed None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:50.516406 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a46c7e71-aedc-4cf2-bbcb-a73ea9fda6ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:50.529404 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1047/2073] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:50.533232 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1f3b9-ab63-4ad8-b50e-3ed1233a8df4 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:50.541205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db1f3b9-ab63-4ad8-b50e-3ed1233a8df4 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:50.546600 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb038f-7c39-4d0b-976a-09043558eb82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:50.547311 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb038f-7c39-4d0b-976a-09043558eb82 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:50.547592 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb038f-7c39-4d0b-976a-09043558eb82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:50.547942 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cb038f-7c39-4d0b-976a-09043558eb82 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:50.548622 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb038f-7c39-4d0b-976a-09043558eb82 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:03:50.549069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb038f-7c39-4d0b-976a-09043558eb82 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:50.550717 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cb038f-7c39-4d0b-976a-09043558eb82 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:50.565292 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1027/2074] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:03:50.570036 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c7e71-aedc-4cf2-bbcb-a73ea9fda6ed None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:50.581838 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46c7e71-aedc-4cf2-bbcb-a73ea9fda6ed None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:50.603743 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaadd3f-02f8-4d4c-ac16-87aa32c29c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:50.604364 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaadd3f-02f8-4d4c-ac16-87aa32c29c98 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:50.604641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaadd3f-02f8-4d4c-ac16-87aa32c29c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:50.604912 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eaadd3f-02f8-4d4c-ac16-87aa32c29c98 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:50.605561 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaadd3f-02f8-4d4c-ac16-87aa32c29c98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:50.607511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eaadd3f-02f8-4d4c-ac16-87aa32c29c98 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:50.682693 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb038f-7c39-4d0b-976a-09043558eb82 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:50.686071 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d6cb038f-7c39-4d0b-976a-09043558eb82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:50.702175 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cb038f-7c39-4d0b-976a-09043558eb82 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:50.712732 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1048/2075] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:03:50 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:03:50.712858 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f849bf2-b7bd-4db1-b075-978196dec858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:50.712858 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f849bf2-b7bd-4db1-b075-978196dec858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:50.712858 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f849bf2-b7bd-4db1-b075-978196dec858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:50.712858 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f849bf2-b7bd-4db1-b075-978196dec858 admin admin] PATH_INFO: `/v3/projects/448a47d87b42447085579e24a709472e` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:50.713202 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f849bf2-b7bd-4db1-b075-978196dec858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=448a47d87b42447085579e24a709472e)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:50.714163 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaadd3f-02f8-4d4c-ac16-87aa32c29c98 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:50.714306 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f849bf2-b7bd-4db1-b075-978196dec858 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:50.787059 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eaadd3f-02f8-4d4c-ac16-87aa32c29c98 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:50.793167 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afea4de-58f6-4345-94ae-3373e0b2b7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:50.797878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afea4de-58f6-4345-94ae-3373e0b2b7e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:50.798203 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afea4de-58f6-4345-94ae-3373e0b2b7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:50.798483 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afea4de-58f6-4345-94ae-3373e0b2b7e9 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:50.799321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afea4de-58f6-4345-94ae-3373e0b2b7e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:50.801265 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afea4de-58f6-4345-94ae-3373e0b2b7e9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:50.853482 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3f849bf2-b7bd-4db1-b075-978196dec858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '448a47d87b42447085579e24a709472e', 'request_id': 'req-3f849bf2-b7bd-4db1-b075-978196dec858'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:50.864253 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3f849bf2-b7bd-4db1-b075-978196dec858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '448a47d87b42447085579e24a709472e', 'request_id': 'req-3f849bf2-b7bd-4db1-b075-978196dec858'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:50.872865 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3f849bf2-b7bd-4db1-b075-978196dec858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '448a47d87b42447085579e24a709472e', 'request_id': 'req-3f849bf2-b7bd-4db1-b075-978196dec858'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:50.959427 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1049/2076] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:03:50 2022] POST /identity/v3/users => generated 291 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:03:50.963654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afea4de-58f6-4345-94ae-3373e0b2b7e9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:50.973622 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afea4de-58f6-4345-94ae-3373e0b2b7e9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:51.005602 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3f849bf2-b7bd-4db1-b075-978196dec858 admin admin] The token cache is being invalidate because project 448a47d87b42447085579e24a709472e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:03:51.008422 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3f849bf2-b7bd-4db1-b075-978196dec858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:51.008422 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3f849bf2-b7bd-4db1-b075-978196dec858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:51.009040 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1028/2077] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:03:50 2022] DELETE /identity/v3/projects/448a47d87b42447085579e24a709472e => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:03:51.013443 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23728aa6-8088-4f5c-ae84-29cdeadb562b None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:51.013757 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23728aa6-8088-4f5c-ae84-29cdeadb562b None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:51.014172 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23728aa6-8088-4f5c-ae84-29cdeadb562b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:51.043566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-23728aa6-8088-4f5c-ae84-29cdeadb562b None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:51.045260 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-23728aa6-8088-4f5c-ae84-29cdeadb562b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:51.047519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a4d5c-293a-4fc3-a46e-2a3ca2e39770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:51.047948 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a4d5c-293a-4fc3-a46e-2a3ca2e39770 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:51.048333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a4d5c-293a-4fc3-a46e-2a3ca2e39770 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:51.048610 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92a4d5c-293a-4fc3-a46e-2a3ca2e39770 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:51.049374 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a4d5c-293a-4fc3-a46e-2a3ca2e39770 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:51.051046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92a4d5c-293a-4fc3-a46e-2a3ca2e39770 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:51.055164 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1029/2078] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:03:51.062724 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3074e05-2d89-4b46-8a55-3c2e2fca0422 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:51.063084 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3074e05-2d89-4b46-8a55-3c2e2fca0422 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:51.063436 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3074e05-2d89-4b46-8a55-3c2e2fca0422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:51.068123 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1050/2079] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:50 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:03:51.073567 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a4d5c-293a-4fc3-a46e-2a3ca2e39770 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:51.075428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d92a4d5c-293a-4fc3-a46e-2a3ca2e39770 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:51.086547 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-d3074e05-2d89-4b46-8a55-3c2e2fca0422 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:51.087746 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d3074e05-2d89-4b46-8a55-3c2e2fca0422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:51.091260 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92a4d5c-293a-4fc3-a46e-2a3ca2e39770 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:51.095918 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1030/2080] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:03:51.096042 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39500f94-b3ad-4a97-9ea1-c102bf7230fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:51.096812 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39500f94-b3ad-4a97-9ea1-c102bf7230fb admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:51.099802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39500f94-b3ad-4a97-9ea1-c102bf7230fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:51.099802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39500f94-b3ad-4a97-9ea1-c102bf7230fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:51.099802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39500f94-b3ad-4a97-9ea1-c102bf7230fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:51.099802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39500f94-b3ad-4a97-9ea1-c102bf7230fb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:51.102778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3074e05-2d89-4b46-8a55-3c2e2fca0422 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:51.111898 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1051/2081] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:51.112439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3074e05-2d89-4b46-8a55-3c2e2fca0422 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:51.115861 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39500f94-b3ad-4a97-9ea1-c102bf7230fb admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:51.118962 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd9c57-b65f-42d2-8f61-87b916f9c826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:51.119577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd9c57-b65f-42d2-8f61-87b916f9c826 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:51.119853 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd9c57-b65f-42d2-8f61-87b916f9c826 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:51.120122 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efd9c57-b65f-42d2-8f61-87b916f9c826 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:51.120772 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd9c57-b65f-42d2-8f61-87b916f9c826 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:03:51.121078 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd9c57-b65f-42d2-8f61-87b916f9c826 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:51.122735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efd9c57-b65f-42d2-8f61-87b916f9c826 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:51.127936 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39500f94-b3ad-4a97-9ea1-c102bf7230fb admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:51.138980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1031/2082] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:03:51.139124 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d5808-14d4-44a0-b68e-a95b1802b880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:51.139124 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d5808-14d4-44a0-b68e-a95b1802b880 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:51.139124 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d5808-14d4-44a0-b68e-a95b1802b880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:51.139124 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9d5808-14d4-44a0-b68e-a95b1802b880 admin admin] PATH_INFO: `/v3/projects/5542424ef1864cd7bcbc802f27639a16/users/04f0aae71cbd45d98a66e386072a6246/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:51.140638 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd9c57-b65f-42d2-8f61-87b916f9c826 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:51.152370 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efd9c57-b65f-42d2-8f61-87b916f9c826 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:51.153840 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d5808-14d4-44a0-b68e-a95b1802b880 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5542424ef1864cd7bcbc802f27639a16, user_id=04f0aae71cbd45d98a66e386072a6246, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:51.156652 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9d5808-14d4-44a0-b68e-a95b1802b880 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:51.157057 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e8d62d-9acb-41cf-91b7-3e93b48b8113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:51.157662 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8d62d-9acb-41cf-91b7-3e93b48b8113 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:51.158216 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8d62d-9acb-41cf-91b7-3e93b48b8113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:51.162905 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e8d62d-9acb-41cf-91b7-3e93b48b8113 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:51.162905 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8d62d-9acb-41cf-91b7-3e93b48b8113 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:51.162905 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e8d62d-9acb-41cf-91b7-3e93b48b8113 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:51.239578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1052/2083] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:03:51 2022] PUT /identity/v3/projects/5542424ef1864cd7bcbc802f27639a16/users/04f0aae71cbd45d98a66e386072a6246/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:51.245501 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:51.247166 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1032/2084] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:03:51 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:51.247979 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d5808-14d4-44a0-b68e-a95b1802b880 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:51.251421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb238e-8553-49e4-b164-37a1e43340df None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:51.251711 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb238e-8553-49e4-b164-37a1e43340df None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:51.251990 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4feb238e-8553-49e4-b164-37a1e43340df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:51.281328 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-4feb238e-8553-49e4-b164-37a1e43340df None None] MFA Rules not processed for user `04f0aae71cbd45d98a66e386072a6246`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:51.282698 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4feb238e-8553-49e4-b164-37a1e43340df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:51.313326 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9d5808-14d4-44a0-b68e-a95b1802b880 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:51.349263 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1033/2085] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:51.353895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb238e-8553-49e4-b164-37a1e43340df None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:51.370774 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7a13f-f4b3-4f8b-94a6-f4a7630dc86b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:51.371306 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7a13f-f4b3-4f8b-94a6-f4a7630dc86b admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:51.371583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7a13f-f4b3-4f8b-94a6-f4a7630dc86b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:51.371868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc7a13f-f4b3-4f8b-94a6-f4a7630dc86b admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:51.372474 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc7a13f-f4b3-4f8b-94a6-f4a7630dc86b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:51.374737 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc7a13f-f4b3-4f8b-94a6-f4a7630dc86b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:51.421992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4feb238e-8553-49e4-b164-37a1e43340df None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:51.426735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20798f31-e55e-4b85-b6db-c0d58919cba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:51.427579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20798f31-e55e-4b85-b6db-c0d58919cba7 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:51.427856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20798f31-e55e-4b85-b6db-c0d58919cba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:51.428127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20798f31-e55e-4b85-b6db-c0d58919cba7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:51.429277 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20798f31-e55e-4b85-b6db-c0d58919cba7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:51.431279 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20798f31-e55e-4b85-b6db-c0d58919cba7 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:51.473577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1053/2086] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:03:51 2022] POST /identity/v3/users => generated 284 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:03:51.480369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7a13f-f4b3-4f8b-94a6-f4a7630dc86b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:51.486908 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc7a13f-f4b3-4f8b-94a6-f4a7630dc86b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:51.492484 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82da5c6-fc1f-4a5b-887d-fd3693e6f8b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:51.492950 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82da5c6-fc1f-4a5b-887d-fd3693e6f8b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:51.493231 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82da5c6-fc1f-4a5b-887d-fd3693e6f8b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:51.493504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82da5c6-fc1f-4a5b-887d-fd3693e6f8b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:51.494308 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82da5c6-fc1f-4a5b-887d-fd3693e6f8b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:51.495898 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82da5c6-fc1f-4a5b-887d-fd3693e6f8b9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:51.507323 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1054/2087] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:03:51.510634 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82da5c6-fc1f-4a5b-887d-fd3693e6f8b9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:51.520478 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82da5c6-fc1f-4a5b-887d-fd3693e6f8b9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:51.525510 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08b0bc-0c22-4787-849e-64ff2b11c2cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:51.526246 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08b0bc-0c22-4787-849e-64ff2b11c2cd admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:51.526527 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08b0bc-0c22-4787-849e-64ff2b11c2cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:51.526797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08b0bc-0c22-4787-849e-64ff2b11c2cd admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:51.527521 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08b0bc-0c22-4787-849e-64ff2b11c2cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:51.529124 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08b0bc-0c22-4787-849e-64ff2b11c2cd admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:51.532778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1034/2088] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:03:51 2022] POST /identity/v3/projects => generated 381 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:51.536608 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20798f31-e55e-4b85-b6db-c0d58919cba7 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:51.542229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1055/2089] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:51.549579 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08b0bc-0c22-4787-849e-64ff2b11c2cd admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:51.563130 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08b0bc-0c22-4787-849e-64ff2b11c2cd admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:51.606593 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20798f31-e55e-4b85-b6db-c0d58919cba7 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:51.611425 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc2475-af3e-412c-9d42-655704107ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:51.612028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc2475-af3e-412c-9d42-655704107ffd admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:51.612304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc2475-af3e-412c-9d42-655704107ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:51.612694 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc2475-af3e-412c-9d42-655704107ffd admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:51.613320 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc2475-af3e-412c-9d42-655704107ffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:51.615352 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc2475-af3e-412c-9d42-655704107ffd admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:51.622762 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eea04c-8ece-4d16-97c6-94c186c1bb8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:51.623533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eea04c-8ece-4d16-97c6-94c186c1bb8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:51.624314 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eea04c-8ece-4d16-97c6-94c186c1bb8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:51.624600 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eea04c-8ece-4d16-97c6-94c186c1bb8e admin admin] PATH_INFO: `/v3/projects/023ce91dee964588885605721a474fa2/users/79970acced8841b9a10ad247a726d716/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:51.640488 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eea04c-8ece-4d16-97c6-94c186c1bb8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=023ce91dee964588885605721a474fa2, user_id=79970acced8841b9a10ad247a726d716, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:51.643197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80eea04c-8ece-4d16-97c6-94c186c1bb8e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:51.736807 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1056/2090] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:03:51 2022] PUT /identity/v3/projects/023ce91dee964588885605721a474fa2/users/79970acced8841b9a10ad247a726d716/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:51.737037 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1035/2091] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:03:51 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:03:51.744622 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eea04c-8ece-4d16-97c6-94c186c1bb8e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:51.748135 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02f151-ef35-4304-8622-3770bb12c912 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:51.748593 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02f151-ef35-4304-8622-3770bb12c912 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:51.748871 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a02f151-ef35-4304-8622-3770bb12c912 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:51.779123 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-5a02f151-ef35-4304-8622-3770bb12c912 None None] MFA Rules not processed for user `79970acced8841b9a10ad247a726d716`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:51.780337 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5a02f151-ef35-4304-8622-3770bb12c912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:51.808296 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eea04c-8ece-4d16-97c6-94c186c1bb8e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:51.813482 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729591a6-e40a-4f36-8091-22285bb34c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:51.814174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729591a6-e40a-4f36-8091-22285bb34c0a admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:51.814463 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729591a6-e40a-4f36-8091-22285bb34c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:51.814739 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729591a6-e40a-4f36-8091-22285bb34c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:51.815413 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729591a6-e40a-4f36-8091-22285bb34c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:51.817070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729591a6-e40a-4f36-8091-22285bb34c0a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:51.828965 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1057/2092] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:03:51.834040 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729591a6-e40a-4f36-8091-22285bb34c0a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:51.844563 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729591a6-e40a-4f36-8091-22285bb34c0a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:51.851607 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff035c5a-b1bd-48c9-bc7f-8c9ea19c77a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:51.852271 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff035c5a-b1bd-48c9-bc7f-8c9ea19c77a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:51.852605 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff035c5a-b1bd-48c9-bc7f-8c9ea19c77a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:51.852881 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff035c5a-b1bd-48c9-bc7f-8c9ea19c77a3 admin admin] PATH_INFO: `/v3/projects/ca6b8052157a43979374b6d71ecd9893/users/aa9a2f48b91d470aad326bb5205095b5/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:51.857187 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1036/2093] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:51 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:03:51.867610 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02f151-ef35-4304-8622-3770bb12c912 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:51.869217 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5a02f151-ef35-4304-8622-3770bb12c912 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:51.871094 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff035c5a-b1bd-48c9-bc7f-8c9ea19c77a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca6b8052157a43979374b6d71ecd9893, user_id=aa9a2f48b91d470aad326bb5205095b5, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:51.874148 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff035c5a-b1bd-48c9-bc7f-8c9ea19c77a3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:51.932279 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a02f151-ef35-4304-8622-3770bb12c912 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:51.936417 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897bd902-db4a-4e87-b4fd-d56aad666e45 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44093d63c1aa45b781d2ce30239ed598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:51.937034 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bd902-db4a-4e87-b4fd-d56aad666e45 service glance] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:51.937497 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bd902-db4a-4e87-b4fd-d56aad666e45 service glance] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:51.937853 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897bd902-db4a-4e87-b4fd-d56aad666e45 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:51.943294 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1058/2094] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:03:51 2022] PUT /identity/v3/projects/ca6b8052157a43979374b6d71ecd9893/users/aa9a2f48b91d470aad326bb5205095b5/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:03:51.947552 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff035c5a-b1bd-48c9-bc7f-8c9ea19c77a3 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:51.954187 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897bd902-db4a-4e87-b4fd-d56aad666e45 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:51.955696 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897bd902-db4a-4e87-b4fd-d56aad666e45 service glance] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:51.966370 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1037/2095] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:51 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:52.024402 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:52.028556 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff035c5a-b1bd-48c9-bc7f-8c9ea19c77a3 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:52.033549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc72d6-725e-4db1-a1ef-4753d74f4d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:52.034260 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc72d6-725e-4db1-a1ef-4753d74f4d3e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:52.034601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc72d6-725e-4db1-a1ef-4753d74f4d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:52.034985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc72d6-725e-4db1-a1ef-4753d74f4d3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:52.035901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc72d6-725e-4db1-a1ef-4753d74f4d3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:52.037569 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc72d6-725e-4db1-a1ef-4753d74f4d3e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:52.054377 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1059/2096] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:51 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:52.054768 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897bd902-db4a-4e87-b4fd-d56aad666e45 service glance] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:52.066967 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897bd902-db4a-4e87-b4fd-d56aad666e45 service glance] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:52.072597 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f01bc-8908-457f-9621-4b6a6e9dfe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:52.073274 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f01bc-8908-457f-9621-4b6a6e9dfe52 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:52.073549 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f01bc-8908-457f-9621-4b6a6e9dfe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:52.073914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f01bc-8908-457f-9621-4b6a6e9dfe52 admin admin] PATH_INFO: `/v3/projects/ca6b8052157a43979374b6d71ecd9893/users/aa9a2f48b91d470aad326bb5205095b5/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:52.075912 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f01bc-8908-457f-9621-4b6a6e9dfe52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca6b8052157a43979374b6d71ecd9893, user_id=aa9a2f48b91d470aad326bb5205095b5, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:52.078684 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707f01bc-8908-457f-9621-4b6a6e9dfe52 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:52.091502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1038/2097] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:03:52 2022] PUT /identity/v3/projects/ca6b8052157a43979374b6d71ecd9893/users/aa9a2f48b91d470aad326bb5205095b5/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:03:52.104031 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8161ad-209a-4e58-aec4-61b805259d30 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:52.104451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8161ad-209a-4e58-aec4-61b805259d30 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:52.104743 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8161ad-209a-4e58-aec4-61b805259d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:52.134567 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8a8161ad-209a-4e58-aec4-61b805259d30 None None] MFA Rules not processed for user `aa9a2f48b91d470aad326bb5205095b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:52.135934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8a8161ad-209a-4e58-aec4-61b805259d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:52.208323 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1060/2098] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:52 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:52.219643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f01bc-8908-457f-9621-4b6a6e9dfe52 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:52.230057 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-707f01bc-8908-457f-9621-4b6a6e9dfe52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:52.292306 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=96 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:52.295837 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f01bc-8908-457f-9621-4b6a6e9dfe52 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:52.299444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdf464a-f16f-4b7e-a66d-1ea16ff467c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:52.300048 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf464a-f16f-4b7e-a66d-1ea16ff467c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:52.300324 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf464a-f16f-4b7e-a66d-1ea16ff467c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:52.300592 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdf464a-f16f-4b7e-a66d-1ea16ff467c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:52.309318 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf464a-f16f-4b7e-a66d-1ea16ff467c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:52.310794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdf464a-f16f-4b7e-a66d-1ea16ff467c2 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:52.319978 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1039/2099] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:52 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:52.440724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:52.899375 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8161ad-209a-4e58-aec4-61b805259d30 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:52.974849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8161ad-209a-4e58-aec4-61b805259d30 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:52.979453 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866656a0-5dd9-4eae-82d3-7557a4bb929d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:52.980110 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866656a0-5dd9-4eae-82d3-7557a4bb929d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:52.980400 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866656a0-5dd9-4eae-82d3-7557a4bb929d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:52.980672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866656a0-5dd9-4eae-82d3-7557a4bb929d admin admin] PATH_INFO: `/v3/users/04f0aae71cbd45d98a66e386072a6246` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:52.981809 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866656a0-5dd9-4eae-82d3-7557a4bb929d admin admin] RBAC: Authorizing `identity:delete_user(user_id=04f0aae71cbd45d98a66e386072a6246)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:52.983732 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866656a0-5dd9-4eae-82d3-7557a4bb929d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:53.109870 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:53.219645 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-866656a0-5dd9-4eae-82d3-7557a4bb929d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04f0aae71cbd45d98a66e386072a6246'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:53.267670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:53.295899 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-866656a0-5dd9-4eae-82d3-7557a4bb929d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04f0aae71cbd45d98a66e386072a6246'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:53.309415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-866656a0-5dd9-4eae-82d3-7557a4bb929d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04f0aae71cbd45d98a66e386072a6246'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:53.310140 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-866656a0-5dd9-4eae-82d3-7557a4bb929d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04f0aae71cbd45d98a66e386072a6246'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:53.317020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-866656a0-5dd9-4eae-82d3-7557a4bb929d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04f0aae71cbd45d98a66e386072a6246'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:53.323235 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1061/2100] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:03:52 2022] DELETE /identity/v3/users/04f0aae71cbd45d98a66e386072a6246 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:53.327521 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02907ef-1092-41f1-8fdc-d54830bf94bd None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:53.327990 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02907ef-1092-41f1-8fdc-d54830bf94bd None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:53.328384 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02907ef-1092-41f1-8fdc-d54830bf94bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:53.352026 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-d02907ef-1092-41f1-8fdc-d54830bf94bd None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:53.353354 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d02907ef-1092-41f1-8fdc-d54830bf94bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:53.417282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1040/2101] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:53.427379 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866656a0-5dd9-4eae-82d3-7557a4bb929d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:53.429465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-866656a0-5dd9-4eae-82d3-7557a4bb929d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:53.502967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866656a0-5dd9-4eae-82d3-7557a4bb929d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:53.507054 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448441fe-2fba-4568-96f2-6bcb2acc6520 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:53.507668 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448441fe-2fba-4568-96f2-6bcb2acc6520 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:53.508049 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448441fe-2fba-4568-96f2-6bcb2acc6520 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:53.508199 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448441fe-2fba-4568-96f2-6bcb2acc6520 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:53.519823 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448441fe-2fba-4568-96f2-6bcb2acc6520 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:53.521378 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448441fe-2fba-4568-96f2-6bcb2acc6520 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:53.534027 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1062/2102] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:53.687718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca5058-07e1-42de-a47c-2dee385333c6 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:53.688011 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca5058-07e1-42de-a47c-2dee385333c6 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:53.688284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afca5058-07e1-42de-a47c-2dee385333c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:53.721665 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-afca5058-07e1-42de-a47c-2dee385333c6 None None] MFA Rules not processed for user `9fd7a80714874e73bf64dfa392632391`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:53.723807 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-afca5058-07e1-42de-a47c-2dee385333c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:53.801659 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1041/2103] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Sep 13 20:03:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:53.820365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448441fe-2fba-4568-96f2-6bcb2acc6520 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:53.821070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-448441fe-2fba-4568-96f2-6bcb2acc6520 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:53.874846 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:53.923166 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448441fe-2fba-4568-96f2-6bcb2acc6520 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:53.935850 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc24cf7-1800-44e4-b267-50063f29bbc0 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00e78bf5e5c4db29c47dce1e87f3f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:53.936484 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc24cf7-1800-44e4-b267-50063f29bbc0 service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:53.936794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc24cf7-1800-44e4-b267-50063f29bbc0 service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:53.937068 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc24cf7-1800-44e4-b267-50063f29bbc0 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:53.945799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc24cf7-1800-44e4-b267-50063f29bbc0 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:53.947478 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc24cf7-1800-44e4-b267-50063f29bbc0 service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:53.956298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1063/2104] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Sep 13 20:03:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:03:54.073671 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca5058-07e1-42de-a47c-2dee385333c6 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:54.075216 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-afca5058-07e1-42de-a47c-2dee385333c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:54.090784 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afca5058-07e1-42de-a47c-2dee385333c6 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:54.096013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d112a-0511-427f-ba24-0d9089607000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:54.097148 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d112a-0511-427f-ba24-0d9089607000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:54.097498 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d112a-0511-427f-ba24-0d9089607000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:54.097878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d112a-0511-427f-ba24-0d9089607000 admin admin] PATH_INFO: `/v3/projects/5542424ef1864cd7bcbc802f27639a16` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:54.099108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d112a-0511-427f-ba24-0d9089607000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5542424ef1864cd7bcbc802f27639a16)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:54.101372 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d112a-0511-427f-ba24-0d9089607000 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:54.244371 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-117d112a-0511-427f-ba24-0d9089607000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5542424ef1864cd7bcbc802f27639a16', 'request_id': 'req-117d112a-0511-427f-ba24-0d9089607000'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:54.257449 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-117d112a-0511-427f-ba24-0d9089607000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5542424ef1864cd7bcbc802f27639a16', 'request_id': 'req-117d112a-0511-427f-ba24-0d9089607000'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:54.273352 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-117d112a-0511-427f-ba24-0d9089607000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5542424ef1864cd7bcbc802f27639a16', 'request_id': 'req-117d112a-0511-427f-ba24-0d9089607000'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:54.349201 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:54.356861 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-117d112a-0511-427f-ba24-0d9089607000 admin admin] The token cache is being invalidate because project 5542424ef1864cd7bcbc802f27639a16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:03:54.357406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-117d112a-0511-427f-ba24-0d9089607000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:54.358465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-117d112a-0511-427f-ba24-0d9089607000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:54.360378 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1042/2105] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:03:54 2022] DELETE /identity/v3/projects/5542424ef1864cd7bcbc802f27639a16 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:54.366091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc24cf7-1800-44e4-b267-50063f29bbc0 service swift] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:54.387701 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc24cf7-1800-44e4-b267-50063f29bbc0 service swift] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:54.518096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cc38da-1d58-4935-9e4d-5d1b41b5c1f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:54.518995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc38da-1d58-4935-9e4d-5d1b41b5c1f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:54.519434 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc38da-1d58-4935-9e4d-5d1b41b5c1f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:54.519859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cc38da-1d58-4935-9e4d-5d1b41b5c1f2 admin admin] PATH_INFO: `/v3/users/aa9a2f48b91d470aad326bb5205095b5` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:54.521507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc38da-1d58-4935-9e4d-5d1b41b5c1f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa9a2f48b91d470aad326bb5205095b5)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:54.523781 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cc38da-1d58-4935-9e4d-5d1b41b5c1f2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:54.755240 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e1cc38da-1d58-4935-9e4d-5d1b41b5c1f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa9a2f48b91d470aad326bb5205095b5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:54.864225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e1cc38da-1d58-4935-9e4d-5d1b41b5c1f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa9a2f48b91d470aad326bb5205095b5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:54.905242 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e1cc38da-1d58-4935-9e4d-5d1b41b5c1f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa9a2f48b91d470aad326bb5205095b5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:54.907141 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e1cc38da-1d58-4935-9e4d-5d1b41b5c1f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa9a2f48b91d470aad326bb5205095b5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:54.921871 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e1cc38da-1d58-4935-9e4d-5d1b41b5c1f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa9a2f48b91d470aad326bb5205095b5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:54.942716 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1064/2106] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:03:54 2022] DELETE /identity/v3/users/aa9a2f48b91d470aad326bb5205095b5 => generated 0 bytes in 574 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:55.470262 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d112a-0511-427f-ba24-0d9089607000 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:55.472047 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-117d112a-0511-427f-ba24-0d9089607000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:55.509391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d112a-0511-427f-ba24-0d9089607000 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:55.598683 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93087ca4-f339-42a3-948b-3c8888b62a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:55.599330 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93087ca4-f339-42a3-948b-3c8888b62a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:55.599611 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93087ca4-f339-42a3-948b-3c8888b62a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:55.599886 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93087ca4-f339-42a3-948b-3c8888b62a2a admin admin] PATH_INFO: `/v3/projects/ca6b8052157a43979374b6d71ecd9893` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:55.601039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93087ca4-f339-42a3-948b-3c8888b62a2a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca6b8052157a43979374b6d71ecd9893)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:55.603132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93087ca4-f339-42a3-948b-3c8888b62a2a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:55.723870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-93087ca4-f339-42a3-948b-3c8888b62a2a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca6b8052157a43979374b6d71ecd9893', 'request_id': 'req-93087ca4-f339-42a3-948b-3c8888b62a2a'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:55.734567 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-93087ca4-f339-42a3-948b-3c8888b62a2a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca6b8052157a43979374b6d71ecd9893', 'request_id': 'req-93087ca4-f339-42a3-948b-3c8888b62a2a'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:55.755796 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-93087ca4-f339-42a3-948b-3c8888b62a2a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca6b8052157a43979374b6d71ecd9893', 'request_id': 'req-93087ca4-f339-42a3-948b-3c8888b62a2a'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:55.859125 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-93087ca4-f339-42a3-948b-3c8888b62a2a admin admin] The token cache is being invalidate because project ca6b8052157a43979374b6d71ecd9893 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:03:55.859645 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-93087ca4-f339-42a3-948b-3c8888b62a2a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:55.860616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-93087ca4-f339-42a3-948b-3c8888b62a2a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:55.862820 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1043/2107] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:03:55 2022] DELETE /identity/v3/projects/ca6b8052157a43979374b6d71ecd9893 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:55.868397 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a884b09-3799-4889-9153-b794feba5449 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:55.871084 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a884b09-3799-4889-9153-b794feba5449 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:55.871556 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a884b09-3799-4889-9153-b794feba5449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:55.910721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6a884b09-3799-4889-9153-b794feba5449 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:55.912206 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6a884b09-3799-4889-9153-b794feba5449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:55.963509 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:55.978867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1065/2108] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:55.988700 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84aa75-3e72-4ff2-b599-0b7eea6938c0 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:55.989982 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84aa75-3e72-4ff2-b599-0b7eea6938c0 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:55.990522 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84aa75-3e72-4ff2-b599-0b7eea6938c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:56.012415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-2b84aa75-3e72-4ff2-b599-0b7eea6938c0 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:56.013634 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2b84aa75-3e72-4ff2-b599-0b7eea6938c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:56.028886 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1044/2109] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:56.033265 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a884b09-3799-4889-9153-b794feba5449 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:56.044527 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a884b09-3799-4889-9153-b794feba5449 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:56.050184 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504b745-061e-4b16-8c01-3e49e8e4b226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:56.050983 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504b745-061e-4b16-8c01-3e49e8e4b226 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:56.051266 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504b745-061e-4b16-8c01-3e49e8e4b226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:56.051536 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d504b745-061e-4b16-8c01-3e49e8e4b226 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:56.052194 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d504b745-061e-4b16-8c01-3e49e8e4b226 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:03:56.052494 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d504b745-061e-4b16-8c01-3e49e8e4b226 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:56.054893 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d504b745-061e-4b16-8c01-3e49e8e4b226 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:56.069920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1066/2110] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:03:56.074123 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84aa75-3e72-4ff2-b599-0b7eea6938c0 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:56.085040 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84aa75-3e72-4ff2-b599-0b7eea6938c0 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:56.090307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25163c-a759-4107-bc80-374d1592efd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:56.091166 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25163c-a759-4107-bc80-374d1592efd0 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:56.091602 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25163c-a759-4107-bc80-374d1592efd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:56.092053 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25163c-a759-4107-bc80-374d1592efd0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:56.093168 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25163c-a759-4107-bc80-374d1592efd0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:56.095266 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a25163c-a759-4107-bc80-374d1592efd0 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:56.189541 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1045/2111] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:03:56 2022] POST /identity/v3/projects => generated 357 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:56.193589 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504b745-061e-4b16-8c01-3e49e8e4b226 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:56.207074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d504b745-061e-4b16-8c01-3e49e8e4b226 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:56.295659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48190824-7ec6-4f74-9eaf-bb8fd5eb8963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:56.296270 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48190824-7ec6-4f74-9eaf-bb8fd5eb8963 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:56.296546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48190824-7ec6-4f74-9eaf-bb8fd5eb8963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:56.296813 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48190824-7ec6-4f74-9eaf-bb8fd5eb8963 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:56.297449 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48190824-7ec6-4f74-9eaf-bb8fd5eb8963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:56.299414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48190824-7ec6-4f74-9eaf-bb8fd5eb8963 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:56.384565 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1067/2112] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:03:56 2022] POST /identity/v3/users => generated 279 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:56.386615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25163c-a759-4107-bc80-374d1592efd0 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:56.396963 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25163c-a759-4107-bc80-374d1592efd0 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:56.401453 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40a76c-8761-453b-80d6-c726c7ed33bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:56.402082 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40a76c-8761-453b-80d6-c726c7ed33bd admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:56.402428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40a76c-8761-453b-80d6-c726c7ed33bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:56.402776 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c40a76c-8761-453b-80d6-c726c7ed33bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:56.403484 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40a76c-8761-453b-80d6-c726c7ed33bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:56.405166 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c40a76c-8761-453b-80d6-c726c7ed33bd admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:56.420148 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1046/2113] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:56.424188 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48190824-7ec6-4f74-9eaf-bb8fd5eb8963 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:56.436073 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48190824-7ec6-4f74-9eaf-bb8fd5eb8963 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:56.441247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e1da3-5efd-4778-b6df-d684b7529b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:56.444992 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e1da3-5efd-4778-b6df-d684b7529b00 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:56.444992 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e1da3-5efd-4778-b6df-d684b7529b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:56.444992 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e1da3-5efd-4778-b6df-d684b7529b00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:56.444992 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e1da3-5efd-4778-b6df-d684b7529b00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:56.446088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e1da3-5efd-4778-b6df-d684b7529b00 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:56.459997 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1068/2114] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:56 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:56.462541 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40a76c-8761-453b-80d6-c726c7ed33bd admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:56.473938 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c40a76c-8761-453b-80d6-c726c7ed33bd admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:56.479750 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84f049-843f-4b1a-b287-0e107cfa3506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:56.480342 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84f049-843f-4b1a-b287-0e107cfa3506 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:56.480866 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84f049-843f-4b1a-b287-0e107cfa3506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:56.481151 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a84f049-843f-4b1a-b287-0e107cfa3506 admin admin] PATH_INFO: `/v3/projects/21dd70c310494f51b6cc93f3d19f5449/users/ddf6506334a04969b5969ee1625a761c/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:56.498611 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84f049-843f-4b1a-b287-0e107cfa3506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21dd70c310494f51b6cc93f3d19f5449, user_id=ddf6506334a04969b5969ee1625a761c, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:56.501307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a84f049-843f-4b1a-b287-0e107cfa3506 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:56.576394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1047/2115] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:03:56 2022] PUT /identity/v3/projects/21dd70c310494f51b6cc93f3d19f5449/users/ddf6506334a04969b5969ee1625a761c/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:56.587510 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78d411-3839-4545-9265-5e6ea89008e6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:56.587794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78d411-3839-4545-9265-5e6ea89008e6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:56.588067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad78d411-3839-4545-9265-5e6ea89008e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:56.620550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ad78d411-3839-4545-9265-5e6ea89008e6 None None] MFA Rules not processed for user `ddf6506334a04969b5969ee1625a761c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:56.622287 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ad78d411-3839-4545-9265-5e6ea89008e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:56.695934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1069/2116] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:56.735232 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84f049-843f-4b1a-b287-0e107cfa3506 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:56.736975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0a84f049-843f-4b1a-b287-0e107cfa3506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:56.773270 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:56.808983 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a84f049-843f-4b1a-b287-0e107cfa3506 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:56.812746 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15134e1b-5932-4035-8e2e-350df52d5d62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:56.813361 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15134e1b-5932-4035-8e2e-350df52d5d62 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:56.813642 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15134e1b-5932-4035-8e2e-350df52d5d62 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:56.813965 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15134e1b-5932-4035-8e2e-350df52d5d62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:56.823136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15134e1b-5932-4035-8e2e-350df52d5d62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:56.824579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15134e1b-5932-4035-8e2e-350df52d5d62 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:56.834193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1048/2117] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:56 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:56.860848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78d411-3839-4545-9265-5e6ea89008e6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:56.914862 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:56.933115 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad78d411-3839-4545-9265-5e6ea89008e6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:56.937901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de14f31-280f-419b-a97c-ef14b07a170a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:56.938539 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de14f31-280f-419b-a97c-ef14b07a170a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:56.938816 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de14f31-280f-419b-a97c-ef14b07a170a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:56.939084 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de14f31-280f-419b-a97c-ef14b07a170a admin admin] PATH_INFO: `/v3/users/ddf6506334a04969b5969ee1625a761c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:56.940475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de14f31-280f-419b-a97c-ef14b07a170a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddf6506334a04969b5969ee1625a761c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:56.945877 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de14f31-280f-419b-a97c-ef14b07a170a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:57.090280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8de14f31-280f-419b-a97c-ef14b07a170a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddf6506334a04969b5969ee1625a761c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:57.170080 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8de14f31-280f-419b-a97c-ef14b07a170a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddf6506334a04969b5969ee1625a761c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:57.188221 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8de14f31-280f-419b-a97c-ef14b07a170a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddf6506334a04969b5969ee1625a761c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:57.189054 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8de14f31-280f-419b-a97c-ef14b07a170a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddf6506334a04969b5969ee1625a761c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:57.200084 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8de14f31-280f-419b-a97c-ef14b07a170a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddf6506334a04969b5969ee1625a761c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:57.213857 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1070/2118] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:03:56 2022] DELETE /identity/v3/users/ddf6506334a04969b5969ee1625a761c => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:57.225570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fcdf1-b74c-4038-881a-79282de623c1 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:57.225570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fcdf1-b74c-4038-881a-79282de623c1 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:57.225570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4fcdf1-b74c-4038-881a-79282de623c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:57.244232 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-0e4fcdf1-b74c-4038-881a-79282de623c1 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:57.245470 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0e4fcdf1-b74c-4038-881a-79282de623c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:57.324961 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1049/2119] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:57.332772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de14f31-280f-419b-a97c-ef14b07a170a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:57.334416 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8de14f31-280f-419b-a97c-ef14b07a170a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:57.407685 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de14f31-280f-419b-a97c-ef14b07a170a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:57.412039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9aad0ce-adb9-409a-a91d-78fa43eb1395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:57.413291 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aad0ce-adb9-409a-a91d-78fa43eb1395 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:57.413567 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aad0ce-adb9-409a-a91d-78fa43eb1395 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:57.413867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9aad0ce-adb9-409a-a91d-78fa43eb1395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:57.423575 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aad0ce-adb9-409a-a91d-78fa43eb1395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:57.425669 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9aad0ce-adb9-409a-a91d-78fa43eb1395 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:57.438108 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1071/2120] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:03:57.977419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fcdf1-b74c-4038-881a-79282de623c1 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:57.978922 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0e4fcdf1-b74c-4038-881a-79282de623c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:57.991407 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4fcdf1-b74c-4038-881a-79282de623c1 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:58.006700 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25d866a-0d98-46fa-85a8-b2a7d2f4c6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:58.007379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d866a-0d98-46fa-85a8-b2a7d2f4c6c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:58.007700 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d866a-0d98-46fa-85a8-b2a7d2f4c6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:58.007939 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25d866a-0d98-46fa-85a8-b2a7d2f4c6c3 admin admin] PATH_INFO: `/v3/projects/21dd70c310494f51b6cc93f3d19f5449` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:58.009208 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d866a-0d98-46fa-85a8-b2a7d2f4c6c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21dd70c310494f51b6cc93f3d19f5449)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:58.011248 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25d866a-0d98-46fa-85a8-b2a7d2f4c6c3 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:58.132534 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e25d866a-0d98-46fa-85a8-b2a7d2f4c6c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21dd70c310494f51b6cc93f3d19f5449', 'request_id': 'req-e25d866a-0d98-46fa-85a8-b2a7d2f4c6c3'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:58.156947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e25d866a-0d98-46fa-85a8-b2a7d2f4c6c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21dd70c310494f51b6cc93f3d19f5449', 'request_id': 'req-e25d866a-0d98-46fa-85a8-b2a7d2f4c6c3'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:58.166169 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e25d866a-0d98-46fa-85a8-b2a7d2f4c6c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21dd70c310494f51b6cc93f3d19f5449', 'request_id': 'req-e25d866a-0d98-46fa-85a8-b2a7d2f4c6c3'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:58.246656 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e25d866a-0d98-46fa-85a8-b2a7d2f4c6c3 admin admin] The token cache is being invalidate because project 21dd70c310494f51b6cc93f3d19f5449 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:03:58.247197 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e25d866a-0d98-46fa-85a8-b2a7d2f4c6c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:58.248138 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e25d866a-0d98-46fa-85a8-b2a7d2f4c6c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:03:58.255191 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c2e93-4c36-4a85-b822-79e26ae888b3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:58.257214 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c2e93-4c36-4a85-b822-79e26ae888b3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:58.257585 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8c2e93-4c36-4a85-b822-79e26ae888b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:58.260699 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1050/2121] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:03:57 2022] DELETE /identity/v3/projects/21dd70c310494f51b6cc93f3d19f5449 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:58.280271 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4e8c2e93-4c36-4a85-b822-79e26ae888b3 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:58.281529 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4e8c2e93-4c36-4a85-b822-79e26ae888b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:58.377148 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1072/2122] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:58.384736 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ee65d-2b8b-4b3b-8f6d-3fed0ce3fa74 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:58.385023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ee65d-2b8b-4b3b-8f6d-3fed0ce3fa74 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:58.385322 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79ee65d-2b8b-4b3b-8f6d-3fed0ce3fa74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:58.406555 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e79ee65d-2b8b-4b3b-8f6d-3fed0ce3fa74 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:58.408060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e79ee65d-2b8b-4b3b-8f6d-3fed0ce3fa74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:58.417309 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1051/2123] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:58.423001 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c2e93-4c36-4a85-b822-79e26ae888b3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:58.434139 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8c2e93-4c36-4a85-b822-79e26ae888b3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:58.438757 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e090f-0305-4a7d-b627-5ebdd9d0a4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:58.439363 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e090f-0305-4a7d-b627-5ebdd9d0a4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:58.439641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e090f-0305-4a7d-b627-5ebdd9d0a4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:58.439909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93e090f-0305-4a7d-b627-5ebdd9d0a4f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:58.440551 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e090f-0305-4a7d-b627-5ebdd9d0a4f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:03:58.440850 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e090f-0305-4a7d-b627-5ebdd9d0a4f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:58.442475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93e090f-0305-4a7d-b627-5ebdd9d0a4f5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:58.445468 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:58.455198 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1073/2124] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:03:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:03:58.462606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ee65d-2b8b-4b3b-8f6d-3fed0ce3fa74 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:58.473629 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79ee65d-2b8b-4b3b-8f6d-3fed0ce3fa74 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:58.479904 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460a42f-abf5-41fd-8645-ef5cb4aa0c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:58.480563 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460a42f-abf5-41fd-8645-ef5cb4aa0c6d admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:58.480906 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460a42f-abf5-41fd-8645-ef5cb4aa0c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:58.481247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3460a42f-abf5-41fd-8645-ef5cb4aa0c6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:58.481985 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460a42f-abf5-41fd-8645-ef5cb4aa0c6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:58.484062 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3460a42f-abf5-41fd-8645-ef5cb4aa0c6d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:58.584354 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1052/2125] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:03:58 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:58.588689 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e090f-0305-4a7d-b627-5ebdd9d0a4f5 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:58.611149 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93e090f-0305-4a7d-b627-5ebdd9d0a4f5 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:58.682879 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e01b48-9c77-48c7-b9cb-a1928c9a299e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:58.683497 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e01b48-9c77-48c7-b9cb-a1928c9a299e admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:58.683774 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e01b48-9c77-48c7-b9cb-a1928c9a299e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:58.684082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e01b48-9c77-48c7-b9cb-a1928c9a299e admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:58.684714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e01b48-9c77-48c7-b9cb-a1928c9a299e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:58.686860 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e01b48-9c77-48c7-b9cb-a1928c9a299e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:58.787565 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1074/2126] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:03:58 2022] POST /identity/v3/users => generated 287 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:03:58.791783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460a42f-abf5-41fd-8645-ef5cb4aa0c6d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:58.803209 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3460a42f-abf5-41fd-8645-ef5cb4aa0c6d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:58.808207 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a349432-3c61-4d87-92ea-49e4c730995e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:58.808886 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a349432-3c61-4d87-92ea-49e4c730995e admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:58.809329 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a349432-3c61-4d87-92ea-49e4c730995e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:58.809670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a349432-3c61-4d87-92ea-49e4c730995e admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:58.810391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a349432-3c61-4d87-92ea-49e4c730995e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:58.812157 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a349432-3c61-4d87-92ea-49e4c730995e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:58.824338 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1053/2127] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:03:58.828535 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e01b48-9c77-48c7-b9cb-a1928c9a299e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:58.844426 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e01b48-9c77-48c7-b9cb-a1928c9a299e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:58.849648 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88613d02-4604-4266-9364-9831fb296434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:58.850336 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88613d02-4604-4266-9364-9831fb296434 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:58.850624 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88613d02-4604-4266-9364-9831fb296434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:58.850881 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88613d02-4604-4266-9364-9831fb296434 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:58.851532 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88613d02-4604-4266-9364-9831fb296434 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:58.853140 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88613d02-4604-4266-9364-9831fb296434 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:58.864638 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1075/2128] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:03:58 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:03:58.869417 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a349432-3c61-4d87-92ea-49e4c730995e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:58.879426 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a349432-3c61-4d87-92ea-49e4c730995e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:58.886369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc7abb-0457-4e39-8795-b437e7632590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:58.888379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc7abb-0457-4e39-8795-b437e7632590 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:58.889008 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc7abb-0457-4e39-8795-b437e7632590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:58.889388 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc7abb-0457-4e39-8795-b437e7632590 admin admin] PATH_INFO: `/v3/projects/2b8cb304a0b342f68b95bfb7cdf73e4b/users/37f4356eec7f4b878e7ff145db378f61/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:58.902629 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:03:58.909885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc7abb-0457-4e39-8795-b437e7632590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b8cb304a0b342f68b95bfb7cdf73e4b, user_id=37f4356eec7f4b878e7ff145db378f61, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:58.916973 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc7abb-0457-4e39-8795-b437e7632590 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:58.993435 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1054/2129] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:03:58 2022] PUT /identity/v3/projects/2b8cb304a0b342f68b95bfb7cdf73e4b/users/37f4356eec7f4b878e7ff145db378f61/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:03:58.999098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15386ab7-ca06-4001-a768-c6f2b21a3305 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:58.999384 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15386ab7-ca06-4001-a768-c6f2b21a3305 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:58.999654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15386ab7-ca06-4001-a768-c6f2b21a3305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:59.019827 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-15386ab7-ca06-4001-a768-c6f2b21a3305 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:03:59.021149 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-15386ab7-ca06-4001-a768-c6f2b21a3305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:59.092407 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1076/2130] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:03:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:03:59.102308 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc7abb-0457-4e39-8795-b437e7632590 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:03:59.104030 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4bcc7abb-0457-4e39-8795-b437e7632590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:03:59.162472 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc7abb-0457-4e39-8795-b437e7632590 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:03:59.166671 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5bb89-36a3-48d8-b4e0-59bc8d38141d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:03:59.167293 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5bb89-36a3-48d8-b4e0-59bc8d38141d service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:03:59.167576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5bb89-36a3-48d8-b4e0-59bc8d38141d service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:03:59.167851 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5bb89-36a3-48d8-b4e0-59bc8d38141d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:03:59.177277 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5bb89-36a3-48d8-b4e0-59bc8d38141d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:03:59.179554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5bb89-36a3-48d8-b4e0-59bc8d38141d service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:03:59.193263 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1055/2131] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:03:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:01.255657 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7eba08-84a2-4da2-9b8e-d501f3ff54b9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:01.257029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7eba08-84a2-4da2-9b8e-d501f3ff54b9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:01.257029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7eba08-84a2-4da2-9b8e-d501f3ff54b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:01.289465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-da7eba08-84a2-4da2-9b8e-d501f3ff54b9 None None] MFA Rules not processed for user `37f4356eec7f4b878e7ff145db378f61`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:01.290921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-da7eba08-84a2-4da2-9b8e-d501f3ff54b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:01.393123 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1077/2132] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:04:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:01.406386 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5bb89-36a3-48d8-b4e0-59bc8d38141d service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:01.407817 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-82f5bb89-36a3-48d8-b4e0-59bc8d38141d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:01.490830 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5bb89-36a3-48d8-b4e0-59bc8d38141d service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:01.499797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68723305-91f5-45d6-8ef8-60145520092a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:01.500557 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68723305-91f5-45d6-8ef8-60145520092a service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:01.500844 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68723305-91f5-45d6-8ef8-60145520092a service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:01.501121 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68723305-91f5-45d6-8ef8-60145520092a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:01.510724 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68723305-91f5-45d6-8ef8-60145520092a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:01.512151 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68723305-91f5-45d6-8ef8-60145520092a service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:01.521426 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1056/2133] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:04.359304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7e27c-e77c-4df5-a6e4-70d8b0ff04e4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:04.360232 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7e27c-e77c-4df5-a6e4-70d8b0ff04e4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:04.360762 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7e27c-e77c-4df5-a6e4-70d8b0ff04e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:04.370108 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:04.382105 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-03d7e27c-e77c-4df5-a6e4-70d8b0ff04e4 None None] MFA Rules not processed for user `37f4356eec7f4b878e7ff145db378f61`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:04.383314 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-03d7e27c-e77c-4df5-a6e4-70d8b0ff04e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:04.390409 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1078/2134] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:04:04 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:11.517027 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=57,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:14.420520 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:30.737661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68723305-91f5-45d6-8ef8-60145520092a service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:30.740120 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-68723305-91f5-45d6-8ef8-60145520092a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:30.755193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68723305-91f5-45d6-8ef8-60145520092a service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:30.759857 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe016bf0-e5e5-48f0-8221-835d1caf1acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:30.760570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe016bf0-e5e5-48f0-8221-835d1caf1acf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:30.760857 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe016bf0-e5e5-48f0-8221-835d1caf1acf admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:30.761130 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe016bf0-e5e5-48f0-8221-835d1caf1acf admin admin] PATH_INFO: `/v3/users/79970acced8841b9a10ad247a726d716` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:30.762426 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe016bf0-e5e5-48f0-8221-835d1caf1acf admin admin] RBAC: Authorizing `identity:delete_user(user_id=79970acced8841b9a10ad247a726d716)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:30.764610 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe016bf0-e5e5-48f0-8221-835d1caf1acf admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:31.392999 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-fe016bf0-e5e5-48f0-8221-835d1caf1acf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79970acced8841b9a10ad247a726d716'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:31.442603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-fe016bf0-e5e5-48f0-8221-835d1caf1acf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79970acced8841b9a10ad247a726d716'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:31.458346 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-fe016bf0-e5e5-48f0-8221-835d1caf1acf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79970acced8841b9a10ad247a726d716'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:31.459711 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-fe016bf0-e5e5-48f0-8221-835d1caf1acf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79970acced8841b9a10ad247a726d716'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:31.467558 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-fe016bf0-e5e5-48f0-8221-835d1caf1acf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79970acced8841b9a10ad247a726d716'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:31.474314 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1057/2135] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:04:30 2022] DELETE /identity/v3/users/79970acced8841b9a10ad247a726d716 => generated 0 bytes in 737 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:31.479207 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8153e-4e36-4045-9e03-5e5e34c476fa None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:31.479661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8153e-4e36-4045-9e03-5e5e34c476fa None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:31.479862 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d8153e-4e36-4045-9e03-5e5e34c476fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:31.499960 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f9d8153e-4e36-4045-9e03-5e5e34c476fa None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:31.501165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f9d8153e-4e36-4045-9e03-5e5e34c476fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:31.566538 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1079/2136] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:04:31.578033 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe016bf0-e5e5-48f0-8221-835d1caf1acf admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:31.579547 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-fe016bf0-e5e5-48f0-8221-835d1caf1acf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:31.638834 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe016bf0-e5e5-48f0-8221-835d1caf1acf admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:31.642559 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433f275-6411-4aa3-a934-e7b68bf60bad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:31.643165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433f275-6411-4aa3-a934-e7b68bf60bad service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:31.643442 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433f275-6411-4aa3-a934-e7b68bf60bad service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:31.643710 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433f275-6411-4aa3-a934-e7b68bf60bad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:31.654044 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433f275-6411-4aa3-a934-e7b68bf60bad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:31.654598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433f275-6411-4aa3-a934-e7b68bf60bad service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:31.664606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1058/2137] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:32.067368 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8153e-4e36-4045-9e03-5e5e34c476fa None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:32.069508 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f9d8153e-4e36-4045-9e03-5e5e34c476fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:32.105388 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d8153e-4e36-4045-9e03-5e5e34c476fa None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:32.113171 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad51533-2975-40a8-86a8-e49819815ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:32.114277 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad51533-2975-40a8-86a8-e49819815ccf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:32.114868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad51533-2975-40a8-86a8-e49819815ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:32.115479 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad51533-2975-40a8-86a8-e49819815ccf admin admin] PATH_INFO: `/v3/projects/023ce91dee964588885605721a474fa2` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:32.117165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad51533-2975-40a8-86a8-e49819815ccf admin admin] RBAC: Authorizing `identity:delete_project(project_id=023ce91dee964588885605721a474fa2)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:32.120511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad51533-2975-40a8-86a8-e49819815ccf admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:32.209330 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9ad51533-2975-40a8-86a8-e49819815ccf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '023ce91dee964588885605721a474fa2', 'request_id': 'req-9ad51533-2975-40a8-86a8-e49819815ccf'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:32.293606 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9ad51533-2975-40a8-86a8-e49819815ccf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '023ce91dee964588885605721a474fa2', 'request_id': 'req-9ad51533-2975-40a8-86a8-e49819815ccf'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:32.300153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9ad51533-2975-40a8-86a8-e49819815ccf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '023ce91dee964588885605721a474fa2', 'request_id': 'req-9ad51533-2975-40a8-86a8-e49819815ccf'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:32.313794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9ad51533-2975-40a8-86a8-e49819815ccf admin admin] The token cache is being invalidate because project 023ce91dee964588885605721a474fa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:04:32.314577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9ad51533-2975-40a8-86a8-e49819815ccf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:32.315554 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9ad51533-2975-40a8-86a8-e49819815ccf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:32.317307 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1080/2138] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:04:32 2022] DELETE /identity/v3/projects/023ce91dee964588885605721a474fa2 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:32.325126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1da2f-208a-45d5-b0f3-fec9044ae3ca None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:32.325126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1da2f-208a-45d5-b0f3-fec9044ae3ca None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:32.325126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab1da2f-208a-45d5-b0f3-fec9044ae3ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:32.342942 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-eab1da2f-208a-45d5-b0f3-fec9044ae3ca None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:32.344491 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-eab1da2f-208a-45d5-b0f3-fec9044ae3ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:32.431226 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1059/2139] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:32.443934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c765a-64b2-4815-8565-3ddb2d3a6484 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:32.444148 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c765a-64b2-4815-8565-3ddb2d3a6484 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:32.444418 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096c765a-64b2-4815-8565-3ddb2d3a6484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:32.465415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-096c765a-64b2-4815-8565-3ddb2d3a6484 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:32.466723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-096c765a-64b2-4815-8565-3ddb2d3a6484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:32.475784 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1081/2140] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:32.479956 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1da2f-208a-45d5-b0f3-fec9044ae3ca None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:32.491491 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab1da2f-208a-45d5-b0f3-fec9044ae3ca None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:32.510470 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c7c26-25e3-4e74-aa7c-fe8d7a94f3b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:32.511129 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c7c26-25e3-4e74-aa7c-fe8d7a94f3b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:32.511437 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c7c26-25e3-4e74-aa7c-fe8d7a94f3b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:32.511709 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83c7c26-25e3-4e74-aa7c-fe8d7a94f3b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:32.512386 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c7c26-25e3-4e74-aa7c-fe8d7a94f3b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:04:32.512688 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c7c26-25e3-4e74-aa7c-fe8d7a94f3b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:32.514440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83c7c26-25e3-4e74-aa7c-fe8d7a94f3b8 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:32.531350 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1060/2141] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:04:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:04:32.532188 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c765a-64b2-4815-8565-3ddb2d3a6484 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:32.542371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096c765a-64b2-4815-8565-3ddb2d3a6484 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:32.548826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea31806-1893-408c-bef4-6babb3d39416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:32.551912 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea31806-1893-408c-bef4-6babb3d39416 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:32.551912 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea31806-1893-408c-bef4-6babb3d39416 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:32.551912 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea31806-1893-408c-bef4-6babb3d39416 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:32.551912 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea31806-1893-408c-bef4-6babb3d39416 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:32.554705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea31806-1893-408c-bef4-6babb3d39416 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:32.686086 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1082/2142] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:04:32 2022] POST /identity/v3/projects => generated 397 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:04:32.690171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c7c26-25e3-4e74-aa7c-fe8d7a94f3b8 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:32.695365 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:32.700167 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83c7c26-25e3-4e74-aa7c-fe8d7a94f3b8 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:32.766670 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683d443-ecbe-4f99-b8c6-54f976f9b611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:32.767281 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683d443-ecbe-4f99-b8c6-54f976f9b611 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:32.767560 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683d443-ecbe-4f99-b8c6-54f976f9b611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:32.767832 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8683d443-ecbe-4f99-b8c6-54f976f9b611 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:32.768608 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683d443-ecbe-4f99-b8c6-54f976f9b611 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:32.772783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8683d443-ecbe-4f99-b8c6-54f976f9b611 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:32.871280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1061/2143] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:04:32 2022] POST /identity/v3/users => generated 299 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:32.875797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea31806-1893-408c-bef4-6babb3d39416 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:32.887145 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea31806-1893-408c-bef4-6babb3d39416 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:32.891891 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9bfcc-9db0-43f0-ae34-68f2e613e614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:32.892752 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9bfcc-9db0-43f0-ae34-68f2e613e614 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:32.893031 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9bfcc-9db0-43f0-ae34-68f2e613e614 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:32.893299 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9bfcc-9db0-43f0-ae34-68f2e613e614 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:32.894306 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9bfcc-9db0-43f0-ae34-68f2e613e614 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:32.896178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9bfcc-9db0-43f0-ae34-68f2e613e614 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:32.907538 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1083/2144] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:32.911545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683d443-ecbe-4f99-b8c6-54f976f9b611 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:32.922162 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8683d443-ecbe-4f99-b8c6-54f976f9b611 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:32.927052 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2be26f-daf7-4f19-ad57-f5b7146ed180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:32.927881 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2be26f-daf7-4f19-ad57-f5b7146ed180 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:32.928576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2be26f-daf7-4f19-ad57-f5b7146ed180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:32.928905 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2be26f-daf7-4f19-ad57-f5b7146ed180 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:32.929544 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2be26f-daf7-4f19-ad57-f5b7146ed180 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:32.931271 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2be26f-daf7-4f19-ad57-f5b7146ed180 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:32.942906 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1062/2145] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:32.947668 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9bfcc-9db0-43f0-ae34-68f2e613e614 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:32.958395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9bfcc-9db0-43f0-ae34-68f2e613e614 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:32.963901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b566f83-6168-4b5f-945c-d74668f7fcb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:32.967599 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b566f83-6168-4b5f-945c-d74668f7fcb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:32.967599 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b566f83-6168-4b5f-945c-d74668f7fcb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:32.967599 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b566f83-6168-4b5f-945c-d74668f7fcb0 admin admin] PATH_INFO: `/v3/projects/0908bc5331e14c618d79dcbde1c0204b/users/364954724f5f4dd192478756c2d4b8ce/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:32.980561 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b566f83-6168-4b5f-945c-d74668f7fcb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0908bc5331e14c618d79dcbde1c0204b, user_id=364954724f5f4dd192478756c2d4b8ce, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:32.983344 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b566f83-6168-4b5f-945c-d74668f7fcb0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:33.076609 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1084/2146] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:32 2022] PUT /identity/v3/projects/0908bc5331e14c618d79dcbde1c0204b/users/364954724f5f4dd192478756c2d4b8ce/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:04:33.088632 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b071c0-3c44-4269-97d6-20e598a093a2 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:33.094270 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b071c0-3c44-4269-97d6-20e598a093a2 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:33.094270 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b071c0-3c44-4269-97d6-20e598a093a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:33.117046 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-65b071c0-3c44-4269-97d6-20e598a093a2 None None] MFA Rules not processed for user `364954724f5f4dd192478756c2d4b8ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:33.119608 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-65b071c0-3c44-4269-97d6-20e598a093a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:33.183008 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1063/2147] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:04:33 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:04:33.194891 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b566f83-6168-4b5f-945c-d74668f7fcb0 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:33.199845 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5b566f83-6168-4b5f-945c-d74668f7fcb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:33.219541 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:33.253723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b566f83-6168-4b5f-945c-d74668f7fcb0 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:33.257819 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404247e2-39e4-4c0b-bf70-b7d631859ac5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:33.258617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404247e2-39e4-4c0b-bf70-b7d631859ac5 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:33.259075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404247e2-39e4-4c0b-bf70-b7d631859ac5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:33.259700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404247e2-39e4-4c0b-bf70-b7d631859ac5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:33.267763 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404247e2-39e4-4c0b-bf70-b7d631859ac5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:33.269171 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404247e2-39e4-4c0b-bf70-b7d631859ac5 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:33.278420 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1085/2148] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:33 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:36.323262 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1585ed6-7fb7-4546-b88e-f5a547fd3ad3 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:36.323794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1585ed6-7fb7-4546-b88e-f5a547fd3ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:36.323794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1585ed6-7fb7-4546-b88e-f5a547fd3ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:36.349998 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-a1585ed6-7fb7-4546-b88e-f5a547fd3ad3 None None] MFA Rules not processed for user `c83ccb0008d04b4f98c05915e5748713`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:36.350997 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a1585ed6-7fb7-4546-b88e-f5a547fd3ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:36.411391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1064/2149] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:04:36 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:04:39.268329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404247e2-39e4-4c0b-bf70-b7d631859ac5 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:39.360911 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404247e2-39e4-4c0b-bf70-b7d631859ac5 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:39.368982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c5cac-508c-436e-9c88-e0e68be57f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:39.370291 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c5cac-508c-436e-9c88-e0e68be57f6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:39.370700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c5cac-508c-436e-9c88-e0e68be57f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:39.371008 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8c5cac-508c-436e-9c88-e0e68be57f6a admin admin] PATH_INFO: `/v3/users/364954724f5f4dd192478756c2d4b8ce` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:39.372266 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c5cac-508c-436e-9c88-e0e68be57f6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=364954724f5f4dd192478756c2d4b8ce)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:39.374529 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8c5cac-508c-436e-9c88-e0e68be57f6a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:39.581636 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3a8c5cac-508c-436e-9c88-e0e68be57f6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '364954724f5f4dd192478756c2d4b8ce'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:39.641433 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3a8c5cac-508c-436e-9c88-e0e68be57f6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '364954724f5f4dd192478756c2d4b8ce'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:39.655661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3a8c5cac-508c-436e-9c88-e0e68be57f6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '364954724f5f4dd192478756c2d4b8ce'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:39.659261 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3a8c5cac-508c-436e-9c88-e0e68be57f6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '364954724f5f4dd192478756c2d4b8ce'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:39.664290 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3a8c5cac-508c-436e-9c88-e0e68be57f6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '364954724f5f4dd192478756c2d4b8ce'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:39.670512 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1086/2150] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:04:39 2022] DELETE /identity/v3/users/364954724f5f4dd192478756c2d4b8ce => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:39.674983 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853aeb4-ffa9-4f11-8eb6-2c3497ba51d6 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:39.675481 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853aeb4-ffa9-4f11-8eb6-2c3497ba51d6 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:39.675576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7853aeb4-ffa9-4f11-8eb6-2c3497ba51d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:39.694797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-7853aeb4-ffa9-4f11-8eb6-2c3497ba51d6 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:39.695994 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7853aeb4-ffa9-4f11-8eb6-2c3497ba51d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:39.704916 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:39.754470 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1065/2151] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:04:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:39.764661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c5cac-508c-436e-9c88-e0e68be57f6a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:39.766100 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3a8c5cac-508c-436e-9c88-e0e68be57f6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:39.821717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:39.835038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8c5cac-508c-436e-9c88-e0e68be57f6a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:39.838740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8e7db7-8313-4889-a448-fd01680ceac3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:39.839340 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e7db7-8313-4889-a448-fd01680ceac3 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:39.839615 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e7db7-8313-4889-a448-fd01680ceac3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:39.839883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8e7db7-8313-4889-a448-fd01680ceac3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:39.849615 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e7db7-8313-4889-a448-fd01680ceac3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:39.851089 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8e7db7-8313-4889-a448-fd01680ceac3 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:39.860498 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1087/2152] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:40.363053 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853aeb4-ffa9-4f11-8eb6-2c3497ba51d6 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:40.364480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7853aeb4-ffa9-4f11-8eb6-2c3497ba51d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:40.379700 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7853aeb4-ffa9-4f11-8eb6-2c3497ba51d6 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:40.386846 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653870f0-21de-4a34-a17f-59b3a3139aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:40.387916 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653870f0-21de-4a34-a17f-59b3a3139aac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:40.389822 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653870f0-21de-4a34-a17f-59b3a3139aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:40.390158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653870f0-21de-4a34-a17f-59b3a3139aac admin admin] PATH_INFO: `/v3/projects/0908bc5331e14c618d79dcbde1c0204b` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:40.391341 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653870f0-21de-4a34-a17f-59b3a3139aac admin admin] RBAC: Authorizing `identity:delete_project(project_id=0908bc5331e14c618d79dcbde1c0204b)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:40.393252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653870f0-21de-4a34-a17f-59b3a3139aac admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:40.577125 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-653870f0-21de-4a34-a17f-59b3a3139aac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0908bc5331e14c618d79dcbde1c0204b', 'request_id': 'req-653870f0-21de-4a34-a17f-59b3a3139aac'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:40.583205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-653870f0-21de-4a34-a17f-59b3a3139aac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0908bc5331e14c618d79dcbde1c0204b', 'request_id': 'req-653870f0-21de-4a34-a17f-59b3a3139aac'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:40.595039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-653870f0-21de-4a34-a17f-59b3a3139aac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0908bc5331e14c618d79dcbde1c0204b', 'request_id': 'req-653870f0-21de-4a34-a17f-59b3a3139aac'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:40.670634 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-653870f0-21de-4a34-a17f-59b3a3139aac admin admin] The token cache is being invalidate because project 0908bc5331e14c618d79dcbde1c0204b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:04:40.670932 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-653870f0-21de-4a34-a17f-59b3a3139aac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:40.674285 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-653870f0-21de-4a34-a17f-59b3a3139aac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:04:40.674285 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1066/2153] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:04:40 2022] DELETE /identity/v3/projects/0908bc5331e14c618d79dcbde1c0204b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:40.678684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efda831-80b1-464a-844c-70c8fa1c6bd3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:40.679187 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efda831-80b1-464a-844c-70c8fa1c6bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:40.679366 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efda831-80b1-464a-844c-70c8fa1c6bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:40.699654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6efda831-80b1-464a-844c-70c8fa1c6bd3 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:40.700888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6efda831-80b1-464a-844c-70c8fa1c6bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:40.765364 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1088/2154] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:40.774057 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b08e8-c9f3-4582-a620-2295f3656a05 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:40.774595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b08e8-c9f3-4582-a620-2295f3656a05 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:40.774720 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683b08e8-c9f3-4582-a620-2295f3656a05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:40.801081 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-683b08e8-c9f3-4582-a620-2295f3656a05 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:40.802815 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-683b08e8-c9f3-4582-a620-2295f3656a05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:40.815234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1067/2155] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:40.819853 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efda831-80b1-464a-844c-70c8fa1c6bd3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:40.829777 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efda831-80b1-464a-844c-70c8fa1c6bd3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:40.834611 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bebb2d-e9d2-45c4-aa21-8c345382c9d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:40.835224 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bebb2d-e9d2-45c4-aa21-8c345382c9d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:40.835507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bebb2d-e9d2-45c4-aa21-8c345382c9d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:40.836041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bebb2d-e9d2-45c4-aa21-8c345382c9d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:40.836424 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bebb2d-e9d2-45c4-aa21-8c345382c9d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:04:40.836727 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bebb2d-e9d2-45c4-aa21-8c345382c9d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:40.838365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3bebb2d-e9d2-45c4-aa21-8c345382c9d4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:40.850754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1089/2156] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:04:40.855181 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b08e8-c9f3-4582-a620-2295f3656a05 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:40.865651 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683b08e8-c9f3-4582-a620-2295f3656a05 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:40.870483 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed493a19-d8a2-445f-bb8f-789f7b1f56b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:40.871087 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed493a19-d8a2-445f-bb8f-789f7b1f56b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:40.871368 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed493a19-d8a2-445f-bb8f-789f7b1f56b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:40.871642 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed493a19-d8a2-445f-bb8f-789f7b1f56b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:40.875097 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed493a19-d8a2-445f-bb8f-789f7b1f56b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:40.875097 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed493a19-d8a2-445f-bb8f-789f7b1f56b8 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:40.925543 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bebb2d-e9d2-45c4-aa21-8c345382c9d4 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:40.927869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b3bebb2d-e9d2-45c4-aa21-8c345382c9d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:40.983220 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1068/2157] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:04:40 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:40.984363 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed493a19-d8a2-445f-bb8f-789f7b1f56b8 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:40.988837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3bebb2d-e9d2-45c4-aa21-8c345382c9d4 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:41.061116 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2c696-71e4-420f-81e6-4389c8dd3b30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:41.061814 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2c696-71e4-420f-81e6-4389c8dd3b30 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:41.062232 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2c696-71e4-420f-81e6-4389c8dd3b30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:41.062670 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2c696-71e4-420f-81e6-4389c8dd3b30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:41.065850 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1fc2c696-71e4-420f-81e6-4389c8dd3b30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:41.077085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed493a19-d8a2-445f-bb8f-789f7b1f56b8 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:41.082676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4bc53-c710-4251-afef-a4ab4aaf7a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:41.083463 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4bc53-c710-4251-afef-a4ab4aaf7a39 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:41.083839 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4bc53-c710-4251-afef-a4ab4aaf7a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:41.084878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d4bc53-c710-4251-afef-a4ab4aaf7a39 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:41.084878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4bc53-c710-4251-afef-a4ab4aaf7a39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:41.086820 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d4bc53-c710-4251-afef-a4ab4aaf7a39 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:41.133806 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:41.156626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2c696-71e4-420f-81e6-4389c8dd3b30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:41.158118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2c696-71e4-420f-81e6-4389c8dd3b30 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:41.168388 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1090/2158] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:40 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:04:41.181427 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:41.187311 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1069/2159] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:04:40 2022] POST /identity/v3/users => generated 286 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:04:41.191312 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2c696-71e4-420f-81e6-4389c8dd3b30 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:41.203942 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2c696-71e4-420f-81e6-4389c8dd3b30 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:41.211439 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e2d90-7c84-4253-a54e-af7307bb2765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:41.212365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e2d90-7c84-4253-a54e-af7307bb2765 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:41.213294 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e2d90-7c84-4253-a54e-af7307bb2765 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:41.213643 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083e2d90-7c84-4253-a54e-af7307bb2765 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:41.214512 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e2d90-7c84-4253-a54e-af7307bb2765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:41.216136 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083e2d90-7c84-4253-a54e-af7307bb2765 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:41.231546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1091/2160] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:41.235586 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4bc53-c710-4251-afef-a4ab4aaf7a39 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:41.249489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d4bc53-c710-4251-afef-a4ab4aaf7a39 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:41.254672 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84418be4-81c3-4ed4-b0d7-955c4dc51ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:41.255478 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84418be4-81c3-4ed4-b0d7-955c4dc51ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:41.255777 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84418be4-81c3-4ed4-b0d7-955c4dc51ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:41.256054 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84418be4-81c3-4ed4-b0d7-955c4dc51ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:41.256724 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84418be4-81c3-4ed4-b0d7-955c4dc51ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:41.258404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84418be4-81c3-4ed4-b0d7-955c4dc51ed0 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:41.274727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1070/2161] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:41.275600 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e2d90-7c84-4253-a54e-af7307bb2765 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:41.284169 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083e2d90-7c84-4253-a54e-af7307bb2765 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:41.289310 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e229bdd2-8ff2-405d-bd1b-7296ff6e86d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:41.289996 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229bdd2-8ff2-405d-bd1b-7296ff6e86d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:41.290300 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229bdd2-8ff2-405d-bd1b-7296ff6e86d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:41.290803 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e229bdd2-8ff2-405d-bd1b-7296ff6e86d3 admin admin] PATH_INFO: `/v3/projects/edd4fa1455a647eca8e63a16b9ab0751/users/daa43ab7e8df457ea1540de347575a35/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:41.306059 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229bdd2-8ff2-405d-bd1b-7296ff6e86d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edd4fa1455a647eca8e63a16b9ab0751, user_id=daa43ab7e8df457ea1540de347575a35, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:41.308692 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e229bdd2-8ff2-405d-bd1b-7296ff6e86d3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:41.386166 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aa34b-1d08-4b50-9207-c4d411a10fc3 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:41.386470 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aa34b-1d08-4b50-9207-c4d411a10fc3 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:41.386731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5aa34b-1d08-4b50-9207-c4d411a10fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:41.402324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1092/2162] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:41 2022] PUT /identity/v3/projects/edd4fa1455a647eca8e63a16b9ab0751/users/daa43ab7e8df457ea1540de347575a35/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:41.407215 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9d03a-f395-4a55-bd20-8bfe1c8cd04f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:41.407502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9d03a-f395-4a55-bd20-8bfe1c8cd04f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:41.407911 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d9d03a-f395-4a55-bd20-8bfe1c8cd04f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:41.408327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-ab5aa34b-1d08-4b50-9207-c4d411a10fc3 None None] MFA Rules not processed for user `37f4356eec7f4b878e7ff145db378f61`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:41.410263 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ab5aa34b-1d08-4b50-9207-c4d411a10fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:41.430078 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d5d9d03a-f395-4a55-bd20-8bfe1c8cd04f None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:41.435205 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d5d9d03a-f395-4a55-bd20-8bfe1c8cd04f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:41.498395 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1071/2163] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:04:41 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:04:41.522129 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1093/2164] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:04:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:41.550662 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5aa34b-1d08-4b50-9207-c4d411a10fc3 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:41.553897 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ab5aa34b-1d08-4b50-9207-c4d411a10fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:41.622727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5aa34b-1d08-4b50-9207-c4d411a10fc3 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:41.626866 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1e595-c04e-4b93-8b9c-b4f5e23f3e1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:41.627617 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1e595-c04e-4b93-8b9c-b4f5e23f3e1a service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:41.627894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1e595-c04e-4b93-8b9c-b4f5e23f3e1a service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:41.628166 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1e595-c04e-4b93-8b9c-b4f5e23f3e1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:41.638838 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1e595-c04e-4b93-8b9c-b4f5e23f3e1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:41.640312 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab1e595-c04e-4b93-8b9c-b4f5e23f3e1a service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:41.650920 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1072/2165] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:04:49.545427 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fbf94-0d6d-4d02-be25-cbf99896c8f1 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:49.545940 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fbf94-0d6d-4d02-be25-cbf99896c8f1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:49.546082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2fbf94-0d6d-4d02-be25-cbf99896c8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:49.583414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-cd2fbf94-0d6d-4d02-be25-cbf99896c8f1 None None] MFA Rules not processed for user `daa43ab7e8df457ea1540de347575a35`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:49.584811 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cd2fbf94-0d6d-4d02-be25-cbf99896c8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:49.676025 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1094/2166] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:04:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:49.676347 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1e595-c04e-4b93-8b9c-b4f5e23f3e1a service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:49.687736 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1e595-c04e-4b93-8b9c-b4f5e23f3e1a service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:49.693609 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79d05b-e803-47cf-ac64-c9052b6b598f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:49.694269 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79d05b-e803-47cf-ac64-c9052b6b598f admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:49.697279 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79d05b-e803-47cf-ac64-c9052b6b598f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:49.697279 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d79d05b-e803-47cf-ac64-c9052b6b598f admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:49.697279 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79d05b-e803-47cf-ac64-c9052b6b598f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:49.697524 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d79d05b-e803-47cf-ac64-c9052b6b598f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:49.781123 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1073/2167] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:04:49 2022] POST /identity/v3/projects => generated 373 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:04:49.785078 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fbf94-0d6d-4d02-be25-cbf99896c8f1 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:49.803600 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2fbf94-0d6d-4d02-be25-cbf99896c8f1 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:49.854330 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:49.940662 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adb881-8902-4fcc-b3b5-9f108be801a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:49.941521 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adb881-8902-4fcc-b3b5-9f108be801a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:49.941979 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adb881-8902-4fcc-b3b5-9f108be801a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:49.943840 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81adb881-8902-4fcc-b3b5-9f108be801a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:49.944865 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81adb881-8902-4fcc-b3b5-9f108be801a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:49.947197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81adb881-8902-4fcc-b3b5-9f108be801a2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:50.104301 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1095/2168] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:04:49 2022] POST /identity/v3/users => generated 293 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:04:50.108113 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79d05b-e803-47cf-ac64-c9052b6b598f admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:50.121793 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d79d05b-e803-47cf-ac64-c9052b6b598f admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:50.134483 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69063b-3801-4301-b802-c3b76cfa9bf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:50.139972 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69063b-3801-4301-b802-c3b76cfa9bf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:50.139972 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69063b-3801-4301-b802-c3b76cfa9bf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:50.139972 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa69063b-3801-4301-b802-c3b76cfa9bf6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:50.139972 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69063b-3801-4301-b802-c3b76cfa9bf6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:50.139972 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa69063b-3801-4301-b802-c3b76cfa9bf6 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:50.152344 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1074/2169] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:04:50.157040 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adb881-8902-4fcc-b3b5-9f108be801a2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:50.167837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81adb881-8902-4fcc-b3b5-9f108be801a2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:50.172996 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d254981-a74a-420f-9a13-939feda9ef7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:50.174043 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d254981-a74a-420f-9a13-939feda9ef7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:50.174310 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d254981-a74a-420f-9a13-939feda9ef7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:50.174590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d254981-a74a-420f-9a13-939feda9ef7b admin admin] PATH_INFO: `/v3/projects/469dc0563e1e4d07b631dbdf249d4bb1/users/d455fd45d43c4945ac1106b62ca65d7f/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:50.194539 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d254981-a74a-420f-9a13-939feda9ef7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=469dc0563e1e4d07b631dbdf249d4bb1, user_id=d455fd45d43c4945ac1106b62ca65d7f, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:50.197306 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d254981-a74a-420f-9a13-939feda9ef7b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:50.271666 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1096/2170] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:50 2022] PUT /identity/v3/projects/469dc0563e1e4d07b631dbdf249d4bb1/users/d455fd45d43c4945ac1106b62ca65d7f/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:04:50.279893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69063b-3801-4301-b802-c3b76cfa9bf6 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:50.286890 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa69063b-3801-4301-b802-c3b76cfa9bf6 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:50.358568 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efb33fc-7d05-4d5c-a74c-fdf3e37fc63b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:50.359103 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb33fc-7d05-4d5c-a74c-fdf3e37fc63b admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:50.359381 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb33fc-7d05-4d5c-a74c-fdf3e37fc63b admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:50.359722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efb33fc-7d05-4d5c-a74c-fdf3e37fc63b admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:50.360294 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb33fc-7d05-4d5c-a74c-fdf3e37fc63b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:50.361953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efb33fc-7d05-4d5c-a74c-fdf3e37fc63b admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:50.370150 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:04:50.379230 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d254981-a74a-420f-9a13-939feda9ef7b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:50.379433 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1075/2171] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:04:50 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:04:50.395328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d254981-a74a-420f-9a13-939feda9ef7b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:50.403477 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e5fe0-dad4-4f9f-abde-f607a5c2edd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:50.404156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e5fe0-dad4-4f9f-abde-f607a5c2edd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:50.404432 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e5fe0-dad4-4f9f-abde-f607a5c2edd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:50.404700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e5fe0-dad4-4f9f-abde-f607a5c2edd3 admin admin] PATH_INFO: `/v3/projects/469dc0563e1e4d07b631dbdf249d4bb1/users/d455fd45d43c4945ac1106b62ca65d7f/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:50.406733 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e5fe0-dad4-4f9f-abde-f607a5c2edd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=469dc0563e1e4d07b631dbdf249d4bb1, user_id=d455fd45d43c4945ac1106b62ca65d7f, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:50.409593 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e5fe0-dad4-4f9f-abde-f607a5c2edd3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:50.421771 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1097/2172] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:04:50 2022] PUT /identity/v3/projects/469dc0563e1e4d07b631dbdf249d4bb1/users/d455fd45d43c4945ac1106b62ca65d7f/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:04:56.636661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b43e51-d859-4ddc-8e61-d23c39e64681 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:56.637272 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b43e51-d859-4ddc-8e61-d23c39e64681 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:56.637272 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b43e51-d859-4ddc-8e61-d23c39e64681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:56.676262 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-70b43e51-d859-4ddc-8e61-d23c39e64681 None None] MFA Rules not processed for user `d455fd45d43c4945ac1106b62ca65d7f`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:04:56.677591 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-70b43e51-d859-4ddc-8e61-d23c39e64681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:56.759020 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1076/2173] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:04:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:04:56.772399 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e5fe0-dad4-4f9f-abde-f607a5c2edd3 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:04:56.774225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-295e5fe0-dad4-4f9f-abde-f607a5c2edd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:04:56.854705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e5fe0-dad4-4f9f-abde-f607a5c2edd3 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:04:56.875613 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456c5179-142b-4103-b19e-6be9ff7b2462 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:04:56.878549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c5179-142b-4103-b19e-6be9ff7b2462 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:04:56.878549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c5179-142b-4103-b19e-6be9ff7b2462 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:04:56.878816 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456c5179-142b-4103-b19e-6be9ff7b2462 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:04:56.938839 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c5179-142b-4103-b19e-6be9ff7b2462 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:04:56.940425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456c5179-142b-4103-b19e-6be9ff7b2462 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:04:56.950486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1098/2174] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:04:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:00.048381 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9eccb8-7dde-4596-aba3-9eef21dbd92c None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:00.048944 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9eccb8-7dde-4596-aba3-9eef21dbd92c None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:00.049133 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9eccb8-7dde-4596-aba3-9eef21dbd92c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:00.080162 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-7c9eccb8-7dde-4596-aba3-9eef21dbd92c None None] MFA Rules not processed for user `daa43ab7e8df457ea1540de347575a35`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:00.081377 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7c9eccb8-7dde-4596-aba3-9eef21dbd92c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:00.091508 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1077/2175] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:05:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:00.533350 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7a59d-79a1-4b29-ad95-8aefd02e8eb7 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:00.533892 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7a59d-79a1-4b29-ad95-8aefd02e8eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:00.533976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb7a59d-79a1-4b29-ad95-8aefd02e8eb7 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:00.536122 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1099/2176] 10.222.0.59 () {54 vars in 961 bytes} [Tue Sep 13 20:05:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:05:00.541152 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbcc02-5d55-4606-9733-450515dbe9a4 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:00.541441 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbcc02-5d55-4606-9733-450515dbe9a4 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:00.541742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cbcc02-5d55-4606-9733-450515dbe9a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:00.564269 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-51cbcc02-5d55-4606-9733-450515dbe9a4 None None] MFA Rules not processed for user `89e7df5170c841abb449f3b4a547ec4d`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:00.565707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-51cbcc02-5d55-4606-9733-450515dbe9a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:00.649223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1078/2177] 10.222.0.59 () {58 vars in 1058 bytes} [Tue Sep 13 20:05:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:00.656804 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7a59d-79a1-4b29-ad95-8aefd02e8eb7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:00.682271 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb7a59d-79a1-4b29-ad95-8aefd02e8eb7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:00.697869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2df5f-f169-467c-8c3c-2569b327faf5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e7df5170c841abb449f3b4a547ec4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:00.698789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2df5f-f169-467c-8c3c-2569b327faf5 service placement] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:00.699236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2df5f-f169-467c-8c3c-2569b327faf5 service placement] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:00.699674 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b2df5f-f169-467c-8c3c-2569b327faf5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:00.702653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-39b2df5f-f169-467c-8c3c-2569b327faf5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:00.721145 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2df5f-f169-467c-8c3c-2569b327faf5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:00.722949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b2df5f-f169-467c-8c3c-2569b327faf5 service placement] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:00.738845 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1100/2178] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:09.937514 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ca92f-41b2-4efd-8277-f1b7b1989836 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:09.938064 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ca92f-41b2-4efd-8277-f1b7b1989836 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:09.938064 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7ca92f-41b2-4efd-8277-f1b7b1989836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:09.962602 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-cb7ca92f-41b2-4efd-8277-f1b7b1989836 None None] MFA Rules not processed for user `9fd7a80714874e73bf64dfa392632391`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:09.963833 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-cb7ca92f-41b2-4efd-8277-f1b7b1989836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:10.026827 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1079/2179] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Sep 13 20:05:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:05:10.081420 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2df5f-f169-467c-8c3c-2569b327faf5 service placement] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:10.081420 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-39b2df5f-f169-467c-8c3c-2569b327faf5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:10.090861 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:10.151617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b2df5f-f169-467c-8c3c-2569b327faf5 service placement] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:10.156605 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37458e1-67a6-41cc-8d74-05c630df33dd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00e78bf5e5c4db29c47dce1e87f3f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:10.157209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37458e1-67a6-41cc-8d74-05c630df33dd service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:10.157493 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37458e1-67a6-41cc-8d74-05c630df33dd service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:10.157797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37458e1-67a6-41cc-8d74-05c630df33dd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:10.168796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37458e1-67a6-41cc-8d74-05c630df33dd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:10.170550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37458e1-67a6-41cc-8d74-05c630df33dd service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:10.179345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1101/2180] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Sep 13 20:05:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:05:20.019566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=91 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:20.176020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=28 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:21.175745 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00166e6e-b647-4da7-8337-f3acc34ae475 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:21.176391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00166e6e-b647-4da7-8337-f3acc34ae475 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:21.176391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00166e6e-b647-4da7-8337-f3acc34ae475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:21.197747 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-00166e6e-b647-4da7-8337-f3acc34ae475 None None] MFA Rules not processed for user `75a27959e4354f11bcf13a1d254a6b56`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:21.199366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-00166e6e-b647-4da7-8337-f3acc34ae475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:21.277833 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1080/2181] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:05:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:30.799777 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7f85b-0e52-4393-ad11-510cef8fcc2e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:30.800361 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7f85b-0e52-4393-ad11-510cef8fcc2e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:30.800468 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa7f85b-0e52-4393-ad11-510cef8fcc2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:30.822326 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3fa7f85b-0e52-4393-ad11-510cef8fcc2e None None] MFA Rules not processed for user `9fd7a80714874e73bf64dfa392632391`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:30.823590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3fa7f85b-0e52-4393-ad11-510cef8fcc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:30.830736 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1102/2182] 10.222.0.59 () {58 vars in 967 bytes} [Tue Sep 13 20:05:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:30.843993 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00166e6e-b647-4da7-8337-f3acc34ae475 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:30.855706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00166e6e-b647-4da7-8337-f3acc34ae475 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:30.860705 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd05258-7b89-4213-9e5d-d0144fac3874 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00e78bf5e5c4db29c47dce1e87f3f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:30.861311 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd05258-7b89-4213-9e5d-d0144fac3874 service swift] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:30.861591 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd05258-7b89-4213-9e5d-d0144fac3874 service swift] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:30.861897 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd05258-7b89-4213-9e5d-d0144fac3874 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:30.870091 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd05258-7b89-4213-9e5d-d0144fac3874 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:30.871734 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd05258-7b89-4213-9e5d-d0144fac3874 service swift] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:30.883312 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1081/2183] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Sep 13 20:05:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:05:34.213026 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7f85b-0e52-4393-ad11-510cef8fcc2e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:34.214502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3fa7f85b-0e52-4393-ad11-510cef8fcc2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:34.290175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa7f85b-0e52-4393-ad11-510cef8fcc2e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:34.296781 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19a15f5-e14f-46c2-9dd6-a15273571070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:34.297570 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a15f5-e14f-46c2-9dd6-a15273571070 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:34.298027 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a15f5-e14f-46c2-9dd6-a15273571070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:34.298902 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19a15f5-e14f-46c2-9dd6-a15273571070 admin admin] PATH_INFO: `/v3/users/37f4356eec7f4b878e7ff145db378f61` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:34.299725 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a15f5-e14f-46c2-9dd6-a15273571070 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37f4356eec7f4b878e7ff145db378f61)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:34.301712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19a15f5-e14f-46c2-9dd6-a15273571070 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:34.549922 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d19a15f5-e14f-46c2-9dd6-a15273571070 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37f4356eec7f4b878e7ff145db378f61'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:34.646672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d19a15f5-e14f-46c2-9dd6-a15273571070 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37f4356eec7f4b878e7ff145db378f61'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:34.666338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d19a15f5-e14f-46c2-9dd6-a15273571070 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37f4356eec7f4b878e7ff145db378f61'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:34.667388 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d19a15f5-e14f-46c2-9dd6-a15273571070 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37f4356eec7f4b878e7ff145db378f61'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:34.675333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d19a15f5-e14f-46c2-9dd6-a15273571070 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37f4356eec7f4b878e7ff145db378f61'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:34.684658 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1103/2184] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:05:34 2022] DELETE /identity/v3/users/37f4356eec7f4b878e7ff145db378f61 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:35.121475 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd05258-7b89-4213-9e5d-d0144fac3874 service swift] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:35.138690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd05258-7b89-4213-9e5d-d0144fac3874 service swift] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:35.214658 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab62778-81c6-43a8-b53b-866b03e89c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:35.215582 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab62778-81c6-43a8-b53b-866b03e89c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:35.215862 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab62778-81c6-43a8-b53b-866b03e89c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:35.216135 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab62778-81c6-43a8-b53b-866b03e89c79 admin admin] PATH_INFO: `/v3/projects/2b8cb304a0b342f68b95bfb7cdf73e4b` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:35.217277 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab62778-81c6-43a8-b53b-866b03e89c79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b8cb304a0b342f68b95bfb7cdf73e4b)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:35.219218 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab62778-81c6-43a8-b53b-866b03e89c79 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:35.315746 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-bab62778-81c6-43a8-b53b-866b03e89c79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b8cb304a0b342f68b95bfb7cdf73e4b', 'request_id': 'req-bab62778-81c6-43a8-b53b-866b03e89c79'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:35.325209 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-bab62778-81c6-43a8-b53b-866b03e89c79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b8cb304a0b342f68b95bfb7cdf73e4b', 'request_id': 'req-bab62778-81c6-43a8-b53b-866b03e89c79'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:35.332578 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-bab62778-81c6-43a8-b53b-866b03e89c79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b8cb304a0b342f68b95bfb7cdf73e4b', 'request_id': 'req-bab62778-81c6-43a8-b53b-866b03e89c79'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:35.415184 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-bab62778-81c6-43a8-b53b-866b03e89c79 admin admin] The token cache is being invalidate because project 2b8cb304a0b342f68b95bfb7cdf73e4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:05:35.415538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-bab62778-81c6-43a8-b53b-866b03e89c79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:35.416422 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-bab62778-81c6-43a8-b53b-866b03e89c79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:05:35.422226 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1082/2185] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:05:35 2022] DELETE /identity/v3/projects/2b8cb304a0b342f68b95bfb7cdf73e4b => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:35.423888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1b4f3-1109-4640-b881-e83851cd7e0a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:35.424500 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1b4f3-1109-4640-b881-e83851cd7e0a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:35.424500 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1b4f3-1109-4640-b881-e83851cd7e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:35.444877 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-52a1b4f3-1109-4640-b881-e83851cd7e0a None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:35.446129 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-52a1b4f3-1109-4640-b881-e83851cd7e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:35.540800 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1104/2186] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:35.547117 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe52070-e9bc-4e4f-a985-86ec2c55505f None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:35.547677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe52070-e9bc-4e4f-a985-86ec2c55505f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:35.548401 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe52070-e9bc-4e4f-a985-86ec2c55505f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:35.576427 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-7fe52070-e9bc-4e4f-a985-86ec2c55505f None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:35.577920 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7fe52070-e9bc-4e4f-a985-86ec2c55505f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:35.587877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1083/2187] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:05:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:35.592001 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1b4f3-1109-4640-b881-e83851cd7e0a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:35.605264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1b4f3-1109-4640-b881-e83851cd7e0a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:35.610555 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbf5aa-de54-402f-9281-51d10c092750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:35.611253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbf5aa-de54-402f-9281-51d10c092750 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:35.611604 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbf5aa-de54-402f-9281-51d10c092750 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:35.611952 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbf5aa-de54-402f-9281-51d10c092750 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:35.612730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbf5aa-de54-402f-9281-51d10c092750 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:05:35.613098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbf5aa-de54-402f-9281-51d10c092750 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:35.615487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbf5aa-de54-402f-9281-51d10c092750 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:35.626273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:35.633786 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1105/2188] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:05:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:05:35.634969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe52070-e9bc-4e4f-a985-86ec2c55505f None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:35.644777 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe52070-e9bc-4e4f-a985-86ec2c55505f None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:35.649675 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c918ab-ec57-4279-a327-ff54e6b52862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:35.650322 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c918ab-ec57-4279-a327-ff54e6b52862 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:35.650602 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c918ab-ec57-4279-a327-ff54e6b52862 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:35.650877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c918ab-ec57-4279-a327-ff54e6b52862 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:35.651512 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c918ab-ec57-4279-a327-ff54e6b52862 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:35.653454 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c918ab-ec57-4279-a327-ff54e6b52862 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:35.668746 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:35.779319 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1084/2189] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:05:35 2022] POST /identity/v3/projects => generated 363 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:35.780816 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbf5aa-de54-402f-9281-51d10c092750 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:35.790735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbf5aa-de54-402f-9281-51d10c092750 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:35.849968 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ba20e-68e6-4099-a3ce-093e2952b2a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:35.850609 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ba20e-68e6-4099-a3ce-093e2952b2a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:35.851460 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ba20e-68e6-4099-a3ce-093e2952b2a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:35.851460 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ba20e-68e6-4099-a3ce-093e2952b2a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:35.851780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ba20e-68e6-4099-a3ce-093e2952b2a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:35.853753 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ba20e-68e6-4099-a3ce-093e2952b2a6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:35.930550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1106/2190] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:05:35 2022] POST /identity/v3/users => generated 282 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:05:35.934440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c918ab-ec57-4279-a327-ff54e6b52862 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:35.944855 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c918ab-ec57-4279-a327-ff54e6b52862 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:35.949474 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0949dc2-ebea-4ce2-91f8-b5c30c9c48b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:35.950139 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0949dc2-ebea-4ce2-91f8-b5c30c9c48b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:35.950424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0949dc2-ebea-4ce2-91f8-b5c30c9c48b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:35.950751 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0949dc2-ebea-4ce2-91f8-b5c30c9c48b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:35.951389 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0949dc2-ebea-4ce2-91f8-b5c30c9c48b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:35.952977 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0949dc2-ebea-4ce2-91f8-b5c30c9c48b9 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:35.962954 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1085/2191] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:05:35.967263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ba20e-68e6-4099-a3ce-093e2952b2a6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:35.977891 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ba20e-68e6-4099-a3ce-093e2952b2a6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:35.982736 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c8377a-0865-416a-831c-af22f9fd95b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:35.983328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8377a-0865-416a-831c-af22f9fd95b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:35.983605 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8377a-0865-416a-831c-af22f9fd95b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:35.983903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c8377a-0865-416a-831c-af22f9fd95b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:35.984542 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8377a-0865-416a-831c-af22f9fd95b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:35.986162 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c8377a-0865-416a-831c-af22f9fd95b7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:35.997370 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1107/2192] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:05:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:05:36.001332 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0949dc2-ebea-4ce2-91f8-b5c30c9c48b9 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:36.011482 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0949dc2-ebea-4ce2-91f8-b5c30c9c48b9 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:36.016222 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41ff0b-7d2b-43c7-97fd-e1a57aaca361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:36.016878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41ff0b-7d2b-43c7-97fd-e1a57aaca361 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:36.017180 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41ff0b-7d2b-43c7-97fd-e1a57aaca361 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:36.017460 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41ff0b-7d2b-43c7-97fd-e1a57aaca361 admin admin] PATH_INFO: `/v3/projects/93be4161f5e14578beec5fdcdc52f3f4/users/f0b73eb1e8dd487488cf83d5dc4625df/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:36.035516 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41ff0b-7d2b-43c7-97fd-e1a57aaca361 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93be4161f5e14578beec5fdcdc52f3f4, user_id=f0b73eb1e8dd487488cf83d5dc4625df, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:36.038678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c41ff0b-7d2b-43c7-97fd-e1a57aaca361 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:36.097526 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1086/2193] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:05:36 2022] PUT /identity/v3/projects/93be4161f5e14578beec5fdcdc52f3f4/users/f0b73eb1e8dd487488cf83d5dc4625df/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:05:36.116967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6713e-a65b-4ab6-8630-1136456eae90 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:36.117248 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6713e-a65b-4ab6-8630-1136456eae90 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:36.117518 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6713e-a65b-4ab6-8630-1136456eae90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:36.163782 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-86a6713e-a65b-4ab6-8630-1136456eae90 None None] MFA Rules not processed for user `f0b73eb1e8dd487488cf83d5dc4625df`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:36.165116 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-86a6713e-a65b-4ab6-8630-1136456eae90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:36.253472 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1108/2194] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:05:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:05:36.264987 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41ff0b-7d2b-43c7-97fd-e1a57aaca361 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:36.267337 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1c41ff0b-7d2b-43c7-97fd-e1a57aaca361 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:36.330030 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c41ff0b-7d2b-43c7-97fd-e1a57aaca361 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:36.334140 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a44bf-b285-4d2a-9220-da03d8ca947f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:36.334745 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a44bf-b285-4d2a-9220-da03d8ca947f service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:36.335025 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a44bf-b285-4d2a-9220-da03d8ca947f service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:36.335302 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a44bf-b285-4d2a-9220-da03d8ca947f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:36.343897 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a44bf-b285-4d2a-9220-da03d8ca947f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:36.345357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a44bf-b285-4d2a-9220-da03d8ca947f service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:36.355193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1087/2195] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:36 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:44.902963 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113d6f4-6af9-4839-8abb-88de2e02e820 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:44.903928 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113d6f4-6af9-4839-8abb-88de2e02e820 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:44.904357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113d6f4-6af9-4839-8abb-88de2e02e820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:44.929201 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5113d6f4-6af9-4839-8abb-88de2e02e820 None None] MFA Rules not processed for user `9fd7a80714874e73bf64dfa392632391`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:05:44.931479 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5113d6f4-6af9-4839-8abb-88de2e02e820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:45.026115 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1109/2196] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Sep 13 20:05:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:05:45.028725 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a44bf-b285-4d2a-9220-da03d8ca947f service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:45.031080 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a18a44bf-b285-4d2a-9220-da03d8ca947f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:45.134073 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a44bf-b285-4d2a-9220-da03d8ca947f service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:45.138869 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217b4ef8-8653-47a4-a818-2545849e9289 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00e78bf5e5c4db29c47dce1e87f3f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:45.139491 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b4ef8-8653-47a4-a818-2545849e9289 service swift] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:45.139773 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b4ef8-8653-47a4-a818-2545849e9289 service swift] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:45.140046 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217b4ef8-8653-47a4-a818-2545849e9289 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:45.149296 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b4ef8-8653-47a4-a818-2545849e9289 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:45.150849 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217b4ef8-8653-47a4-a818-2545849e9289 service swift] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:45.159547 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1088/2197] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Sep 13 20:05:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:05:47.725283 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113d6f4-6af9-4839-8abb-88de2e02e820 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:05:47.726904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5113d6f4-6af9-4839-8abb-88de2e02e820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:47.740903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:47.799441 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113d6f4-6af9-4839-8abb-88de2e02e820 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:05:47.803494 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79652fb5-0cfd-4f44-bfbb-2629be372320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:05:47.804109 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79652fb5-0cfd-4f44-bfbb-2629be372320 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:05:47.804398 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79652fb5-0cfd-4f44-bfbb-2629be372320 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:05:47.804687 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79652fb5-0cfd-4f44-bfbb-2629be372320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:05:47.806471 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-79652fb5-0cfd-4f44-bfbb-2629be372320 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:05:47.887406 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79652fb5-0cfd-4f44-bfbb-2629be372320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:05:47.888945 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79652fb5-0cfd-4f44-bfbb-2629be372320 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:05:47.901118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1110/2198] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:05:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:05:55.156280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:INSERT=2,keystone:SELECT=75 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:05:57.895149 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=44 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:03.633055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f6c4c-fe12-42a0-9c8e-53fb86d9e36f None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:03.633656 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f6c4c-fe12-42a0-9c8e-53fb86d9e36f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:03.633656 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707f6c4c-fe12-42a0-9c8e-53fb86d9e36f None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:03.635081 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1089/2199] 10.222.0.59 () {54 vars in 921 bytes} [Tue Sep 13 20:06:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:06:03.641132 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2ac96-8f64-489e-856a-ce46f0022369 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:03.641577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2ac96-8f64-489e-856a-ce46f0022369 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:03.641710 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2ac96-8f64-489e-856a-ce46f0022369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:03.661167 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-bcd2ac96-8f64-489e-856a-ce46f0022369 None None] MFA Rules not processed for user `3919b24291f54df99a9da0f5d3164ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:03.662288 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bcd2ac96-8f64-489e-856a-ce46f0022369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:03.739674 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1111/2200] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Sep 13 20:06:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:03.753141 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f6c4c-fe12-42a0-9c8e-53fb86d9e36f None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:03.754861 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-707f6c4c-fe12-42a0-9c8e-53fb86d9e36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:03.812549 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707f6c4c-fe12-42a0-9c8e-53fb86d9e36f None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:03.816306 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4708b3-0e15-40f5-a598-91e86727953b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '44093d63c1aa45b781d2ce30239ed598', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:03.816947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4708b3-0e15-40f5-a598-91e86727953b service glance] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:03.817229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4708b3-0e15-40f5-a598-91e86727953b service glance] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:03.817507 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4708b3-0e15-40f5-a598-91e86727953b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:03.828241 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4708b3-0e15-40f5-a598-91e86727953b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:03.829662 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4708b3-0e15-40f5-a598-91e86727953b service glance] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:03.841042 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1090/2201] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:04.060786 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee569d74-1fe5-40ef-88e6-548db8b765d1 None None] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:04.061079 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee569d74-1fe5-40ef-88e6-548db8b765d1 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:04.061357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee569d74-1fe5-40ef-88e6-548db8b765d1 None None] PATH_INFO: `/` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:04.062783 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1112/2202] 10.222.0.59 () {54 vars in 921 bytes} [Tue Sep 13 20:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 13 20:06:04.067386 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc3d58-7e46-47fb-9c57-d24e03ac465d None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:04.067673 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc3d58-7e46-47fb-9c57-d24e03ac465d None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:04.067945 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc3d58-7e46-47fb-9c57-d24e03ac465d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:04.088583 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-75fc3d58-7e46-47fb-9c57-d24e03ac465d None None] MFA Rules not processed for user `b86b85c457d84ac99359ac93add704d2`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:04.091239 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-75fc3d58-7e46-47fb-9c57-d24e03ac465d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:04.096514 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1091/2203] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Sep 13 20:06:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:04.108997 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee569d74-1fe5-40ef-88e6-548db8b765d1 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:04.110717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ee569d74-1fe5-40ef-88e6-548db8b765d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:04.123638 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee569d74-1fe5-40ef-88e6-548db8b765d1 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:04.127165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3e5102-9f10-46ab-8252-fc0130b92f5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:04.127762 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e5102-9f10-46ab-8252-fc0130b92f5d service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:04.128040 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e5102-9f10-46ab-8252-fc0130b92f5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:04.128311 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3e5102-9f10-46ab-8252-fc0130b92f5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:04.135515 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e5102-9f10-46ab-8252-fc0130b92f5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:04.136939 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3e5102-9f10-46ab-8252-fc0130b92f5d service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:04.147542 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1113/2204] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:04.232176 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d23cec-54a3-4711-9eba-9bb8677dd245 None None] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:04.232462 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d23cec-54a3-4711-9eba-9bb8677dd245 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:04.232741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d23cec-54a3-4711-9eba-9bb8677dd245 None None] PATH_INFO: `/` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:04.234140 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1092/2205] 10.222.0.59 () {54 vars in 921 bytes} [Tue Sep 13 20:06:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 13 20:06:04.239830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac86732-77a4-4586-91c4-f1d29336d91e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:04.240117 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac86732-77a4-4586-91c4-f1d29336d91e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:04.240395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac86732-77a4-4586-91c4-f1d29336d91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:04.262462 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5ac86732-77a4-4586-91c4-f1d29336d91e None None] MFA Rules not processed for user `3919b24291f54df99a9da0f5d3164ccf`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:04.263671 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5ac86732-77a4-4586-91c4-f1d29336d91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:04.272857 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1114/2206] 10.222.0.59 () {58 vars in 1018 bytes} [Tue Sep 13 20:06:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:04.283351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d23cec-54a3-4711-9eba-9bb8677dd245 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:04.294550 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d23cec-54a3-4711-9eba-9bb8677dd245 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:04.298121 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cedbdd-3a77-4e12-9732-3b48a3007f80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:04.298715 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cedbdd-3a77-4e12-9732-3b48a3007f80 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:04.298993 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cedbdd-3a77-4e12-9732-3b48a3007f80 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:04.299266 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cedbdd-3a77-4e12-9732-3b48a3007f80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:04.310474 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cedbdd-3a77-4e12-9732-3b48a3007f80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:04.311950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cedbdd-3a77-4e12-9732-3b48a3007f80 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:04.323844 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1093/2207] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:06:07.625611 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5d62f-cf62-460e-8388-897172a3b090 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:07.626180 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5d62f-cf62-460e-8388-897172a3b090 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:07.626302 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a5d62f-cf62-460e-8388-897172a3b090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:07.645423 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a2a5d62f-cf62-460e-8388-897172a3b090 None None] MFA Rules not processed for user `9fd7a80714874e73bf64dfa392632391`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:07.646637 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a2a5d62f-cf62-460e-8388-897172a3b090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:07.653830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1115/2208] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Sep 13 20:06:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:07.665680 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cedbdd-3a77-4e12-9732-3b48a3007f80 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:07.676764 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cedbdd-3a77-4e12-9732-3b48a3007f80 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:07.681730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f565f549-a997-41fb-9625-a38491ada431 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00e78bf5e5c4db29c47dce1e87f3f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:07.682322 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565f549-a997-41fb-9625-a38491ada431 service swift] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:07.683086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565f549-a997-41fb-9625-a38491ada431 service swift] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:07.683359 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f565f549-a997-41fb-9625-a38491ada431 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:07.691313 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565f549-a997-41fb-9625-a38491ada431 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:07.692886 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f565f549-a997-41fb-9625-a38491ada431 service swift] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:07.701618 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1094/2209] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Sep 13 20:06:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:06:17.640554 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=43 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:17.697977 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=41 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:24.178967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5d62f-cf62-460e-8388-897172a3b090 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:24.235699 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a5d62f-cf62-460e-8388-897172a3b090 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:24.240159 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f7e5d-b725-4bd8-954a-906522f46d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:24.240776 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f7e5d-b725-4bd8-954a-906522f46d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:24.241057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f7e5d-b725-4bd8-954a-906522f46d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:24.241327 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f7e5d-b725-4bd8-954a-906522f46d01 admin admin] PATH_INFO: `/v3/users/f0b73eb1e8dd487488cf83d5dc4625df` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:24.242454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f7e5d-b725-4bd8-954a-906522f46d01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0b73eb1e8dd487488cf83d5dc4625df)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:24.244355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f7e5d-b725-4bd8-954a-906522f46d01 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:24.386346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3f5f7e5d-b725-4bd8-954a-906522f46d01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0b73eb1e8dd487488cf83d5dc4625df'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:24.458149 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3f5f7e5d-b725-4bd8-954a-906522f46d01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0b73eb1e8dd487488cf83d5dc4625df'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:24.470597 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3f5f7e5d-b725-4bd8-954a-906522f46d01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0b73eb1e8dd487488cf83d5dc4625df'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:24.471332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3f5f7e5d-b725-4bd8-954a-906522f46d01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0b73eb1e8dd487488cf83d5dc4625df'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:24.478141 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-3f5f7e5d-b725-4bd8-954a-906522f46d01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0b73eb1e8dd487488cf83d5dc4625df'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:24.484659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1116/2210] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:06:24 2022] DELETE /identity/v3/users/f0b73eb1e8dd487488cf83d5dc4625df => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:06:24.489170 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658deec2-0366-4482-835d-39f69185b259 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:24.489741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658deec2-0366-4482-835d-39f69185b259 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:24.489741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658deec2-0366-4482-835d-39f69185b259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:24.509006 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-658deec2-0366-4482-835d-39f69185b259 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:24.510223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-658deec2-0366-4482-835d-39f69185b259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:24.568994 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1095/2211] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:24.578677 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f7e5d-b725-4bd8-954a-906522f46d01 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:24.585671 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3f5f7e5d-b725-4bd8-954a-906522f46d01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:24.636808 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f7e5d-b725-4bd8-954a-906522f46d01 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:24.640328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10d43d3-443a-44d4-9a0a-1ada337abd17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:24.640916 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d43d3-443a-44d4-9a0a-1ada337abd17 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:24.641192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d43d3-443a-44d4-9a0a-1ada337abd17 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:24.641458 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10d43d3-443a-44d4-9a0a-1ada337abd17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:24.650149 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d43d3-443a-44d4-9a0a-1ada337abd17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:24.651574 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10d43d3-443a-44d4-9a0a-1ada337abd17 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:24.660700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1117/2212] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:25.094258 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658deec2-0366-4482-835d-39f69185b259 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:25.095824 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-658deec2-0366-4482-835d-39f69185b259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:25.110583 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658deec2-0366-4482-835d-39f69185b259 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:25.113604 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20882fc-3309-45ca-b8dc-4de6725b2d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:25.114280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20882fc-3309-45ca-b8dc-4de6725b2d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:25.114560 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20882fc-3309-45ca-b8dc-4de6725b2d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:25.114834 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20882fc-3309-45ca-b8dc-4de6725b2d81 admin admin] PATH_INFO: `/v3/projects/93be4161f5e14578beec5fdcdc52f3f4` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:25.116228 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20882fc-3309-45ca-b8dc-4de6725b2d81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=93be4161f5e14578beec5fdcdc52f3f4)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:25.118202 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20882fc-3309-45ca-b8dc-4de6725b2d81 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:25.200402 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b20882fc-3309-45ca-b8dc-4de6725b2d81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93be4161f5e14578beec5fdcdc52f3f4', 'request_id': 'req-b20882fc-3309-45ca-b8dc-4de6725b2d81'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:25.205879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b20882fc-3309-45ca-b8dc-4de6725b2d81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93be4161f5e14578beec5fdcdc52f3f4', 'request_id': 'req-b20882fc-3309-45ca-b8dc-4de6725b2d81'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:25.212332 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b20882fc-3309-45ca-b8dc-4de6725b2d81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93be4161f5e14578beec5fdcdc52f3f4', 'request_id': 'req-b20882fc-3309-45ca-b8dc-4de6725b2d81'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:25.262852 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b20882fc-3309-45ca-b8dc-4de6725b2d81 admin admin] The token cache is being invalidate because project 93be4161f5e14578beec5fdcdc52f3f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:06:25.263080 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b20882fc-3309-45ca-b8dc-4de6725b2d81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:25.263705 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b20882fc-3309-45ca-b8dc-4de6725b2d81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:06:25.265206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1096/2213] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:06:25 2022] DELETE /identity/v3/projects/93be4161f5e14578beec5fdcdc52f3f4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:06:25.270038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4c174-7f72-44b3-a6e3-d48489688567 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:25.270518 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4c174-7f72-44b3-a6e3-d48489688567 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:25.270709 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4c174-7f72-44b3-a6e3-d48489688567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:25.290459 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-20c4c174-7f72-44b3-a6e3-d48489688567 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:25.291635 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-20c4c174-7f72-44b3-a6e3-d48489688567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:25.307650 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:25.349569 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1118/2214] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:25.357368 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f702bf-7b0f-424e-9039-aaf0ba891be2 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:25.357659 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f702bf-7b0f-424e-9039-aaf0ba891be2 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:25.357967 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f702bf-7b0f-424e-9039-aaf0ba891be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:25.377110 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-95f702bf-7b0f-424e-9039-aaf0ba891be2 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:25.378334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-95f702bf-7b0f-424e-9039-aaf0ba891be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:25.386708 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1097/2215] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:25.391015 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4c174-7f72-44b3-a6e3-d48489688567 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:25.401041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4c174-7f72-44b3-a6e3-d48489688567 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:25.407021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6aa3f6-c6a3-463b-8c35-7605371e92b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:25.407669 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6aa3f6-c6a3-463b-8c35-7605371e92b7 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:25.407929 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6aa3f6-c6a3-463b-8c35-7605371e92b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:25.408203 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6aa3f6-c6a3-463b-8c35-7605371e92b7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:25.408862 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6aa3f6-c6a3-463b-8c35-7605371e92b7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:06:25.409168 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6aa3f6-c6a3-463b-8c35-7605371e92b7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:25.410943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6aa3f6-c6a3-463b-8c35-7605371e92b7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:25.423375 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1119/2216] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:06:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:06:25.427423 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f702bf-7b0f-424e-9039-aaf0ba891be2 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:25.436793 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f702bf-7b0f-424e-9039-aaf0ba891be2 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:25.441395 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a7c14-0f8f-4875-bebe-bc2e56ef66f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:25.442029 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a7c14-0f8f-4875-bebe-bc2e56ef66f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:25.442309 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a7c14-0f8f-4875-bebe-bc2e56ef66f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:25.442597 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a7c14-0f8f-4875-bebe-bc2e56ef66f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:25.443210 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a7c14-0f8f-4875-bebe-bc2e56ef66f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:25.445091 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a7c14-0f8f-4875-bebe-bc2e56ef66f3 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:26.114073 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1098/2217] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:06:25 2022] POST /identity/v3/projects => generated 383 bytes in 684 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:06:26.115552 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6aa3f6-c6a3-463b-8c35-7605371e92b7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:26.126124 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6aa3f6-c6a3-463b-8c35-7605371e92b7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:26.191714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22b21d-a079-4e06-87e9-e2e15ece5145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:26.192323 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22b21d-a079-4e06-87e9-e2e15ece5145 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:26.192607 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22b21d-a079-4e06-87e9-e2e15ece5145 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:26.192876 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb22b21d-a079-4e06-87e9-e2e15ece5145 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:26.193501 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22b21d-a079-4e06-87e9-e2e15ece5145 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:26.195454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb22b21d-a079-4e06-87e9-e2e15ece5145 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:26.321512 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1120/2218] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:06:26 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:06:26.325494 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a7c14-0f8f-4875-bebe-bc2e56ef66f3 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:26.335785 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a7c14-0f8f-4875-bebe-bc2e56ef66f3 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:26.341120 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde453f7-4d3a-4f5c-b1da-1aebed070bd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:26.345943 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde453f7-4d3a-4f5c-b1da-1aebed070bd4 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:26.345943 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde453f7-4d3a-4f5c-b1da-1aebed070bd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:26.345943 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde453f7-4d3a-4f5c-b1da-1aebed070bd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:26.345943 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde453f7-4d3a-4f5c-b1da-1aebed070bd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:26.345943 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde453f7-4d3a-4f5c-b1da-1aebed070bd4 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:26.354342 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1099/2219] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:06:26.359368 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22b21d-a079-4e06-87e9-e2e15ece5145 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:26.369421 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb22b21d-a079-4e06-87e9-e2e15ece5145 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:26.373964 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764f1ed-0568-4175-bf52-47b012511c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:26.374550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764f1ed-0568-4175-bf52-47b012511c0f admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:26.374944 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764f1ed-0568-4175-bf52-47b012511c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:26.375218 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764f1ed-0568-4175-bf52-47b012511c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:26.375845 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764f1ed-0568-4175-bf52-47b012511c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:26.377493 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764f1ed-0568-4175-bf52-47b012511c0f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:26.388196 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1121/2220] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:06:26.392167 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde453f7-4d3a-4f5c-b1da-1aebed070bd4 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:26.404762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde453f7-4d3a-4f5c-b1da-1aebed070bd4 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:26.406992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1349fe1-0cc2-4566-9455-436e1a6ce9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:26.407628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1349fe1-0cc2-4566-9455-436e1a6ce9e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:26.407909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1349fe1-0cc2-4566-9455-436e1a6ce9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:26.408181 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1349fe1-0cc2-4566-9455-436e1a6ce9e1 admin admin] PATH_INFO: `/v3/projects/feadd538c5fa4776a353bf22bd964156/users/2ac3ce4e64754e059555bd2aa82495bd/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:26.423339 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1349fe1-0cc2-4566-9455-436e1a6ce9e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feadd538c5fa4776a353bf22bd964156, user_id=2ac3ce4e64754e059555bd2aa82495bd, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:26.425945 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1349fe1-0cc2-4566-9455-436e1a6ce9e1 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:26.485946 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1100/2221] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:06:26 2022] PUT /identity/v3/projects/feadd538c5fa4776a353bf22bd964156/users/2ac3ce4e64754e059555bd2aa82495bd/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:06:26.492259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6e424-e380-406b-931f-acede7b65f74 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:26.492542 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6e424-e380-406b-931f-acede7b65f74 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:26.492833 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a6e424-e380-406b-931f-acede7b65f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:26.512282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e8a6e424-e380-406b-931f-acede7b65f74 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:26.513459 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e8a6e424-e380-406b-931f-acede7b65f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:26.570976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1122/2222] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:06:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:26.580923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1349fe1-0cc2-4566-9455-436e1a6ce9e1 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:26.582627 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f1349fe1-0cc2-4566-9455-436e1a6ce9e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:26.605034 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:26.639208 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1349fe1-0cc2-4566-9455-436e1a6ce9e1 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:26.643566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396df7b-e147-487c-85ad-c1b5032e1c49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:26.644170 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396df7b-e147-487c-85ad-c1b5032e1c49 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:26.644453 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396df7b-e147-487c-85ad-c1b5032e1c49 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:26.644730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8396df7b-e147-487c-85ad-c1b5032e1c49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:26.654149 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396df7b-e147-487c-85ad-c1b5032e1c49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:26.655589 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8396df7b-e147-487c-85ad-c1b5032e1c49 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:26.665125 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1101/2223] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:27.899272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17cbc7-3bc5-4a17-b60c-fa8a3103a830 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:27.900301 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17cbc7-3bc5-4a17-b60c-fa8a3103a830 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:27.900641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac17cbc7-3bc5-4a17-b60c-fa8a3103a830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:27.930496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ac17cbc7-3bc5-4a17-b60c-fa8a3103a830 None None] MFA Rules not processed for user `2ac3ce4e64754e059555bd2aa82495bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:27.931705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ac17cbc7-3bc5-4a17-b60c-fa8a3103a830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:27.948871 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:27.996419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1123/2224] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:06:27 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:28.007277 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396df7b-e147-487c-85ad-c1b5032e1c49 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:28.013780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8396df7b-e147-487c-85ad-c1b5032e1c49 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:28.066350 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8396df7b-e147-487c-85ad-c1b5032e1c49 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:28.069905 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e248c8-07ce-4761-81ee-56ac1c0b66e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:28.070509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e248c8-07ce-4761-81ee-56ac1c0b66e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:28.070792 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e248c8-07ce-4761-81ee-56ac1c0b66e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:28.071064 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e248c8-07ce-4761-81ee-56ac1c0b66e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:28.079720 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e248c8-07ce-4761-81ee-56ac1c0b66e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:28.081144 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e248c8-07ce-4761-81ee-56ac1c0b66e0 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:28.090731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1102/2225] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:06:28 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:06:29.775827 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecec19-21d5-4d2c-a23d-9bfced38ce9e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:29.776365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecec19-21d5-4d2c-a23d-9bfced38ce9e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:29.776365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ecec19-21d5-4d2c-a23d-9bfced38ce9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:29.796634 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-51ecec19-21d5-4d2c-a23d-9bfced38ce9e None None] MFA Rules not processed for user `2ac3ce4e64754e059555bd2aa82495bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:29.797795 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-51ecec19-21d5-4d2c-a23d-9bfced38ce9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:29.804855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1124/2226] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:06:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:34.926056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873318f8-7395-439c-a6ce-0c3da90f90dc None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:34.926883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873318f8-7395-439c-a6ce-0c3da90f90dc None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:34.927623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873318f8-7395-439c-a6ce-0c3da90f90dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:34.952016 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-873318f8-7395-439c-a6ce-0c3da90f90dc None None] MFA Rules not processed for user `9fd7a80714874e73bf64dfa392632391`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:06:34.953430 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-873318f8-7395-439c-a6ce-0c3da90f90dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:35.024891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1103/2227] 10.222.0.59 () {58 vars in 967 bytes} [Tue Sep 13 20:06:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:06:35.049362 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecec19-21d5-4d2c-a23d-9bfced38ce9e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:06:35.050836 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-51ecec19-21d5-4d2c-a23d-9bfced38ce9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:06:35.122978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ecec19-21d5-4d2c-a23d-9bfced38ce9e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:06:35.127707 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd9c4b-8a6b-4b53-bc14-57b4bc6db042 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00e78bf5e5c4db29c47dce1e87f3f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:06:35.128317 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd9c4b-8a6b-4b53-bc14-57b4bc6db042 service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:06:35.128597 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd9c4b-8a6b-4b53-bc14-57b4bc6db042 service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:06:35.128933 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bd9c4b-8a6b-4b53-bc14-57b4bc6db042 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:06:35.137813 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd9c4b-8a6b-4b53-bc14-57b4bc6db042 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:06:35.139321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bd9c4b-8a6b-4b53-bc14-57b4bc6db042 service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:06:35.148376 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1125/2228] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Sep 13 20:06:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:06:45.018088 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=68 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:06:45.144095 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=54 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:04.404497 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873318f8-7395-439c-a6ce-0c3da90f90dc None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:04.414409 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873318f8-7395-439c-a6ce-0c3da90f90dc None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:04.417935 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef990286-ecc2-45b6-a710-ffb72d28525a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:04.418629 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef990286-ecc2-45b6-a710-ffb72d28525a service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:04.418972 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef990286-ecc2-45b6-a710-ffb72d28525a service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:04.419309 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef990286-ecc2-45b6-a710-ffb72d28525a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:04.421129 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ef990286-ecc2-45b6-a710-ffb72d28525a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:04.493966 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef990286-ecc2-45b6-a710-ffb72d28525a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:04.495423 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef990286-ecc2-45b6-a710-ffb72d28525a service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:04.506940 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1104/2229] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:08.108984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd9c4b-8a6b-4b53-bc14-57b4bc6db042 service swift] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:08.110400 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-59bd9c4b-8a6b-4b53-bc14-57b4bc6db042 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:08.122584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bd9c4b-8a6b-4b53-bc14-57b4bc6db042 service swift] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:08.126195 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee0dfc-45ff-467c-b07c-2c6fca3f6bc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:08.126854 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee0dfc-45ff-467c-b07c-2c6fca3f6bc4 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:08.127112 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee0dfc-45ff-467c-b07c-2c6fca3f6bc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:08.127377 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee0dfc-45ff-467c-b07c-2c6fca3f6bc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:08.129041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-32ee0dfc-45ff-467c-b07c-2c6fca3f6bc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:08.141590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee0dfc-45ff-467c-b07c-2c6fca3f6bc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:08.143044 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee0dfc-45ff-467c-b07c-2c6fca3f6bc4 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:08.153464 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1126/2230] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:14.501872 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=34 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:15.831354 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58541541-e0c5-413b-a022-54cc18b11661 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:15.831958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58541541-e0c5-413b-a022-54cc18b11661 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:15.831958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58541541-e0c5-413b-a022-54cc18b11661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:15.851500 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-58541541-e0c5-413b-a022-54cc18b11661 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:15.852695 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-58541541-e0c5-413b-a022-54cc18b11661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:15.860844 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1105/2231] 10.222.0.62 () {58 vars in 1016 bytes} [Tue Sep 13 20:07:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:15.875316 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee0dfc-45ff-467c-b07c-2c6fca3f6bc4 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:15.877262 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-32ee0dfc-45ff-467c-b07c-2c6fca3f6bc4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:15.890724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee0dfc-45ff-467c-b07c-2c6fca3f6bc4 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:15.896207 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8327f9-eb55-4102-b1db-2671a44c28ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:15.896811 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8327f9-eb55-4102-b1db-2671a44c28ab service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:15.897085 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8327f9-eb55-4102-b1db-2671a44c28ab service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:15.897350 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8327f9-eb55-4102-b1db-2671a44c28ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:15.905319 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8327f9-eb55-4102-b1db-2671a44c28ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:15.906972 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8327f9-eb55-4102-b1db-2671a44c28ab service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:15.916186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1127/2232] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:22.185608 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd77ca-3005-45db-803f-8865c81d6cb2 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:22.186580 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd77ca-3005-45db-803f-8865c81d6cb2 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:22.186861 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd77ca-3005-45db-803f-8865c81d6cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:22.207243 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-0bbd77ca-3005-45db-803f-8865c81d6cb2 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:22.208697 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0bbd77ca-3005-45db-803f-8865c81d6cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:22.217472 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1106/2233] 10.222.0.62 () {58 vars in 1016 bytes} [Tue Sep 13 20:07:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:22.233638 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8327f9-eb55-4102-b1db-2671a44c28ab service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:22.248016 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bc8327f9-eb55-4102-b1db-2671a44c28ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:22.250962 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8327f9-eb55-4102-b1db-2671a44c28ab service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:22.256458 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4b4c5-1f4d-4bff-bdf8-b8f896dadcaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:22.257058 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4b4c5-1f4d-4bff-bdf8-b8f896dadcaf service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:22.257339 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4b4c5-1f4d-4bff-bdf8-b8f896dadcaf service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:22.257609 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4b4c5-1f4d-4bff-bdf8-b8f896dadcaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:22.266018 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4b4c5-1f4d-4bff-bdf8-b8f896dadcaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:22.267605 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c4b4c5-1f4d-4bff-bdf8-b8f896dadcaf service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:22.277381 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1128/2234] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:23.364240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd77ca-3005-45db-803f-8865c81d6cb2 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:23.377128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbd77ca-3005-45db-803f-8865c81d6cb2 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:23.382453 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f46c470-19ad-41d4-9f62-c18061a23b63 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:23.383079 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46c470-19ad-41d4-9f62-c18061a23b63 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:23.383354 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46c470-19ad-41d4-9f62-c18061a23b63 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:23.383624 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f46c470-19ad-41d4-9f62-c18061a23b63 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:23.385351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6f46c470-19ad-41d4-9f62-c18061a23b63 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:23.445072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46c470-19ad-41d4-9f62-c18061a23b63 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:23.446703 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f46c470-19ad-41d4-9f62-c18061a23b63 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:23.455656 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1107/2235] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:23 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:23.642353 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4b4c5-1f4d-4bff-bdf8-b8f896dadcaf service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:23.653154 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4b4c5-1f4d-4bff-bdf8-b8f896dadcaf service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:23.658469 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49de221-9b9c-45ad-bf77-e32f2c91e4da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:23.659052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49de221-9b9c-45ad-bf77-e32f2c91e4da service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:23.659355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49de221-9b9c-45ad-bf77-e32f2c91e4da service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:23.659622 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49de221-9b9c-45ad-bf77-e32f2c91e4da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:23.661278 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f49de221-9b9c-45ad-bf77-e32f2c91e4da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:23.719689 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49de221-9b9c-45ad-bf77-e32f2c91e4da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:23.721264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49de221-9b9c-45ad-bf77-e32f2c91e4da service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:23.730151 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1129/2236] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:23 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:27.153262 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1826b-ba3f-4c4c-be49-30280d0a2644 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:27.153764 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1826b-ba3f-4c4c-be49-30280d0a2644 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:27.153893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa1826b-ba3f-4c4c-be49-30280d0a2644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:27.173888 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-8aa1826b-ba3f-4c4c-be49-30280d0a2644 None None] MFA Rules not processed for user `c83ccb0008d04b4f98c05915e5748713`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:27.175084 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8aa1826b-ba3f-4c4c-be49-30280d0a2644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:27.181811 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1108/2237] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:07:27 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:28.757342 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b0558-7e09-4cff-822e-953186d0f1d5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:28.757946 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b0558-7e09-4cff-822e-953186d0f1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:28.758264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b0558-7e09-4cff-822e-953186d0f1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:28.777933 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-134b0558-7e09-4cff-822e-953186d0f1d5 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:28.779122 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-134b0558-7e09-4cff-822e-953186d0f1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:28.787012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1130/2238] 10.222.0.62 () {58 vars in 1016 bytes} [Tue Sep 13 20:07:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:28.800809 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1826b-ba3f-4c4c-be49-30280d0a2644 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:28.813328 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa1826b-ba3f-4c4c-be49-30280d0a2644 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:28.819362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f936b0-d92b-41c7-a5e2-87325033aac1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:28.819974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f936b0-d92b-41c7-a5e2-87325033aac1 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:28.820257 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f936b0-d92b-41c7-a5e2-87325033aac1 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:28.820534 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f936b0-d92b-41c7-a5e2-87325033aac1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:28.829071 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f936b0-d92b-41c7-a5e2-87325033aac1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:28.830861 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f936b0-d92b-41c7-a5e2-87325033aac1 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:28.841102 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1109/2239] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:34.718590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b0558-7e09-4cff-822e-953186d0f1d5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:34.731013 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b0558-7e09-4cff-822e-953186d0f1d5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:34.736056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4fb01-eec1-4f75-8597-873bb36ec252 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:34.737212 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4fb01-eec1-4f75-8597-873bb36ec252 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:34.737550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4fb01-eec1-4f75-8597-873bb36ec252 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:34.737845 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b4fb01-eec1-4f75-8597-873bb36ec252 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:34.750302 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-05b4fb01-eec1-4f75-8597-873bb36ec252 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:34.765449 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4fb01-eec1-4f75-8597-873bb36ec252 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:34.769867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b4fb01-eec1-4f75-8597-873bb36ec252 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:34.786980 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1131/2240] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:35.790598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a064576-f7c0-4762-91c1-a0a842eb7c5f None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:35.791092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a064576-f7c0-4762-91c1-a0a842eb7c5f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:35.791200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a064576-f7c0-4762-91c1-a0a842eb7c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:35.810212 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-6a064576-f7c0-4762-91c1-a0a842eb7c5f None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:35.811385 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6a064576-f7c0-4762-91c1-a0a842eb7c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:35.820158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1110/2241] 10.222.0.62 () {58 vars in 1016 bytes} [Tue Sep 13 20:07:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:35.839081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4fb01-eec1-4f75-8597-873bb36ec252 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:35.846010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=56 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:35.852293 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b4fb01-eec1-4f75-8597-873bb36ec252 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:35.857759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf49d2d-0de6-4719-928d-6794c20898a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:35.858362 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf49d2d-0de6-4719-928d-6794c20898a1 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:35.858641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf49d2d-0de6-4719-928d-6794c20898a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:35.858909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf49d2d-0de6-4719-928d-6794c20898a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:35.866970 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf49d2d-0de6-4719-928d-6794c20898a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:35.868461 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf49d2d-0de6-4719-928d-6794c20898a1 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:35.878183 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1132/2242] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:42.076165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f2310-d673-45bf-b51c-51235d9ed0c9 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:42.076639 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f2310-d673-45bf-b51c-51235d9ed0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:42.076751 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790f2310-d673-45bf-b51c-51235d9ed0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:42.096031 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-790f2310-d673-45bf-b51c-51235d9ed0c9 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:42.097212 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-790f2310-d673-45bf-b51c-51235d9ed0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:42.104868 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1111/2243] 10.222.0.62 () {58 vars in 1016 bytes} [Tue Sep 13 20:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:42.120526 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf49d2d-0de6-4719-928d-6794c20898a1 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:42.131975 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf49d2d-0de6-4719-928d-6794c20898a1 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:42.137299 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83130ad-8039-4192-b8b1-00db6f378061 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:42.137916 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83130ad-8039-4192-b8b1-00db6f378061 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:42.138192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83130ad-8039-4192-b8b1-00db6f378061 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:42.138460 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83130ad-8039-4192-b8b1-00db6f378061 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:42.146274 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83130ad-8039-4192-b8b1-00db6f378061 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:42.147767 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83130ad-8039-4192-b8b1-00db6f378061 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:42.156826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1133/2244] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:47.365935 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bca0d-d7e2-450a-9c0d-0ba2f62c29cb None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:47.366425 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bca0d-d7e2-450a-9c0d-0ba2f62c29cb None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:47.366532 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3bca0d-d7e2-450a-9c0d-0ba2f62c29cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:47.374026 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=50 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:47.385965 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-8a3bca0d-d7e2-450a-9c0d-0ba2f62c29cb None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:07:47.390256 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8a3bca0d-d7e2-450a-9c0d-0ba2f62c29cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:47.395574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1112/2245] 10.222.0.62 () {58 vars in 1016 bytes} [Tue Sep 13 20:07:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:07:47.419081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83130ad-8039-4192-b8b1-00db6f378061 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:47.430327 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83130ad-8039-4192-b8b1-00db6f378061 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:47.435906 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1b0c2-313a-4d9b-b610-ecf98ab6c8d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:47.436506 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1b0c2-313a-4d9b-b610-ecf98ab6c8d4 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:47.436784 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1b0c2-313a-4d9b-b610-ecf98ab6c8d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:47.437057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de1b0c2-313a-4d9b-b610-ecf98ab6c8d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:47.445280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1b0c2-313a-4d9b-b610-ecf98ab6c8d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:47.446884 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de1b0c2-313a-4d9b-b610-ecf98ab6c8d4 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:47.456227 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1134/2246] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:07:57.406547 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:57.451924 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=17 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:07:58.247239 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bca0d-d7e2-450a-9c0d-0ba2f62c29cb None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:07:58.259921 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3bca0d-d7e2-450a-9c0d-0ba2f62c29cb None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:07:58.265311 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4dcf6-f000-485a-93f3-dd1ec2660db5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:07:58.265943 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4dcf6-f000-485a-93f3-dd1ec2660db5 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:07:58.266225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4dcf6-f000-485a-93f3-dd1ec2660db5 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:07:58.266499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4dcf6-f000-485a-93f3-dd1ec2660db5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:07:58.268182 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-19e4dcf6-f000-485a-93f3-dd1ec2660db5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:07:58.326222 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4dcf6-f000-485a-93f3-dd1ec2660db5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:07:58.327783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e4dcf6-f000-485a-93f3-dd1ec2660db5 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:07:58.336806 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1113/2247] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:07:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:08:02.631492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1b0c2-313a-4d9b-b610-ecf98ab6c8d4 service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:02.645084 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de1b0c2-313a-4d9b-b610-ecf98ab6c8d4 service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:02.651139 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac99c7-1297-4c8c-bf41-90e344ce910d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:02.651956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac99c7-1297-4c8c-bf41-90e344ce910d service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:02.652390 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac99c7-1297-4c8c-bf41-90e344ce910d service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:02.653048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ac99c7-1297-4c8c-bf41-90e344ce910d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:02.654857 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-20ac99c7-1297-4c8c-bf41-90e344ce910d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:02.669415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac99c7-1297-4c8c-bf41-90e344ce910d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:02.670963 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ac99c7-1297-4c8c-bf41-90e344ce910d service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:02.684291 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1135/2248] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:08:02 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:08:03.980651 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4dcf6-f000-485a-93f3-dd1ec2660db5 service nova] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:03.995193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e4dcf6-f000-485a-93f3-dd1ec2660db5 service nova] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:04.000972 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0d979b-8004-4902-97b4-bab5b670a569 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:04.001675 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d979b-8004-4902-97b4-bab5b670a569 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:04.004025 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d979b-8004-4902-97b4-bab5b670a569 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:04.004025 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0d979b-8004-4902-97b4-bab5b670a569 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:04.005135 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-cf0d979b-8004-4902-97b4-bab5b670a569 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:04.019601 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d979b-8004-4902-97b4-bab5b670a569 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:04.021336 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0d979b-8004-4902-97b4-bab5b670a569 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:04.034058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1114/2249] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:08:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:08:07.601910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac99c7-1297-4c8c-bf41-90e344ce910d service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:07.613658 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ac99c7-1297-4c8c-bf41-90e344ce910d service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:07.619534 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bf2ff-d7f3-4fed-85da-bb0670e3011b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:07.620135 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bf2ff-d7f3-4fed-85da-bb0670e3011b service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:07.620412 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bf2ff-d7f3-4fed-85da-bb0670e3011b service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:07.620681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49bf2ff-d7f3-4fed-85da-bb0670e3011b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:07.622435 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e49bf2ff-d7f3-4fed-85da-bb0670e3011b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:07.681778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bf2ff-d7f3-4fed-85da-bb0670e3011b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:07.683418 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49bf2ff-d7f3-4fed-85da-bb0670e3011b service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:07.693831 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1136/2250] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:08:07 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:08:09.151546 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596661c-6025-4a22-a185-e5ae2eb224c8 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:09.152048 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596661c-6025-4a22-a185-e5ae2eb224c8 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:09.152048 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5596661c-6025-4a22-a185-e5ae2eb224c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:09.170782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-5596661c-6025-4a22-a185-e5ae2eb224c8 None None] MFA Rules not processed for user `2ac3ce4e64754e059555bd2aa82495bd`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:08:09.171958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5596661c-6025-4a22-a185-e5ae2eb224c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:09.179419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1115/2251] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:08:09 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:08:09.418259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bf2ff-d7f3-4fed-85da-bb0670e3011b service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:09.428129 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49bf2ff-d7f3-4fed-85da-bb0670e3011b service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:09.431708 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7c3046-5c61-4856-aec1-93721822b0cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:09.432297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c3046-5c61-4856-aec1-93721822b0cd service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:09.432575 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c3046-5c61-4856-aec1-93721822b0cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:09.432850 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7c3046-5c61-4856-aec1-93721822b0cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:09.434556 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1d7c3046-5c61-4856-aec1-93721822b0cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:09.443525 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c3046-5c61-4856-aec1-93721822b0cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:09.444930 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7c3046-5c61-4856-aec1-93721822b0cd service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:09.452719 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1137/2252] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:08:09 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:08:09.851820 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596661c-6025-4a22-a185-e5ae2eb224c8 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:09.853252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5596661c-6025-4a22-a185-e5ae2eb224c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:09.936504 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5596661c-6025-4a22-a185-e5ae2eb224c8 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:09.941348 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91543a20-9b04-448c-bb08-e2ea0e81f0cd service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e7df5170c841abb449f3b4a547ec4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:09.942023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91543a20-9b04-448c-bb08-e2ea0e81f0cd service placement] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:09.942304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91543a20-9b04-448c-bb08-e2ea0e81f0cd service placement] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:09.942601 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91543a20-9b04-448c-bb08-e2ea0e81f0cd service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:09.944336 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-91543a20-9b04-448c-bb08-e2ea0e81f0cd service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:09.956303 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91543a20-9b04-448c-bb08-e2ea0e81f0cd service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:09.957914 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91543a20-9b04-448c-bb08-e2ea0e81f0cd service placement] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:09.968182 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1116/2253] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:08:09 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:08:19.449848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=40 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:19.964307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=69 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:21.320953 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877980f9-5f3d-4b70-904c-c13cadaa7bed None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:21.321522 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877980f9-5f3d-4b70-904c-c13cadaa7bed None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:21.321522 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877980f9-5f3d-4b70-904c-c13cadaa7bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:21.343932 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-877980f9-5f3d-4b70-904c-c13cadaa7bed None None] MFA Rules not processed for user `0851425d841946f49c73af574b818ace`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:08:21.345872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-877980f9-5f3d-4b70-904c-c13cadaa7bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:21.354580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1138/2254] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:08:21 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:08:22.161784 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba0e41-03f4-4d16-9597-12d73f03f719 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:22.162295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba0e41-03f4-4d16-9597-12d73f03f719 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:22.162412 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ba0e41-03f4-4d16-9597-12d73f03f719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:22.181611 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-92ba0e41-03f4-4d16-9597-12d73f03f719 None None] MFA Rules not processed for user `75a27959e4354f11bcf13a1d254a6b56`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:08:22.182926 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-92ba0e41-03f4-4d16-9597-12d73f03f719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:22.190312 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1117/2255] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:08:22 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:08:22.513868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877980f9-5f3d-4b70-904c-c13cadaa7bed None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:22.523909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877980f9-5f3d-4b70-904c-c13cadaa7bed None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:22.528203 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5c0bf-1a90-48e8-bbbf-a2e3788230d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:22.532804 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5c0bf-1a90-48e8-bbbf-a2e3788230d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:22.532804 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5c0bf-1a90-48e8-bbbf-a2e3788230d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:22.532804 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5c0bf-1a90-48e8-bbbf-a2e3788230d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:22.532804 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f0d5c0bf-1a90-48e8-bbbf-a2e3788230d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:22.545347 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5c0bf-1a90-48e8-bbbf-a2e3788230d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:22.545347 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5c0bf-1a90-48e8-bbbf-a2e3788230d6 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:22.554344 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1139/2256] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:08:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:08:23.291728 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba0e41-03f4-4d16-9597-12d73f03f719 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:23.305023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ba0e41-03f4-4d16-9597-12d73f03f719 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:23.310648 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75d42d-1e96-4f32-9239-0ab72db3f3bd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:23.311254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75d42d-1e96-4f32-9239-0ab72db3f3bd service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:23.314002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75d42d-1e96-4f32-9239-0ab72db3f3bd service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:23.314002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75d42d-1e96-4f32-9239-0ab72db3f3bd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:23.314274 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ad75d42d-1e96-4f32-9239-0ab72db3f3bd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:23.326137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75d42d-1e96-4f32-9239-0ab72db3f3bd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:23.327737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75d42d-1e96-4f32-9239-0ab72db3f3bd service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:23.339144 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1118/2257] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:08:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:08:29.846348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71951d6e-cab3-4721-ba5a-5f03f0ef8070 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:29.846348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71951d6e-cab3-4721-ba5a-5f03f0ef8070 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:29.846348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71951d6e-cab3-4721-ba5a-5f03f0ef8070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:29.874070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-71951d6e-cab3-4721-ba5a-5f03f0ef8070 None None] MFA Rules not processed for user `9fd7a80714874e73bf64dfa392632391`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:08:29.879042 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-71951d6e-cab3-4721-ba5a-5f03f0ef8070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:29.906225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1140/2258] 10.222.0.59 () {58 vars in 967 bytes} [Tue Sep 13 20:08:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:08:30.090870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75d42d-1e96-4f32-9239-0ab72db3f3bd service nova] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:30.104975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75d42d-1e96-4f32-9239-0ab72db3f3bd service nova] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:30.112565 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910f8869-f120-4a53-ba08-6e76ef9261ab service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00e78bf5e5c4db29c47dce1e87f3f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:30.113281 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f8869-f120-4a53-ba08-6e76ef9261ab service swift] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:30.113567 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f8869-f120-4a53-ba08-6e76ef9261ab service swift] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:30.113867 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910f8869-f120-4a53-ba08-6e76ef9261ab service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:30.124078 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f8869-f120-4a53-ba08-6e76ef9261ab service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:30.126002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910f8869-f120-4a53-ba08-6e76ef9261ab service swift] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:30.136052 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1119/2259] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Sep 13 20:08:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:08:31.259266 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71951d6e-cab3-4721-ba5a-5f03f0ef8070 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:31.270189 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71951d6e-cab3-4721-ba5a-5f03f0ef8070 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:31.279055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a465d0-e835-4b91-b241-5986fc6d673c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:31.279941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a465d0-e835-4b91-b241-5986fc6d673c service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:31.280223 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a465d0-e835-4b91-b241-5986fc6d673c service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:31.280488 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a465d0-e835-4b91-b241-5986fc6d673c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:31.282263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-41a465d0-e835-4b91-b241-5986fc6d673c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:31.303205 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a465d0-e835-4b91-b241-5986fc6d673c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:31.304878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a465d0-e835-4b91-b241-5986fc6d673c service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:31.316874 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1141/2260] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:08:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:08:33.008534 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32851017-fc37-4595-bf02-432795b214f1 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:33.009131 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32851017-fc37-4595-bf02-432795b214f1 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:33.009131 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32851017-fc37-4595-bf02-432795b214f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:33.029766 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-32851017-fc37-4595-bf02-432795b214f1 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:08:33.031084 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-32851017-fc37-4595-bf02-432795b214f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:33.039284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1120/2261] 10.222.0.62 () {58 vars in 1016 bytes} [Tue Sep 13 20:08:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:08:33.070680 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a465d0-e835-4b91-b241-5986fc6d673c service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:33.083892 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a465d0-e835-4b91-b241-5986fc6d673c service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:33.089946 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93906e55-c4f0-494a-87d6-c32ee9f78e1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:33.090545 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93906e55-c4f0-494a-87d6-c32ee9f78e1f service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:33.090822 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93906e55-c4f0-494a-87d6-c32ee9f78e1f service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:33.091093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93906e55-c4f0-494a-87d6-c32ee9f78e1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:33.099441 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93906e55-c4f0-494a-87d6-c32ee9f78e1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:33.101022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93906e55-c4f0-494a-87d6-c32ee9f78e1f service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:33.110636 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1142/2262] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:08:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:08:35.243797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32851017-fc37-4595-bf02-432795b214f1 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:35.263817 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32851017-fc37-4595-bf02-432795b214f1 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:35.272888 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918ef89-9202-484b-8b4f-858528453751 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e7df5170c841abb449f3b4a547ec4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:35.273954 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918ef89-9202-484b-8b4f-858528453751 service placement] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:35.274645 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918ef89-9202-484b-8b4f-858528453751 service placement] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:35.275620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e918ef89-9202-484b-8b4f-858528453751 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:35.290480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e918ef89-9202-484b-8b4f-858528453751 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:35.308204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918ef89-9202-484b-8b4f-858528453751 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:35.310483 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e918ef89-9202-484b-8b4f-858528453751 service placement] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:35.322058 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1121/2263] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:08:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:08:39.165066 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93906e55-c4f0-494a-87d6-c32ee9f78e1f service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:39.166538 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-93906e55-c4f0-494a-87d6-c32ee9f78e1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:39.181210 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93906e55-c4f0-494a-87d6-c32ee9f78e1f service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:39.185872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c1009-a7e5-44ef-accd-a6b91f6c338b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:39.186488 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c1009-a7e5-44ef-accd-a6b91f6c338b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:39.186765 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c1009-a7e5-44ef-accd-a6b91f6c338b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:39.187031 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618c1009-a7e5-44ef-accd-a6b91f6c338b admin admin] PATH_INFO: `/v3/users/23226bd83acd46a8812632c0a117f9bc` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:39.188115 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c1009-a7e5-44ef-accd-a6b91f6c338b admin admin] RBAC: Authorizing `identity:delete_user(user_id=23226bd83acd46a8812632c0a117f9bc)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:39.190081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618c1009-a7e5-44ef-accd-a6b91f6c338b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:39.367371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-618c1009-a7e5-44ef-accd-a6b91f6c338b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23226bd83acd46a8812632c0a117f9bc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:39.461507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-618c1009-a7e5-44ef-accd-a6b91f6c338b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23226bd83acd46a8812632c0a117f9bc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:39.488666 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-618c1009-a7e5-44ef-accd-a6b91f6c338b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23226bd83acd46a8812632c0a117f9bc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:39.489400 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-618c1009-a7e5-44ef-accd-a6b91f6c338b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23226bd83acd46a8812632c0a117f9bc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:39.497568 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-618c1009-a7e5-44ef-accd-a6b91f6c338b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23226bd83acd46a8812632c0a117f9bc'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:39.504154 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1143/2264] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:08:39 2022] DELETE /identity/v3/users/23226bd83acd46a8812632c0a117f9bc => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:08:39.771455 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918ef89-9202-484b-8b4f-858528453751 service placement] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:39.789216 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e918ef89-9202-484b-8b4f-858528453751 service placement] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:39.850496 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca32aef-65d8-45e5-99ba-a62148d95fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:39.851216 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca32aef-65d8-45e5-99ba-a62148d95fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:39.851403 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca32aef-65d8-45e5-99ba-a62148d95fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:39.851745 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca32aef-65d8-45e5-99ba-a62148d95fa3 admin admin] PATH_INFO: `/v3/projects/d395559e5cf1480a99c70428f6f94689` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:39.852898 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca32aef-65d8-45e5-99ba-a62148d95fa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d395559e5cf1480a99c70428f6f94689)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:39.854917 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca32aef-65d8-45e5-99ba-a62148d95fa3 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:39.981648 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-fca32aef-65d8-45e5-99ba-a62148d95fa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd395559e5cf1480a99c70428f6f94689', 'request_id': 'req-fca32aef-65d8-45e5-99ba-a62148d95fa3'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:39.988823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-fca32aef-65d8-45e5-99ba-a62148d95fa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd395559e5cf1480a99c70428f6f94689', 'request_id': 'req-fca32aef-65d8-45e5-99ba-a62148d95fa3'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:39.995532 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-fca32aef-65d8-45e5-99ba-a62148d95fa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd395559e5cf1480a99c70428f6f94689', 'request_id': 'req-fca32aef-65d8-45e5-99ba-a62148d95fa3'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:40.055130 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-fca32aef-65d8-45e5-99ba-a62148d95fa3 admin admin] The token cache is being invalidate because project d395559e5cf1480a99c70428f6f94689 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:08:40.055350 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-fca32aef-65d8-45e5-99ba-a62148d95fa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:40.055964 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-fca32aef-65d8-45e5-99ba-a62148d95fa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:40.057478 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1122/2265] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:08:39 2022] DELETE /identity/v3/projects/d395559e5cf1480a99c70428f6f94689 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:08:40.061502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c1009-a7e5-44ef-accd-a6b91f6c338b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:40.062931 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-618c1009-a7e5-44ef-accd-a6b91f6c338b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:40.076454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618c1009-a7e5-44ef-accd-a6b91f6c338b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:40.132703 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07c40c7-ecea-44f0-9b01-b81c3ae331b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:40.133327 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c40c7-ecea-44f0-9b01-b81c3ae331b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:40.133601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c40c7-ecea-44f0-9b01-b81c3ae331b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:40.133928 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07c40c7-ecea-44f0-9b01-b81c3ae331b7 admin admin] PATH_INFO: `/v3/users/a2241fcd4464459b81ca304b29cb5196` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:40.135055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c40c7-ecea-44f0-9b01-b81c3ae331b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2241fcd4464459b81ca304b29cb5196)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:40.137001 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07c40c7-ecea-44f0-9b01-b81c3ae331b7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:40.158266 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:40.332461 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b07c40c7-ecea-44f0-9b01-b81c3ae331b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2241fcd4464459b81ca304b29cb5196'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:40.425644 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b07c40c7-ecea-44f0-9b01-b81c3ae331b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2241fcd4464459b81ca304b29cb5196'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:40.437774 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b07c40c7-ecea-44f0-9b01-b81c3ae331b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2241fcd4464459b81ca304b29cb5196'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:40.438416 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b07c40c7-ecea-44f0-9b01-b81c3ae331b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2241fcd4464459b81ca304b29cb5196'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:40.446702 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b07c40c7-ecea-44f0-9b01-b81c3ae331b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2241fcd4464459b81ca304b29cb5196'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:40.453155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1144/2266] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:08:40 2022] DELETE /identity/v3/users/a2241fcd4464459b81ca304b29cb5196 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:08:40.787875 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca32aef-65d8-45e5-99ba-a62148d95fa3 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:40.792159 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-fca32aef-65d8-45e5-99ba-a62148d95fa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:40.803178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca32aef-65d8-45e5-99ba-a62148d95fa3 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:40.838589 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:08:40.861126 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef90ef-ccf3-49a9-9d77-d46a0391df15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:40.861783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef90ef-ccf3-49a9-9d77-d46a0391df15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:40.862066 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef90ef-ccf3-49a9-9d77-d46a0391df15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:40.862339 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ef90ef-ccf3-49a9-9d77-d46a0391df15 admin admin] PATH_INFO: `/v3/projects/c5ccd92e67d84c4fa94686fc1fcb80b3` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:40.863446 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef90ef-ccf3-49a9-9d77-d46a0391df15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5ccd92e67d84c4fa94686fc1fcb80b3)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:40.865354 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ef90ef-ccf3-49a9-9d77-d46a0391df15 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:40.981924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-86ef90ef-ccf3-49a9-9d77-d46a0391df15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5ccd92e67d84c4fa94686fc1fcb80b3', 'request_id': 'req-86ef90ef-ccf3-49a9-9d77-d46a0391df15'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:40.989169 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-86ef90ef-ccf3-49a9-9d77-d46a0391df15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5ccd92e67d84c4fa94686fc1fcb80b3', 'request_id': 'req-86ef90ef-ccf3-49a9-9d77-d46a0391df15'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:40.995700 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-86ef90ef-ccf3-49a9-9d77-d46a0391df15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5ccd92e67d84c4fa94686fc1fcb80b3', 'request_id': 'req-86ef90ef-ccf3-49a9-9d77-d46a0391df15'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:41.066190 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-86ef90ef-ccf3-49a9-9d77-d46a0391df15 admin admin] The token cache is being invalidate because project c5ccd92e67d84c4fa94686fc1fcb80b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:08:41.066728 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-86ef90ef-ccf3-49a9-9d77-d46a0391df15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:41.067606 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-86ef90ef-ccf3-49a9-9d77-d46a0391df15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:08:41.069307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1123/2267] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:08:40 2022] DELETE /identity/v3/projects/c5ccd92e67d84c4fa94686fc1fcb80b3 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:08:41.711392 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c33c71-161f-4eda-a607-1170cd5db060 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:41.713300 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c33c71-161f-4eda-a607-1170cd5db060 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:41.713478 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c33c71-161f-4eda-a607-1170cd5db060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:41.735798 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-56c33c71-161f-4eda-a607-1170cd5db060 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:08:41.737003 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-56c33c71-161f-4eda-a607-1170cd5db060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:41.800743 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1145/2268] 10.222.0.62 () {58 vars in 1016 bytes} [Tue Sep 13 20:08:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:08:41.908648 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef90ef-ccf3-49a9-9d77-d46a0391df15 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:41.910097 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-86ef90ef-ccf3-49a9-9d77-d46a0391df15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:41.995674 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ef90ef-ccf3-49a9-9d77-d46a0391df15 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:42.001009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d110412-076f-4d12-ba29-4ed86dd26af8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:42.001654 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d110412-076f-4d12-ba29-4ed86dd26af8 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:42.001957 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d110412-076f-4d12-ba29-4ed86dd26af8 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:42.002226 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d110412-076f-4d12-ba29-4ed86dd26af8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:42.010132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d110412-076f-4d12-ba29-4ed86dd26af8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:42.011692 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d110412-076f-4d12-ba29-4ed86dd26af8 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:42.020762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1124/2269] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:08:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:08:46.681242 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96c743-3700-4d8c-a423-c7db912c0190 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:46.681678 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96c743-3700-4d8c-a423-c7db912c0190 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:46.681825 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96c743-3700-4d8c-a423-c7db912c0190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:46.701276 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2e96c743-3700-4d8c-a423-c7db912c0190 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:08:46.706709 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2e96c743-3700-4d8c-a423-c7db912c0190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:46.710764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1146/2270] 10.222.0.62 () {58 vars in 1016 bytes} [Tue Sep 13 20:08:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:08:46.729160 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d110412-076f-4d12-ba29-4ed86dd26af8 service nova] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:46.733761 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3d110412-076f-4d12-ba29-4ed86dd26af8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:46.745614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d110412-076f-4d12-ba29-4ed86dd26af8 service nova] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:46.751372 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a584748-68d1-45c1-982c-38834b4c8f08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:46.751982 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a584748-68d1-45c1-982c-38834b4c8f08 service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:46.755803 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a584748-68d1-45c1-982c-38834b4c8f08 service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:46.755803 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a584748-68d1-45c1-982c-38834b4c8f08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:46.760967 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a584748-68d1-45c1-982c-38834b4c8f08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:46.762628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a584748-68d1-45c1-982c-38834b4c8f08 service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:46.772604 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1125/2271] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:08:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:08:55.065901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a904a-c3b2-4150-98b9-a7f6e1910246 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:55.066437 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a904a-c3b2-4150-98b9-a7f6e1910246 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:55.066567 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247a904a-c3b2-4150-98b9-a7f6e1910246 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:55.088654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-247a904a-c3b2-4150-98b9-a7f6e1910246 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:08:55.090876 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-247a904a-c3b2-4150-98b9-a7f6e1910246 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:08:55.101126 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1147/2272] 10.222.0.62 () {58 vars in 1016 bytes} [Tue Sep 13 20:08:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:08:55.120796 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a584748-68d1-45c1-982c-38834b4c8f08 service nova] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:08:55.133505 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a584748-68d1-45c1-982c-38834b4c8f08 service nova] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:08:55.139873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5d568-2f38-4c3e-a402-0e95a8ce9bfa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:08:55.139873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5d568-2f38-4c3e-a402-0e95a8ce9bfa service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:08:55.140127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5d568-2f38-4c3e-a402-0e95a8ce9bfa service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:08:55.140391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5d568-2f38-4c3e-a402-0e95a8ce9bfa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:08:55.149605 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5d568-2f38-4c3e-a402-0e95a8ce9bfa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:08:55.151439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5d568-2f38-4c3e-a402-0e95a8ce9bfa service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:08:55.163085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1126/2273] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:08:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:09:00.377799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91931fc7-0d53-49cc-a328-e84934e70bf4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:00.378384 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91931fc7-0d53-49cc-a328-e84934e70bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:00.378486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91931fc7-0d53-49cc-a328-e84934e70bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:00.400110 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-91931fc7-0d53-49cc-a328-e84934e70bf4 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:00.401259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-91931fc7-0d53-49cc-a328-e84934e70bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:00.410097 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1148/2274] 10.222.0.62 () {58 vars in 1016 bytes} [Tue Sep 13 20:09:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:09:00.429945 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5d568-2f38-4c3e-a402-0e95a8ce9bfa service nova] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:00.441237 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5d568-2f38-4c3e-a402-0e95a8ce9bfa service nova] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:00.446780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b5743-7752-49ad-9eb5-0c9ce1435a2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:00.447468 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b5743-7752-49ad-9eb5-0c9ce1435a2f service nova] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:00.447747 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b5743-7752-49ad-9eb5-0c9ce1435a2f service nova] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:00.450827 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b5743-7752-49ad-9eb5-0c9ce1435a2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:00.458416 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b5743-7752-49ad-9eb5-0c9ce1435a2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:00.462521 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b5743-7752-49ad-9eb5-0c9ce1435a2f service nova] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:00.479586 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1127/2275] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:09:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:09:02.737885 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912cb33-2c4f-4c85-b24f-481b35694ff4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:02.738411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912cb33-2c4f-4c85-b24f-481b35694ff4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:02.738411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6912cb33-2c4f-4c85-b24f-481b35694ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:02.757516 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6912cb33-2c4f-4c85-b24f-481b35694ff4 None None] MFA Rules not processed for user `abb30d0c8b764bed8ca98f35ea070e86`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:02.758742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6912cb33-2c4f-4c85-b24f-481b35694ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:02.812181 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1149/2276] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:09:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:09:10.474090 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:12.805358 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=7,keystone:SELECT=81,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:20.606575 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b5743-7752-49ad-9eb5-0c9ce1435a2f service nova] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:20.608076 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-047b5743-7752-49ad-9eb5-0c9ce1435a2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:20.665073 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b5743-7752-49ad-9eb5-0c9ce1435a2f service nova] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:20.668582 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4efa5-9da2-4262-8bc9-0473e8639cd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:20.669186 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4efa5-9da2-4262-8bc9-0473e8639cd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:20.669497 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4efa5-9da2-4262-8bc9-0473e8639cd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:20.669810 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db4efa5-9da2-4262-8bc9-0473e8639cd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:20.671518 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7db4efa5-9da2-4262-8bc9-0473e8639cd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:20.683393 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4efa5-9da2-4262-8bc9-0473e8639cd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:20.684843 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db4efa5-9da2-4262-8bc9-0473e8639cd0 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:20.695109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1128/2277] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:09:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:09:24.937376 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912cb33-2c4f-4c85-b24f-481b35694ff4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:24.944124 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6912cb33-2c4f-4c85-b24f-481b35694ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:25.009558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6912cb33-2c4f-4c85-b24f-481b35694ff4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:25.014490 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d414714-5a9d-44c3-bf90-809cb0911820 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e7df5170c841abb449f3b4a547ec4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:25.015088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d414714-5a9d-44c3-bf90-809cb0911820 service placement] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:25.015364 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d414714-5a9d-44c3-bf90-809cb0911820 service placement] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:25.015660 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d414714-5a9d-44c3-bf90-809cb0911820 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:25.017377 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1d414714-5a9d-44c3-bf90-809cb0911820 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:25.029071 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d414714-5a9d-44c3-bf90-809cb0911820 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:25.031209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d414714-5a9d-44c3-bf90-809cb0911820 service placement] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:25.041481 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1150/2278] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:09:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:09:25.089792 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4efa5-9da2-4262-8bc9-0473e8639cd0 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:25.091644 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7db4efa5-9da2-4262-8bc9-0473e8639cd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:25.108405 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db4efa5-9da2-4262-8bc9-0473e8639cd0 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:25.113091 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d3118b-57d7-4a77-bf29-84dfcafc821e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:25.113802 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3118b-57d7-4a77-bf29-84dfcafc821e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:25.114085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3118b-57d7-4a77-bf29-84dfcafc821e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:25.114362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d3118b-57d7-4a77-bf29-84dfcafc821e admin admin] PATH_INFO: `/v3/users/c83ccb0008d04b4f98c05915e5748713` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:25.115618 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3118b-57d7-4a77-bf29-84dfcafc821e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c83ccb0008d04b4f98c05915e5748713)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:25.117545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d3118b-57d7-4a77-bf29-84dfcafc821e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:25.311116 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-94d3118b-57d7-4a77-bf29-84dfcafc821e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c83ccb0008d04b4f98c05915e5748713'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:25.418186 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-94d3118b-57d7-4a77-bf29-84dfcafc821e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c83ccb0008d04b4f98c05915e5748713'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:25.430994 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-94d3118b-57d7-4a77-bf29-84dfcafc821e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c83ccb0008d04b4f98c05915e5748713'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:25.431577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-94d3118b-57d7-4a77-bf29-84dfcafc821e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c83ccb0008d04b4f98c05915e5748713'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:25.439065 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-94d3118b-57d7-4a77-bf29-84dfcafc821e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c83ccb0008d04b4f98c05915e5748713'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:25.445258 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1129/2279] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:09:25 2022] DELETE /identity/v3/users/c83ccb0008d04b4f98c05915e5748713 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:09:25.722596 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d414714-5a9d-44c3-bf90-809cb0911820 service placement] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:25.735876 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d414714-5a9d-44c3-bf90-809cb0911820 service placement] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:25.814851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ae0875-026f-454d-a084-2b0f2a3f6d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:25.817962 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae0875-026f-454d-a084-2b0f2a3f6d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:25.817962 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae0875-026f-454d-a084-2b0f2a3f6d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:25.817962 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ae0875-026f-454d-a084-2b0f2a3f6d71 admin admin] PATH_INFO: `/v3/projects/847778f574cf425fa76d6df2abf9cb82` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:25.818989 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae0875-026f-454d-a084-2b0f2a3f6d71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=847778f574cf425fa76d6df2abf9cb82)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:25.821025 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ae0875-026f-454d-a084-2b0f2a3f6d71 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:25.956450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-80ae0875-026f-454d-a084-2b0f2a3f6d71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '847778f574cf425fa76d6df2abf9cb82', 'request_id': 'req-80ae0875-026f-454d-a084-2b0f2a3f6d71'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:26.006797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-80ae0875-026f-454d-a084-2b0f2a3f6d71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '847778f574cf425fa76d6df2abf9cb82', 'request_id': 'req-80ae0875-026f-454d-a084-2b0f2a3f6d71'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:26.012837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-80ae0875-026f-454d-a084-2b0f2a3f6d71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '847778f574cf425fa76d6df2abf9cb82', 'request_id': 'req-80ae0875-026f-454d-a084-2b0f2a3f6d71'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:26.024925 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-80ae0875-026f-454d-a084-2b0f2a3f6d71 admin admin] The token cache is being invalidate because project 847778f574cf425fa76d6df2abf9cb82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:09:26.025213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-80ae0875-026f-454d-a084-2b0f2a3f6d71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:26.026098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-80ae0875-026f-454d-a084-2b0f2a3f6d71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:26.027702 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1151/2280] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:09:25 2022] DELETE /identity/v3/projects/847778f574cf425fa76d6df2abf9cb82 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:09:26.032572 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a125f0-2b74-4f57-a2a6-2e386d5d3bca None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:26.032923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a125f0-2b74-4f57-a2a6-2e386d5d3bca None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:26.033281 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a125f0-2b74-4f57-a2a6-2e386d5d3bca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:26.053513 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-15a125f0-2b74-4f57-a2a6-2e386d5d3bca None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:26.054776 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-15a125f0-2b74-4f57-a2a6-2e386d5d3bca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:26.115152 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1130/2281] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:09:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:09:26.123042 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a75ab-a163-4eb6-9a56-2c58c619c2d9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:26.123344 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a75ab-a163-4eb6-9a56-2c58c619c2d9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:26.123620 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a75ab-a163-4eb6-9a56-2c58c619c2d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:26.146018 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-939a75ab-a163-4eb6-9a56-2c58c619c2d9 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:26.147223 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-939a75ab-a163-4eb6-9a56-2c58c619c2d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:26.155407 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1152/2282] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:09:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:09:26.159573 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a125f0-2b74-4f57-a2a6-2e386d5d3bca None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:26.174381 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a125f0-2b74-4f57-a2a6-2e386d5d3bca None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:26.174725 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71f3ca-1c7c-48b3-909e-5f18bc6fb663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:26.175334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71f3ca-1c7c-48b3-909e-5f18bc6fb663 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:26.175698 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71f3ca-1c7c-48b3-909e-5f18bc6fb663 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:26.175974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff71f3ca-1c7c-48b3-909e-5f18bc6fb663 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:26.176621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71f3ca-1c7c-48b3-909e-5f18bc6fb663 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:09:26.176923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71f3ca-1c7c-48b3-909e-5f18bc6fb663 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:26.178628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff71f3ca-1c7c-48b3-909e-5f18bc6fb663 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:26.192155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1131/2283] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:09:26.196581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a75ab-a163-4eb6-9a56-2c58c619c2d9 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:26.207125 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a75ab-a163-4eb6-9a56-2c58c619c2d9 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:26.211858 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabcdd7-8ddb-4770-9edb-7646a7da2979 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:26.212463 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabcdd7-8ddb-4770-9edb-7646a7da2979 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:26.212743 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabcdd7-8ddb-4770-9edb-7646a7da2979 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:26.213014 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dabcdd7-8ddb-4770-9edb-7646a7da2979 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:26.213652 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dabcdd7-8ddb-4770-9edb-7646a7da2979 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:26.215568 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dabcdd7-8ddb-4770-9edb-7646a7da2979 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:26.228288 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:26.312808 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1153/2284] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:09:26 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:09:26.316421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71f3ca-1c7c-48b3-909e-5f18bc6fb663 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:26.321915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:26.327545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff71f3ca-1c7c-48b3-909e-5f18bc6fb663 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:26.386152 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41051d7d-ca3b-40e0-86d7-bf6959410cb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:26.386763 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41051d7d-ca3b-40e0-86d7-bf6959410cb8 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:26.387046 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41051d7d-ca3b-40e0-86d7-bf6959410cb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:26.387322 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41051d7d-ca3b-40e0-86d7-bf6959410cb8 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:26.387979 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41051d7d-ca3b-40e0-86d7-bf6959410cb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:26.390000 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41051d7d-ca3b-40e0-86d7-bf6959410cb8 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:26.505235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1132/2285] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:09:26 2022] POST /identity/v3/users => generated 288 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:09:26.509284 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabcdd7-8ddb-4770-9edb-7646a7da2979 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:26.520021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dabcdd7-8ddb-4770-9edb-7646a7da2979 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:26.524882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a5980-3515-41c2-9639-cd3140a2c780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:26.525501 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a5980-3515-41c2-9639-cd3140a2c780 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:26.525829 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a5980-3515-41c2-9639-cd3140a2c780 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:26.526103 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0a5980-3515-41c2-9639-cd3140a2c780 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:26.526781 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a5980-3515-41c2-9639-cd3140a2c780 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:26.533415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0a5980-3515-41c2-9639-cd3140a2c780 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:26.550760 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1154/2286] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:09:26.552959 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41051d7d-ca3b-40e0-86d7-bf6959410cb8 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:26.563206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41051d7d-ca3b-40e0-86d7-bf6959410cb8 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:26.568386 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577ca34-961f-475f-b8f2-938db21688d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:26.569263 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577ca34-961f-475f-b8f2-938db21688d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:26.569546 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577ca34-961f-475f-b8f2-938db21688d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:26.569866 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577ca34-961f-475f-b8f2-938db21688d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:26.570502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577ca34-961f-475f-b8f2-938db21688d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:26.572160 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577ca34-961f-475f-b8f2-938db21688d0 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:26.583731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1133/2287] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:09:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:09:26.588028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a5980-3515-41c2-9639-cd3140a2c780 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:26.598745 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0a5980-3515-41c2-9639-cd3140a2c780 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:26.603643 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c591440-60c8-489e-8f8a-5358331dff10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:26.604299 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c591440-60c8-489e-8f8a-5358331dff10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:26.604581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c591440-60c8-489e-8f8a-5358331dff10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:26.604857 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c591440-60c8-489e-8f8a-5358331dff10 admin admin] PATH_INFO: `/v3/projects/ffb69bb0dbdf47d49e1034c9ac87fcb9/users/1ede1252b27446a2a3b3f46b7f690ac3/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:26.619643 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c591440-60c8-489e-8f8a-5358331dff10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffb69bb0dbdf47d49e1034c9ac87fcb9, user_id=1ede1252b27446a2a3b3f46b7f690ac3, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:26.622390 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c591440-60c8-489e-8f8a-5358331dff10 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:26.725592 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1155/2288] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:09:26 2022] PUT /identity/v3/projects/ffb69bb0dbdf47d49e1034c9ac87fcb9/users/1ede1252b27446a2a3b3f46b7f690ac3/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:09:26.737086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fa592-d8ff-46e9-846d-f5940a394ad6 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:26.737374 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fa592-d8ff-46e9-846d-f5940a394ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:26.737651 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298fa592-d8ff-46e9-846d-f5940a394ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:26.766523 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-298fa592-d8ff-46e9-846d-f5940a394ad6 None None] MFA Rules not processed for user `1ede1252b27446a2a3b3f46b7f690ac3`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:26.767756 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-298fa592-d8ff-46e9-846d-f5940a394ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:26.832226 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1134/2289] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:09:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:09:26.837026 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c591440-60c8-489e-8f8a-5358331dff10 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:26.898525 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c591440-60c8-489e-8f8a-5358331dff10 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:26.903216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf95ab-7002-4b5f-bcb8-a6bac92be90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:26.903831 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf95ab-7002-4b5f-bcb8-a6bac92be90f admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:26.904228 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf95ab-7002-4b5f-bcb8-a6bac92be90f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:26.904500 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bf95ab-7002-4b5f-bcb8-a6bac92be90f admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:26.905170 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf95ab-7002-4b5f-bcb8-a6bac92be90f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:26.907083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bf95ab-7002-4b5f-bcb8-a6bac92be90f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:26.992820 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1156/2290] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:09:26 2022] POST /identity/v3/projects => generated 377 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:09:26.994205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fa592-d8ff-46e9-846d-f5940a394ad6 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:27.004871 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298fa592-d8ff-46e9-846d-f5940a394ad6 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:27.061733 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359f6e5-8b60-4eb9-9790-8cb5b5801f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:27.062351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359f6e5-8b60-4eb9-9790-8cb5b5801f40 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:27.062631 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359f6e5-8b60-4eb9-9790-8cb5b5801f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:27.062904 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8359f6e5-8b60-4eb9-9790-8cb5b5801f40 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:27.063547 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359f6e5-8b60-4eb9-9790-8cb5b5801f40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:27.065442 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8359f6e5-8b60-4eb9-9790-8cb5b5801f40 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:27.156780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:27.161713 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1135/2291] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:09:26 2022] POST /identity/v3/users => generated 295 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:09:27.165781 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf95ab-7002-4b5f-bcb8-a6bac92be90f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:27.176677 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bf95ab-7002-4b5f-bcb8-a6bac92be90f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:27.181273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef22141-65f3-431b-84ab-44b7481eda6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:27.181886 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef22141-65f3-431b-84ab-44b7481eda6c admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:27.182205 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef22141-65f3-431b-84ab-44b7481eda6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:27.182473 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef22141-65f3-431b-84ab-44b7481eda6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:27.183109 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef22141-65f3-431b-84ab-44b7481eda6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:27.184680 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef22141-65f3-431b-84ab-44b7481eda6c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:27.195305 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1157/2292] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:09:27.199739 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359f6e5-8b60-4eb9-9790-8cb5b5801f40 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:27.209641 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8359f6e5-8b60-4eb9-9790-8cb5b5801f40 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:27.214277 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bd0a6-1ca7-4eb3-aba2-e863c5c31a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:27.214908 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bd0a6-1ca7-4eb3-aba2-e863c5c31a7d admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:27.215187 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bd0a6-1ca7-4eb3-aba2-e863c5c31a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:27.215456 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bd0a6-1ca7-4eb3-aba2-e863c5c31a7d admin admin] PATH_INFO: `/v3/projects/003de45b282242639c93de783d1a9b91/users/917df3522d3c4c368b9464a0906236ee/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:27.230817 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993bd0a6-1ca7-4eb3-aba2-e863c5c31a7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=003de45b282242639c93de783d1a9b91, user_id=917df3522d3c4c368b9464a0906236ee, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:27.234130 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993bd0a6-1ca7-4eb3-aba2-e863c5c31a7d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:27.309035 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1136/2293] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:09:27 2022] PUT /identity/v3/projects/003de45b282242639c93de783d1a9b91/users/917df3522d3c4c368b9464a0906236ee/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:09:27.313138 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef22141-65f3-431b-84ab-44b7481eda6c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:27.323095 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef22141-65f3-431b-84ab-44b7481eda6c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:27.378300 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6076c693-9fc5-478d-bbed-d012262716d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:27.378893 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076c693-9fc5-478d-bbed-d012262716d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:27.379177 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076c693-9fc5-478d-bbed-d012262716d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:27.379446 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6076c693-9fc5-478d-bbed-d012262716d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:27.380066 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076c693-9fc5-478d-bbed-d012262716d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:27.382008 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6076c693-9fc5-478d-bbed-d012262716d6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:27.391859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1158/2294] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:09:27 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:09:27.395966 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bd0a6-1ca7-4eb3-aba2-e863c5c31a7d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:27.406590 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bd0a6-1ca7-4eb3-aba2-e863c5c31a7d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:27.411074 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61ee74-7542-4988-a121-0eecf5ca0d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:27.411711 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61ee74-7542-4988-a121-0eecf5ca0d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:27.411989 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61ee74-7542-4988-a121-0eecf5ca0d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:27.412260 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a61ee74-7542-4988-a121-0eecf5ca0d1d admin admin] PATH_INFO: `/v3/projects/003de45b282242639c93de783d1a9b91/users/917df3522d3c4c368b9464a0906236ee/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:27.414149 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61ee74-7542-4988-a121-0eecf5ca0d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=003de45b282242639c93de783d1a9b91, user_id=917df3522d3c4c368b9464a0906236ee, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:27.416761 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a61ee74-7542-4988-a121-0eecf5ca0d1d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:27.426675 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1137/2295] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:09:27 2022] PUT /identity/v3/projects/003de45b282242639c93de783d1a9b91/users/917df3522d3c4c368b9464a0906236ee/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:09:27.436560 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad77959-b9d6-47b3-b694-e23c46d0401d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:27.436851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad77959-b9d6-47b3-b694-e23c46d0401d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:27.437131 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad77959-b9d6-47b3-b694-e23c46d0401d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:27.464660 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0ad77959-b9d6-47b3-b694-e23c46d0401d None None] MFA Rules not processed for user `917df3522d3c4c368b9464a0906236ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:27.465883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0ad77959-b9d6-47b3-b694-e23c46d0401d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:27.478717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:27.535064 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1159/2296] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:09:27 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:09:27.545912 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61ee74-7542-4988-a121-0eecf5ca0d1d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:27.547383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2a61ee74-7542-4988-a121-0eecf5ca0d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:27.619666 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a61ee74-7542-4988-a121-0eecf5ca0d1d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:27.626559 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1d930-fd90-4d99-888e-484477e10830 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:27.627434 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1d930-fd90-4d99-888e-484477e10830 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:27.627917 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1d930-fd90-4d99-888e-484477e10830 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:27.628258 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd1d930-fd90-4d99-888e-484477e10830 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:27.697762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1d930-fd90-4d99-888e-484477e10830 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:27.699384 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd1d930-fd90-4d99-888e-484477e10830 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:27.710137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1138/2297] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:09:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:09:31.060055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad77959-b9d6-47b3-b694-e23c46d0401d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:31.070266 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad77959-b9d6-47b3-b694-e23c46d0401d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:31.073763 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9d53e-7bd2-4ad7-9426-2174723aea7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:31.074635 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9d53e-7bd2-4ad7-9426-2174723aea7a service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:31.074915 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9d53e-7bd2-4ad7-9426-2174723aea7a service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:31.075179 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e9d53e-7bd2-4ad7-9426-2174723aea7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:31.084030 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9d53e-7bd2-4ad7-9426-2174723aea7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:31.085570 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e9d53e-7bd2-4ad7-9426-2174723aea7a service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:31.096920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1160/2298] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:09:31 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:09:37.705509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=63,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:41.091989 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=28 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:43.073000 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1d930-fd90-4d99-888e-484477e10830 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:43.074785 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ebd1d930-fd90-4d99-888e-484477e10830 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:43.140987 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd1d930-fd90-4d99-888e-484477e10830 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:43.145413 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fa3ea-375c-4be0-a2b7-75152008b987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:43.146076 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fa3ea-375c-4be0-a2b7-75152008b987 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:43.146358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fa3ea-375c-4be0-a2b7-75152008b987 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:43.146630 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fa3ea-375c-4be0-a2b7-75152008b987 admin admin] PATH_INFO: `/v3/users/2ac3ce4e64754e059555bd2aa82495bd` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:43.147735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5fa3ea-375c-4be0-a2b7-75152008b987 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ac3ce4e64754e059555bd2aa82495bd)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:43.149638 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5fa3ea-375c-4be0-a2b7-75152008b987 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:43.312431 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ff5fa3ea-375c-4be0-a2b7-75152008b987 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ac3ce4e64754e059555bd2aa82495bd'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:43.428845 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ff5fa3ea-375c-4be0-a2b7-75152008b987 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ac3ce4e64754e059555bd2aa82495bd'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:43.444936 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ff5fa3ea-375c-4be0-a2b7-75152008b987 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ac3ce4e64754e059555bd2aa82495bd'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:43.445602 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ff5fa3ea-375c-4be0-a2b7-75152008b987 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ac3ce4e64754e059555bd2aa82495bd'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:43.453040 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ff5fa3ea-375c-4be0-a2b7-75152008b987 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ac3ce4e64754e059555bd2aa82495bd'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:43.459009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1139/2299] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:09:43 2022] DELETE /identity/v3/users/2ac3ce4e64754e059555bd2aa82495bd => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:09:43.727506 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9d53e-7bd2-4ad7-9426-2174723aea7a service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:43.738476 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e9d53e-7bd2-4ad7-9426-2174723aea7a service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:43.795512 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a4095-6fa3-42e0-bc46-ca8086d895a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:43.796134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a4095-6fa3-42e0-bc46-ca8086d895a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:43.796417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a4095-6fa3-42e0-bc46-ca8086d895a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:43.796682 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a4095-6fa3-42e0-bc46-ca8086d895a2 admin admin] PATH_INFO: `/v3/projects/feadd538c5fa4776a353bf22bd964156` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:43.797801 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a4095-6fa3-42e0-bc46-ca8086d895a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=feadd538c5fa4776a353bf22bd964156)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:43.799679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a4095-6fa3-42e0-bc46-ca8086d895a2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:43.896074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-183a4095-6fa3-42e0-bc46-ca8086d895a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feadd538c5fa4776a353bf22bd964156', 'request_id': 'req-183a4095-6fa3-42e0-bc46-ca8086d895a2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:43.959694 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-183a4095-6fa3-42e0-bc46-ca8086d895a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feadd538c5fa4776a353bf22bd964156', 'request_id': 'req-183a4095-6fa3-42e0-bc46-ca8086d895a2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:43.965455 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-183a4095-6fa3-42e0-bc46-ca8086d895a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feadd538c5fa4776a353bf22bd964156', 'request_id': 'req-183a4095-6fa3-42e0-bc46-ca8086d895a2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:43.977263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-183a4095-6fa3-42e0-bc46-ca8086d895a2 admin admin] The token cache is being invalidate because project feadd538c5fa4776a353bf22bd964156 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:09:43.977573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-183a4095-6fa3-42e0-bc46-ca8086d895a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:43.978234 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-183a4095-6fa3-42e0-bc46-ca8086d895a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:43.979742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1161/2300] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:09:43 2022] DELETE /identity/v3/projects/feadd538c5fa4776a353bf22bd964156 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:09:45.734774 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fa3ea-375c-4be0-a2b7-75152008b987 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:45.736229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ff5fa3ea-375c-4be0-a2b7-75152008b987 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:45.749605 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fa3ea-375c-4be0-a2b7-75152008b987 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:45.805035 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3f418-8a19-4e1b-a93a-9c98f52c6150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:45.805658 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3f418-8a19-4e1b-a93a-9c98f52c6150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:45.805965 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3f418-8a19-4e1b-a93a-9c98f52c6150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:45.806237 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b3f418-8a19-4e1b-a93a-9c98f52c6150 admin admin] PATH_INFO: `/v3/users/1ede1252b27446a2a3b3f46b7f690ac3` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:45.807330 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3f418-8a19-4e1b-a93a-9c98f52c6150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ede1252b27446a2a3b3f46b7f690ac3)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:45.809234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b3f418-8a19-4e1b-a93a-9c98f52c6150 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:45.830935 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:46.025094 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-16b3f418-8a19-4e1b-a93a-9c98f52c6150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ede1252b27446a2a3b3f46b7f690ac3'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:46.084870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-16b3f418-8a19-4e1b-a93a-9c98f52c6150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ede1252b27446a2a3b3f46b7f690ac3'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:46.097956 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-16b3f418-8a19-4e1b-a93a-9c98f52c6150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ede1252b27446a2a3b3f46b7f690ac3'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:46.098611 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-16b3f418-8a19-4e1b-a93a-9c98f52c6150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ede1252b27446a2a3b3f46b7f690ac3'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:46.106176 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-16b3f418-8a19-4e1b-a93a-9c98f52c6150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ede1252b27446a2a3b3f46b7f690ac3'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:46.111973 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1140/2301] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:09:45 2022] DELETE /identity/v3/users/1ede1252b27446a2a3b3f46b7f690ac3 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:09:46.116391 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87849d2a-d07f-4072-ae94-f7501b096acd None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:46.116972 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87849d2a-d07f-4072-ae94-f7501b096acd None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:46.116972 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87849d2a-d07f-4072-ae94-f7501b096acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:46.135563 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-87849d2a-d07f-4072-ae94-f7501b096acd None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:46.136741 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-87849d2a-d07f-4072-ae94-f7501b096acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:46.193885 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1162/2302] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:09:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:09:46.204055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3f418-8a19-4e1b-a93a-9c98f52c6150 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:46.208768 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-16b3f418-8a19-4e1b-a93a-9c98f52c6150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:46.263838 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b3f418-8a19-4e1b-a93a-9c98f52c6150 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:46.267410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb7b93-a9df-496a-8880-d7d51effed94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:46.268013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb7b93-a9df-496a-8880-d7d51effed94 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:46.268313 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb7b93-a9df-496a-8880-d7d51effed94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:46.268568 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb7b93-a9df-496a-8880-d7d51effed94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:46.278221 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb7b93-a9df-496a-8880-d7d51effed94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:46.279592 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54cb7b93-a9df-496a-8880-d7d51effed94 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:46.288853 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1141/2303] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:09:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:09:46.725284 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87849d2a-d07f-4072-ae94-f7501b096acd None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:46.726727 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-87849d2a-d07f-4072-ae94-f7501b096acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:46.738584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87849d2a-d07f-4072-ae94-f7501b096acd None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:46.744171 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a798a6e-78ab-419c-b3b7-ec7aeb79259b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:46.744810 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a798a6e-78ab-419c-b3b7-ec7aeb79259b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:46.745089 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a798a6e-78ab-419c-b3b7-ec7aeb79259b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:46.745365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a798a6e-78ab-419c-b3b7-ec7aeb79259b admin admin] PATH_INFO: `/v3/projects/ffb69bb0dbdf47d49e1034c9ac87fcb9` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:46.746547 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a798a6e-78ab-419c-b3b7-ec7aeb79259b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffb69bb0dbdf47d49e1034c9ac87fcb9)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:46.748486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a798a6e-78ab-419c-b3b7-ec7aeb79259b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:46.869271 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:46.885718 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7a798a6e-78ab-419c-b3b7-ec7aeb79259b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffb69bb0dbdf47d49e1034c9ac87fcb9', 'request_id': 'req-7a798a6e-78ab-419c-b3b7-ec7aeb79259b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:46.951936 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7a798a6e-78ab-419c-b3b7-ec7aeb79259b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffb69bb0dbdf47d49e1034c9ac87fcb9', 'request_id': 'req-7a798a6e-78ab-419c-b3b7-ec7aeb79259b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:46.957861 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7a798a6e-78ab-419c-b3b7-ec7aeb79259b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffb69bb0dbdf47d49e1034c9ac87fcb9', 'request_id': 'req-7a798a6e-78ab-419c-b3b7-ec7aeb79259b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:46.969241 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7a798a6e-78ab-419c-b3b7-ec7aeb79259b admin admin] The token cache is being invalidate because project ffb69bb0dbdf47d49e1034c9ac87fcb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:09:46.969529 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7a798a6e-78ab-419c-b3b7-ec7aeb79259b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:46.970780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7a798a6e-78ab-419c-b3b7-ec7aeb79259b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:46.972246 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1163/2304] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:09:46 2022] DELETE /identity/v3/projects/ffb69bb0dbdf47d49e1034c9ac87fcb9 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:09:46.976194 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb7b93-a9df-496a-8880-d7d51effed94 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:46.985888 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cb7b93-a9df-496a-8880-d7d51effed94 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:47.041511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5801616-17ba-407e-9002-99e6595cbfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:47.042152 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5801616-17ba-407e-9002-99e6595cbfdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:47.042431 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5801616-17ba-407e-9002-99e6595cbfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:47.042985 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5801616-17ba-407e-9002-99e6595cbfdd admin admin] PATH_INFO: `/v3/users/917df3522d3c4c368b9464a0906236ee` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:47.044092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5801616-17ba-407e-9002-99e6595cbfdd admin admin] RBAC: Authorizing `identity:delete_user(user_id=917df3522d3c4c368b9464a0906236ee)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:47.046029 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5801616-17ba-407e-9002-99e6595cbfdd admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:47.193062 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:47.195744 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b5801616-17ba-407e-9002-99e6595cbfdd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '917df3522d3c4c368b9464a0906236ee'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:47.256351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b5801616-17ba-407e-9002-99e6595cbfdd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '917df3522d3c4c368b9464a0906236ee'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:47.269168 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b5801616-17ba-407e-9002-99e6595cbfdd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '917df3522d3c4c368b9464a0906236ee'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:47.269842 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b5801616-17ba-407e-9002-99e6595cbfdd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '917df3522d3c4c368b9464a0906236ee'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:47.276781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b5801616-17ba-407e-9002-99e6595cbfdd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '917df3522d3c4c368b9464a0906236ee'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:47.282724 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1142/2305] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:09:46 2022] DELETE /identity/v3/users/917df3522d3c4c368b9464a0906236ee => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:09:47.686843 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a798a6e-78ab-419c-b3b7-ec7aeb79259b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:47.688297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7a798a6e-78ab-419c-b3b7-ec7aeb79259b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:47.701616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a798a6e-78ab-419c-b3b7-ec7aeb79259b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:47.758698 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df037af-fcd9-49a5-a0fd-2a7ad9833703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:47.759333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df037af-fcd9-49a5-a0fd-2a7ad9833703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:47.759612 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df037af-fcd9-49a5-a0fd-2a7ad9833703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:47.759886 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df037af-fcd9-49a5-a0fd-2a7ad9833703 admin admin] PATH_INFO: `/v3/projects/003de45b282242639c93de783d1a9b91` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:47.760994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df037af-fcd9-49a5-a0fd-2a7ad9833703 admin admin] RBAC: Authorizing `identity:delete_project(project_id=003de45b282242639c93de783d1a9b91)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:47.762938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df037af-fcd9-49a5-a0fd-2a7ad9833703 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:47.861987 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8df037af-fcd9-49a5-a0fd-2a7ad9833703 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '003de45b282242639c93de783d1a9b91', 'request_id': 'req-8df037af-fcd9-49a5-a0fd-2a7ad9833703'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:47.913421 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8df037af-fcd9-49a5-a0fd-2a7ad9833703 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '003de45b282242639c93de783d1a9b91', 'request_id': 'req-8df037af-fcd9-49a5-a0fd-2a7ad9833703'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:47.919479 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8df037af-fcd9-49a5-a0fd-2a7ad9833703 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '003de45b282242639c93de783d1a9b91', 'request_id': 'req-8df037af-fcd9-49a5-a0fd-2a7ad9833703'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:47.930550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8df037af-fcd9-49a5-a0fd-2a7ad9833703 admin admin] The token cache is being invalidate because project 003de45b282242639c93de783d1a9b91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:09:47.930842 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8df037af-fcd9-49a5-a0fd-2a7ad9833703 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:47.931468 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8df037af-fcd9-49a5-a0fd-2a7ad9833703 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:47.932936 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1164/2306] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:09:47 2022] DELETE /identity/v3/projects/003de45b282242639c93de783d1a9b91 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:09:47.937852 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd44b6-83b3-4913-8d19-13c093155920 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:47.938136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd44b6-83b3-4913-8d19-13c093155920 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:47.938410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dd44b6-83b3-4913-8d19-13c093155920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:47.959454 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-03dd44b6-83b3-4913-8d19-13c093155920 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:47.960652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-03dd44b6-83b3-4913-8d19-13c093155920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:48.017207 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1143/2307] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:09:48.026874 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96b100-eebd-427e-80bd-7cef58c0ef4c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:48.027158 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96b100-eebd-427e-80bd-7cef58c0ef4c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:48.027432 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96b100-eebd-427e-80bd-7cef58c0ef4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:48.046576 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-cf96b100-eebd-427e-80bd-7cef58c0ef4c None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:48.047757 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cf96b100-eebd-427e-80bd-7cef58c0ef4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:48.055425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1165/2308] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:09:48.059383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd44b6-83b3-4913-8d19-13c093155920 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:48.069907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dd44b6-83b3-4913-8d19-13c093155920 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:48.074641 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ef3d4-f290-4188-8fa6-b3d75679213b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:48.075233 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ef3d4-f290-4188-8fa6-b3d75679213b admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:48.075512 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ef3d4-f290-4188-8fa6-b3d75679213b admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:48.075782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ef3d4-f290-4188-8fa6-b3d75679213b admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:48.076417 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ef3d4-f290-4188-8fa6-b3d75679213b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:09:48.076720 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ef3d4-f290-4188-8fa6-b3d75679213b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:48.078355 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ef3d4-f290-4188-8fa6-b3d75679213b admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:48.090285 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1144/2309] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:09:48.094224 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96b100-eebd-427e-80bd-7cef58c0ef4c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:48.103012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96b100-eebd-427e-80bd-7cef58c0ef4c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:48.107547 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce54100-f5b7-4f43-a0bf-9fdacca1e0fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:48.108126 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce54100-f5b7-4f43-a0bf-9fdacca1e0fa admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:48.108401 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce54100-f5b7-4f43-a0bf-9fdacca1e0fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:48.108669 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce54100-f5b7-4f43-a0bf-9fdacca1e0fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:48.109285 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce54100-f5b7-4f43-a0bf-9fdacca1e0fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:48.111201 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce54100-f5b7-4f43-a0bf-9fdacca1e0fa admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:48.199860 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1166/2310] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:09:48 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:09:48.204048 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ef3d4-f290-4188-8fa6-b3d75679213b admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:48.213970 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ef3d4-f290-4188-8fa6-b3d75679213b admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:48.271321 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8967d-bf99-41f2-8bde-7de397817292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:48.271864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8967d-bf99-41f2-8bde-7de397817292 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:48.272142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8967d-bf99-41f2-8bde-7de397817292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:48.272411 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c8967d-bf99-41f2-8bde-7de397817292 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:48.273035 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8967d-bf99-41f2-8bde-7de397817292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:48.274983 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c8967d-bf99-41f2-8bde-7de397817292 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:48.362838 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1145/2311] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:09:48 2022] POST /identity/v3/users => generated 292 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:09:48.367434 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce54100-f5b7-4f43-a0bf-9fdacca1e0fa admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:48.377408 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce54100-f5b7-4f43-a0bf-9fdacca1e0fa admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:48.382835 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e0e8d-fa8c-43bf-8392-00e8d5857996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:48.383543 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e0e8d-fa8c-43bf-8392-00e8d5857996 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:48.383827 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e0e8d-fa8c-43bf-8392-00e8d5857996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:48.384096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e0e8d-fa8c-43bf-8392-00e8d5857996 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:48.384739 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e0e8d-fa8c-43bf-8392-00e8d5857996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:48.386367 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83e0e8d-fa8c-43bf-8392-00e8d5857996 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:48.396282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1167/2312] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:09:48.399943 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8967d-bf99-41f2-8bde-7de397817292 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:48.410351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c8967d-bf99-41f2-8bde-7de397817292 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:48.414880 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04938551-0063-463a-a701-af7063f7b62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:48.415460 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04938551-0063-463a-a701-af7063f7b62c admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:48.415735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04938551-0063-463a-a701-af7063f7b62c admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:48.416005 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04938551-0063-463a-a701-af7063f7b62c admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:48.416634 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04938551-0063-463a-a701-af7063f7b62c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:48.418263 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04938551-0063-463a-a701-af7063f7b62c admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:48.428964 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1146/2313] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:09:48.432773 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e0e8d-fa8c-43bf-8392-00e8d5857996 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:48.438873 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:48.443102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e0e8d-fa8c-43bf-8392-00e8d5857996 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:48.447641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e5382-e27d-4c87-9dbb-ae37a034d1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:48.448534 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e5382-e27d-4c87-9dbb-ae37a034d1ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:48.448813 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e5382-e27d-4c87-9dbb-ae37a034d1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:48.449083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389e5382-e27d-4c87-9dbb-ae37a034d1ae admin admin] PATH_INFO: `/v3/projects/82ab22d8480e4b2a9fb3eed76e00ad5b/users/9ec07c1d47dc4c4290acf795bdf9b53d/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:48.463230 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e5382-e27d-4c87-9dbb-ae37a034d1ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=82ab22d8480e4b2a9fb3eed76e00ad5b, user_id=9ec07c1d47dc4c4290acf795bdf9b53d, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:48.465910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389e5382-e27d-4c87-9dbb-ae37a034d1ae admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:48.528888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1168/2314] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:09:48 2022] PUT /identity/v3/projects/82ab22d8480e4b2a9fb3eed76e00ad5b/users/9ec07c1d47dc4c4290acf795bdf9b53d/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:09:48.539588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfe773-24b1-406a-ab15-3d70f69d9fa2 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:48.539870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfe773-24b1-406a-ab15-3d70f69d9fa2 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:48.540137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dfe773-24b1-406a-ab15-3d70f69d9fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:48.568016 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-26dfe773-24b1-406a-ab15-3d70f69d9fa2 None None] MFA Rules not processed for user `9ec07c1d47dc4c4290acf795bdf9b53d`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:48.569234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-26dfe773-24b1-406a-ab15-3d70f69d9fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:48.581641 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:48.633306 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1147/2315] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:09:48 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:09:48.637797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e5382-e27d-4c87-9dbb-ae37a034d1ae admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:48.699655 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389e5382-e27d-4c87-9dbb-ae37a034d1ae admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:48.704402 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc0faf-76da-43a1-bb84-d3c504a23fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:48.705037 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc0faf-76da-43a1-bb84-d3c504a23fdb admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:48.705312 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc0faf-76da-43a1-bb84-d3c504a23fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:48.705622 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc0faf-76da-43a1-bb84-d3c504a23fdb admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:48.706278 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc0faf-76da-43a1-bb84-d3c504a23fdb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:48.708202 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52cc0faf-76da-43a1-bb84-d3c504a23fdb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:48.788065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1169/2316] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:09:48 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:09:48.792031 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfe773-24b1-406a-ab15-3d70f69d9fa2 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:48.804771 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dfe773-24b1-406a-ab15-3d70f69d9fa2 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:48.859468 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc705ee-6cdf-4336-98ea-b2bc27171dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:48.860074 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc705ee-6cdf-4336-98ea-b2bc27171dd5 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:48.860352 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc705ee-6cdf-4336-98ea-b2bc27171dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:48.860904 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc705ee-6cdf-4336-98ea-b2bc27171dd5 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:48.861525 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc705ee-6cdf-4336-98ea-b2bc27171dd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:48.863455 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc705ee-6cdf-4336-98ea-b2bc27171dd5 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:48.929843 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1148/2317] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:09:48 2022] POST /identity/v3/users => generated 300 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:09:48.933904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc0faf-76da-43a1-bb84-d3c504a23fdb admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:48.944147 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc0faf-76da-43a1-bb84-d3c504a23fdb admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:48.948978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e75f0-ef12-41a3-9c58-c5aec603f1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:48.949566 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e75f0-ef12-41a3-9c58-c5aec603f1d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:48.949876 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e75f0-ef12-41a3-9c58-c5aec603f1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:48.950143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365e75f0-ef12-41a3-9c58-c5aec603f1d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:48.950776 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e75f0-ef12-41a3-9c58-c5aec603f1d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:48.952349 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365e75f0-ef12-41a3-9c58-c5aec603f1d6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:48.963673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1170/2318] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:09:48.967514 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc705ee-6cdf-4336-98ea-b2bc27171dd5 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:48.978109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc705ee-6cdf-4336-98ea-b2bc27171dd5 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:48.982617 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825ac15-f0f6-4270-897c-cb8765215853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:48.983251 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825ac15-f0f6-4270-897c-cb8765215853 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:48.983527 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825ac15-f0f6-4270-897c-cb8765215853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:48.983796 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825ac15-f0f6-4270-897c-cb8765215853 admin admin] PATH_INFO: `/v3/projects/0ccc9ca615be4521b23003a011157a8d/users/52daa36dae8e407787ee9bfbbbdb92d0/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:48.998120 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825ac15-f0f6-4270-897c-cb8765215853 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ccc9ca615be4521b23003a011157a8d, user_id=52daa36dae8e407787ee9bfbbbdb92d0, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:49.000740 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e825ac15-f0f6-4270-897c-cb8765215853 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:49.056405 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1149/2319] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:09:48 2022] PUT /identity/v3/projects/0ccc9ca615be4521b23003a011157a8d/users/52daa36dae8e407787ee9bfbbbdb92d0/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:09:49.060236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e75f0-ef12-41a3-9c58-c5aec603f1d6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:49.070276 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365e75f0-ef12-41a3-9c58-c5aec603f1d6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:49.126010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec08e783-1102-4f12-9e54-b270d358c5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:49.126605 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08e783-1102-4f12-9e54-b270d358c5f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:49.126885 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08e783-1102-4f12-9e54-b270d358c5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:49.127157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec08e783-1102-4f12-9e54-b270d358c5f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:49.127790 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08e783-1102-4f12-9e54-b270d358c5f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:49.129378 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec08e783-1102-4f12-9e54-b270d358c5f0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:49.138915 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1171/2320] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:09:49.143233 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825ac15-f0f6-4270-897c-cb8765215853 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:49.153877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825ac15-f0f6-4270-897c-cb8765215853 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:49.158388 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa8bc7-3ed0-45c2-a817-ab27c1cedd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:49.159026 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa8bc7-3ed0-45c2-a817-ab27c1cedd6e admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:49.159299 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa8bc7-3ed0-45c2-a817-ab27c1cedd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:49.159566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aa8bc7-3ed0-45c2-a817-ab27c1cedd6e admin admin] PATH_INFO: `/v3/projects/0ccc9ca615be4521b23003a011157a8d/users/52daa36dae8e407787ee9bfbbbdb92d0/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:49.162024 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa8bc7-3ed0-45c2-a817-ab27c1cedd6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ccc9ca615be4521b23003a011157a8d, user_id=52daa36dae8e407787ee9bfbbbdb92d0, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:49.164636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12aa8bc7-3ed0-45c2-a817-ab27c1cedd6e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:49.174437 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1150/2321] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:09:49 2022] PUT /identity/v3/projects/0ccc9ca615be4521b23003a011157a8d/users/52daa36dae8e407787ee9bfbbbdb92d0/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:09:49.184566 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f8667-42f9-4f49-b494-0af70f9a8f48 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:49.184863 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f8667-42f9-4f49-b494-0af70f9a8f48 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:49.185211 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011f8667-42f9-4f49-b494-0af70f9a8f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:49.213331 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-011f8667-42f9-4f49-b494-0af70f9a8f48 None None] MFA Rules not processed for user `52daa36dae8e407787ee9bfbbbdb92d0`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:49.214575 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-011f8667-42f9-4f49-b494-0af70f9a8f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:49.254187 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:49.282414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1172/2322] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:09:49 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:09:49.293552 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa8bc7-3ed0-45c2-a817-ab27c1cedd6e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:49.295236 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-12aa8bc7-3ed0-45c2-a817-ab27c1cedd6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:49.351313 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aa8bc7-3ed0-45c2-a817-ab27c1cedd6e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:49.354827 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01933d96-1756-4d66-b4ef-0a1f64614632 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:49.355427 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01933d96-1756-4d66-b4ef-0a1f64614632 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:49.355705 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01933d96-1756-4d66-b4ef-0a1f64614632 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:49.355972 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01933d96-1756-4d66-b4ef-0a1f64614632 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:49.364766 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01933d96-1756-4d66-b4ef-0a1f64614632 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:49.366216 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01933d96-1756-4d66-b4ef-0a1f64614632 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:49.375325 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1151/2323] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:09:49 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:09:49.404710 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f8667-42f9-4f49-b494-0af70f9a8f48 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:49.465923 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011f8667-42f9-4f49-b494-0af70f9a8f48 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:49.470604 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9f445-2a2a-499c-b393-f1c797a818a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:49.471219 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9f445-2a2a-499c-b393-f1c797a818a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:49.471502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9f445-2a2a-499c-b393-f1c797a818a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:49.471768 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f9f445-2a2a-499c-b393-f1c797a818a0 admin admin] PATH_INFO: `/v3/users/9ec07c1d47dc4c4290acf795bdf9b53d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:49.472856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9f445-2a2a-499c-b393-f1c797a818a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9ec07c1d47dc4c4290acf795bdf9b53d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:49.474778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f9f445-2a2a-499c-b393-f1c797a818a0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:49.639404 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c7f9f445-2a2a-499c-b393-f1c797a818a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9ec07c1d47dc4c4290acf795bdf9b53d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:49.729220 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c7f9f445-2a2a-499c-b393-f1c797a818a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9ec07c1d47dc4c4290acf795bdf9b53d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:49.741603 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c7f9f445-2a2a-499c-b393-f1c797a818a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9ec07c1d47dc4c4290acf795bdf9b53d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:49.742327 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c7f9f445-2a2a-499c-b393-f1c797a818a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9ec07c1d47dc4c4290acf795bdf9b53d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:49.749328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c7f9f445-2a2a-499c-b393-f1c797a818a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9ec07c1d47dc4c4290acf795bdf9b53d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:49.755234 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1173/2324] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:09:49 2022] DELETE /identity/v3/users/9ec07c1d47dc4c4290acf795bdf9b53d => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:09:49.759649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff64e2-7715-44bd-9dbc-3b14cf94a3f8 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:49.760007 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff64e2-7715-44bd-9dbc-3b14cf94a3f8 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:49.760282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff64e2-7715-44bd-9dbc-3b14cf94a3f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:49.779327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-b3ff64e2-7715-44bd-9dbc-3b14cf94a3f8 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:49.780521 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b3ff64e2-7715-44bd-9dbc-3b14cf94a3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:49.785799 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:49.839857 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1152/2325] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:09:49.849968 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9f445-2a2a-499c-b393-f1c797a818a0 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:49.860253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c7f9f445-2a2a-499c-b393-f1c797a818a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:49.909491 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f9f445-2a2a-499c-b393-f1c797a818a0 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:49.913778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a71806-c08d-4287-8080-0c1efc9f7472 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:49.914381 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a71806-c08d-4287-8080-0c1efc9f7472 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:49.914657 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a71806-c08d-4287-8080-0c1efc9f7472 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:49.914927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a71806-c08d-4287-8080-0c1efc9f7472 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:49.923647 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a71806-c08d-4287-8080-0c1efc9f7472 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:49.925088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a71806-c08d-4287-8080-0c1efc9f7472 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:49.928953 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:49.935022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1174/2326] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:09:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:09:50.326481 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff64e2-7715-44bd-9dbc-3b14cf94a3f8 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:50.334893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b3ff64e2-7715-44bd-9dbc-3b14cf94a3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:50.340493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff64e2-7715-44bd-9dbc-3b14cf94a3f8 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:50.345136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137afdd2-00ef-4a4f-98ae-c87851579e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:50.345901 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137afdd2-00ef-4a4f-98ae-c87851579e36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:50.346219 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137afdd2-00ef-4a4f-98ae-c87851579e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:50.346495 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137afdd2-00ef-4a4f-98ae-c87851579e36 admin admin] PATH_INFO: `/v3/projects/82ab22d8480e4b2a9fb3eed76e00ad5b` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:50.347618 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137afdd2-00ef-4a4f-98ae-c87851579e36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82ab22d8480e4b2a9fb3eed76e00ad5b)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:50.349615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137afdd2-00ef-4a4f-98ae-c87851579e36 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:50.449534 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-137afdd2-00ef-4a4f-98ae-c87851579e36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82ab22d8480e4b2a9fb3eed76e00ad5b', 'request_id': 'req-137afdd2-00ef-4a4f-98ae-c87851579e36'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:50.455224 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-137afdd2-00ef-4a4f-98ae-c87851579e36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82ab22d8480e4b2a9fb3eed76e00ad5b', 'request_id': 'req-137afdd2-00ef-4a4f-98ae-c87851579e36'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:50.461443 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-137afdd2-00ef-4a4f-98ae-c87851579e36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82ab22d8480e4b2a9fb3eed76e00ad5b', 'request_id': 'req-137afdd2-00ef-4a4f-98ae-c87851579e36'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:50.545391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-137afdd2-00ef-4a4f-98ae-c87851579e36 admin admin] The token cache is being invalidate because project 82ab22d8480e4b2a9fb3eed76e00ad5b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:09:50.545681 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-137afdd2-00ef-4a4f-98ae-c87851579e36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:50.546330 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-137afdd2-00ef-4a4f-98ae-c87851579e36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:50.547808 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1153/2327] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:09:50 2022] DELETE /identity/v3/projects/82ab22d8480e4b2a9fb3eed76e00ad5b => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:09:50.552385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a71806-c08d-4287-8080-0c1efc9f7472 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:50.561858 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a71806-c08d-4287-8080-0c1efc9f7472 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:50.616826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa18f496-648f-4e7f-a48c-fb539bc516a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:50.617441 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18f496-648f-4e7f-a48c-fb539bc516a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:50.617740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18f496-648f-4e7f-a48c-fb539bc516a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:50.618013 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa18f496-648f-4e7f-a48c-fb539bc516a3 admin admin] PATH_INFO: `/v3/users/52daa36dae8e407787ee9bfbbbdb92d0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:50.619107 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18f496-648f-4e7f-a48c-fb539bc516a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52daa36dae8e407787ee9bfbbbdb92d0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:50.621004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa18f496-648f-4e7f-a48c-fb539bc516a3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:50.810797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fa18f496-648f-4e7f-a48c-fb539bc516a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52daa36dae8e407787ee9bfbbbdb92d0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:50.883649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fa18f496-648f-4e7f-a48c-fb539bc516a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52daa36dae8e407787ee9bfbbbdb92d0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:50.896811 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fa18f496-648f-4e7f-a48c-fb539bc516a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52daa36dae8e407787ee9bfbbbdb92d0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:50.897466 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fa18f496-648f-4e7f-a48c-fb539bc516a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52daa36dae8e407787ee9bfbbbdb92d0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:50.904369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-fa18f496-648f-4e7f-a48c-fb539bc516a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52daa36dae8e407787ee9bfbbbdb92d0'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:50.910215 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1175/2328] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:09:50 2022] DELETE /identity/v3/users/52daa36dae8e407787ee9bfbbbdb92d0 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:09:51.405164 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137afdd2-00ef-4a4f-98ae-c87851579e36 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:51.406608 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-137afdd2-00ef-4a4f-98ae-c87851579e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:51.420452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137afdd2-00ef-4a4f-98ae-c87851579e36 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:51.478531 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856d6806-40ec-46a4-888e-4fb627997352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:51.479162 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d6806-40ec-46a4-888e-4fb627997352 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:51.479436 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d6806-40ec-46a4-888e-4fb627997352 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:51.479705 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856d6806-40ec-46a4-888e-4fb627997352 admin admin] PATH_INFO: `/v3/projects/0ccc9ca615be4521b23003a011157a8d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:51.480796 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d6806-40ec-46a4-888e-4fb627997352 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ccc9ca615be4521b23003a011157a8d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:51.482748 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856d6806-40ec-46a4-888e-4fb627997352 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:51.591907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:51.600739 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-856d6806-40ec-46a4-888e-4fb627997352 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ccc9ca615be4521b23003a011157a8d', 'request_id': 'req-856d6806-40ec-46a4-888e-4fb627997352'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:51.606297 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-856d6806-40ec-46a4-888e-4fb627997352 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ccc9ca615be4521b23003a011157a8d', 'request_id': 'req-856d6806-40ec-46a4-888e-4fb627997352'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:51.612523 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-856d6806-40ec-46a4-888e-4fb627997352 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ccc9ca615be4521b23003a011157a8d', 'request_id': 'req-856d6806-40ec-46a4-888e-4fb627997352'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:51.688357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-856d6806-40ec-46a4-888e-4fb627997352 admin admin] The token cache is being invalidate because project 0ccc9ca615be4521b23003a011157a8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:09:51.688658 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-856d6806-40ec-46a4-888e-4fb627997352 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:51.689280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-856d6806-40ec-46a4-888e-4fb627997352 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:51.690793 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1154/2329] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:09:51 2022] DELETE /identity/v3/projects/0ccc9ca615be4521b23003a011157a8d => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:09:51.695638 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898e853-3e8a-42d8-b641-a614de44331c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:51.695923 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898e853-3e8a-42d8-b641-a614de44331c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:51.696200 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5898e853-3e8a-42d8-b641-a614de44331c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:51.716057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-5898e853-3e8a-42d8-b641-a614de44331c None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:51.717237 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5898e853-3e8a-42d8-b641-a614de44331c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:51.775869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1176/2330] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:09:51.784601 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943960cd-16d8-4115-bb96-b84f335fa609 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:51.784887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943960cd-16d8-4115-bb96-b84f335fa609 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:51.785192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943960cd-16d8-4115-bb96-b84f335fa609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:51.805473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-943960cd-16d8-4115-bb96-b84f335fa609 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:51.806700 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-943960cd-16d8-4115-bb96-b84f335fa609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:51.815714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1155/2331] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:09:51.819910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898e853-3e8a-42d8-b641-a614de44331c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:51.829822 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5898e853-3e8a-42d8-b641-a614de44331c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:51.834432 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea2db0-c6c6-4c9c-b89d-73bf4b76f154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:51.835051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea2db0-c6c6-4c9c-b89d-73bf4b76f154 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:51.835331 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea2db0-c6c6-4c9c-b89d-73bf4b76f154 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:51.835602 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ea2db0-c6c6-4c9c-b89d-73bf4b76f154 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:51.836266 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea2db0-c6c6-4c9c-b89d-73bf4b76f154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:09:51.836568 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea2db0-c6c6-4c9c-b89d-73bf4b76f154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:51.838197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ea2db0-c6c6-4c9c-b89d-73bf4b76f154 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:51.850120 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1177/2332] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:09:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:09:51.854330 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943960cd-16d8-4115-bb96-b84f335fa609 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:51.863261 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943960cd-16d8-4115-bb96-b84f335fa609 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:51.868364 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463730f7-4579-46b3-bf7b-103f7d7d82cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:51.868954 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463730f7-4579-46b3-bf7b-103f7d7d82cd admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:51.869228 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463730f7-4579-46b3-bf7b-103f7d7d82cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:51.869495 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463730f7-4579-46b3-bf7b-103f7d7d82cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:51.870156 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463730f7-4579-46b3-bf7b-103f7d7d82cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:51.872022 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463730f7-4579-46b3-bf7b-103f7d7d82cd admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:51.978398 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1156/2333] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:09:51 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:09:51.982571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea2db0-c6c6-4c9c-b89d-73bf4b76f154 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:51.988907 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:51.992827 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ea2db0-c6c6-4c9c-b89d-73bf4b76f154 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:52.047394 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec50d0c-f9ef-4972-b94b-bf83d4604a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:52.047988 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec50d0c-f9ef-4972-b94b-bf83d4604a2c admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:52.048294 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec50d0c-f9ef-4972-b94b-bf83d4604a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:52.048562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec50d0c-f9ef-4972-b94b-bf83d4604a2c admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:52.049177 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec50d0c-f9ef-4972-b94b-bf83d4604a2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:52.051105 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec50d0c-f9ef-4972-b94b-bf83d4604a2c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:52.124609 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1178/2334] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:09:51 2022] POST /identity/v3/users => generated 289 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:09:52.128601 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463730f7-4579-46b3-bf7b-103f7d7d82cd admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:52.138767 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463730f7-4579-46b3-bf7b-103f7d7d82cd admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:52.143240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09878c52-86b8-4f46-9d43-6909fcbd95eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:52.143836 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09878c52-86b8-4f46-9d43-6909fcbd95eb admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:52.144114 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09878c52-86b8-4f46-9d43-6909fcbd95eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:52.144384 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09878c52-86b8-4f46-9d43-6909fcbd95eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:52.145014 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09878c52-86b8-4f46-9d43-6909fcbd95eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:52.147138 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09878c52-86b8-4f46-9d43-6909fcbd95eb admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:52.156789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1157/2335] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:09:52.160609 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec50d0c-f9ef-4972-b94b-bf83d4604a2c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:52.170879 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec50d0c-f9ef-4972-b94b-bf83d4604a2c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:52.175387 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce0afd5-556e-4509-a5da-95cb9865ba1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:52.175989 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0afd5-556e-4509-a5da-95cb9865ba1a admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:52.176268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0afd5-556e-4509-a5da-95cb9865ba1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:52.176581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce0afd5-556e-4509-a5da-95cb9865ba1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:52.177213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0afd5-556e-4509-a5da-95cb9865ba1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:52.178816 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce0afd5-556e-4509-a5da-95cb9865ba1a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:52.189153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1179/2336] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:09:52.193102 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09878c52-86b8-4f46-9d43-6909fcbd95eb admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:52.203053 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09878c52-86b8-4f46-9d43-6909fcbd95eb admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:52.207520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35d39c-4a6c-4986-a322-c42d6034f12e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:52.208661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35d39c-4a6c-4986-a322-c42d6034f12e admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:52.208936 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35d39c-4a6c-4986-a322-c42d6034f12e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:52.209200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb35d39c-4a6c-4986-a322-c42d6034f12e admin admin] PATH_INFO: `/v3/projects/2fe34e62a02144aab52a20bd2be00412/users/abec6c7e16434895aedc32d3ce5d165d/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:52.224111 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35d39c-4a6c-4986-a322-c42d6034f12e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fe34e62a02144aab52a20bd2be00412, user_id=abec6c7e16434895aedc32d3ce5d165d, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:52.226781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb35d39c-4a6c-4986-a322-c42d6034f12e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:52.296041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1158/2337] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:09:52 2022] PUT /identity/v3/projects/2fe34e62a02144aab52a20bd2be00412/users/abec6c7e16434895aedc32d3ce5d165d/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:09:52.306245 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66132cee-a9ee-4772-937f-271510940d49 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:52.306618 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66132cee-a9ee-4772-937f-271510940d49 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:52.306907 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66132cee-a9ee-4772-937f-271510940d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:52.335662 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-66132cee-a9ee-4772-937f-271510940d49 None None] MFA Rules not processed for user `abec6c7e16434895aedc32d3ce5d165d`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:52.336863 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-66132cee-a9ee-4772-937f-271510940d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:52.398955 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1180/2338] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:09:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:09:52.403401 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35d39c-4a6c-4986-a322-c42d6034f12e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:52.467329 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb35d39c-4a6c-4986-a322-c42d6034f12e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:52.472001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d020ed-4042-4c95-a60f-3beadd40d4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:52.472609 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d020ed-4042-4c95-a60f-3beadd40d4e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:52.472888 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d020ed-4042-4c95-a60f-3beadd40d4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:52.473168 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d020ed-4042-4c95-a60f-3beadd40d4e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:52.473825 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d020ed-4042-4c95-a60f-3beadd40d4e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:52.475721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d020ed-4042-4c95-a60f-3beadd40d4e5 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:52.560343 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1159/2339] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:09:52 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:09:52.564510 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66132cee-a9ee-4772-937f-271510940d49 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:52.575753 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66132cee-a9ee-4772-937f-271510940d49 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:52.631160 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70124314-4833-4d0f-8db4-c664208c681a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:52.631755 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70124314-4833-4d0f-8db4-c664208c681a admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:52.632035 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70124314-4833-4d0f-8db4-c664208c681a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:52.632308 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70124314-4833-4d0f-8db4-c664208c681a admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:52.632938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70124314-4833-4d0f-8db4-c664208c681a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:52.634885 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70124314-4833-4d0f-8db4-c664208c681a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:52.712217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1181/2340] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:09:52 2022] POST /identity/v3/users => generated 295 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:09:52.716310 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d020ed-4042-4c95-a60f-3beadd40d4e5 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:52.727251 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d020ed-4042-4c95-a60f-3beadd40d4e5 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:52.731848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653eead-0a68-41a9-8a14-b2af5e4e2a0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:52.732445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653eead-0a68-41a9-8a14-b2af5e4e2a0e admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:52.732725 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653eead-0a68-41a9-8a14-b2af5e4e2a0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:52.733024 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0653eead-0a68-41a9-8a14-b2af5e4e2a0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:52.733664 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653eead-0a68-41a9-8a14-b2af5e4e2a0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:52.735379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0653eead-0a68-41a9-8a14-b2af5e4e2a0e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:52.745842 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1160/2341] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:09:52.749879 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70124314-4833-4d0f-8db4-c664208c681a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:52.754921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:52.760132 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70124314-4833-4d0f-8db4-c664208c681a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:52.764704 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9280f-0ede-48f9-9a6f-6e1b1ac287f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:52.765343 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9280f-0ede-48f9-9a6f-6e1b1ac287f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:52.765622 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9280f-0ede-48f9-9a6f-6e1b1ac287f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:52.765928 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e9280f-0ede-48f9-9a6f-6e1b1ac287f8 admin admin] PATH_INFO: `/v3/projects/bb7047d814ac43e4b870800e7581ac13/users/0a49050666db454396f8b681620274b7/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:52.780825 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9280f-0ede-48f9-9a6f-6e1b1ac287f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb7047d814ac43e4b870800e7581ac13, user_id=0a49050666db454396f8b681620274b7, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:52.783482 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e9280f-0ede-48f9-9a6f-6e1b1ac287f8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:52.844449 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1182/2342] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:09:52 2022] PUT /identity/v3/projects/bb7047d814ac43e4b870800e7581ac13/users/0a49050666db454396f8b681620274b7/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:09:52.849172 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653eead-0a68-41a9-8a14-b2af5e4e2a0e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:52.859167 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0653eead-0a68-41a9-8a14-b2af5e4e2a0e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:52.891305 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:52.915905 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebce939d-ebff-4f97-9415-7e3e27d11c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:52.916507 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce939d-ebff-4f97-9415-7e3e27d11c46 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:52.916783 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce939d-ebff-4f97-9415-7e3e27d11c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:52.917052 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebce939d-ebff-4f97-9415-7e3e27d11c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:52.917679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce939d-ebff-4f97-9415-7e3e27d11c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:52.919297 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebce939d-ebff-4f97-9415-7e3e27d11c46 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:52.928739 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1161/2343] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:09:52 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:09:52.932946 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9280f-0ede-48f9-9a6f-6e1b1ac287f8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:52.943198 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e9280f-0ede-48f9-9a6f-6e1b1ac287f8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:52.948116 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab0061-e987-4d66-bb9b-767e1343e15c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:52.948755 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab0061-e987-4d66-bb9b-767e1343e15c admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:52.949037 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab0061-e987-4d66-bb9b-767e1343e15c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:52.949308 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eab0061-e987-4d66-bb9b-767e1343e15c admin admin] PATH_INFO: `/v3/projects/bb7047d814ac43e4b870800e7581ac13/users/0a49050666db454396f8b681620274b7/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:52.951222 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab0061-e987-4d66-bb9b-767e1343e15c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb7047d814ac43e4b870800e7581ac13, user_id=0a49050666db454396f8b681620274b7, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:52.953886 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eab0061-e987-4d66-bb9b-767e1343e15c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:52.965068 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1183/2344] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:09:52 2022] PUT /identity/v3/projects/bb7047d814ac43e4b870800e7581ac13/users/0a49050666db454396f8b681620274b7/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:09:52.975570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04811ba0-a72d-44be-a87b-0f40a49be2f9 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:52.975858 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04811ba0-a72d-44be-a87b-0f40a49be2f9 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:52.976161 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04811ba0-a72d-44be-a87b-0f40a49be2f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:53.003449 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-04811ba0-a72d-44be-a87b-0f40a49be2f9 None None] MFA Rules not processed for user `0a49050666db454396f8b681620274b7`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:53.005155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-04811ba0-a72d-44be-a87b-0f40a49be2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:53.071384 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1162/2345] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:09:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:09:53.084538 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab0061-e987-4d66-bb9b-767e1343e15c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:53.086278 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9eab0061-e987-4d66-bb9b-767e1343e15c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:53.143439 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eab0061-e987-4d66-bb9b-767e1343e15c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:53.147526 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b0e0e-fd5a-4c1c-afa2-f9fbce96c38e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:53.148119 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b0e0e-fd5a-4c1c-afa2-f9fbce96c38e service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:53.148394 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b0e0e-fd5a-4c1c-afa2-f9fbce96c38e service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:53.148662 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859b0e0e-fd5a-4c1c-afa2-f9fbce96c38e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:53.202300 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b0e0e-fd5a-4c1c-afa2-f9fbce96c38e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:53.203706 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859b0e0e-fd5a-4c1c-afa2-f9fbce96c38e service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:53.212878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1184/2346] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:09:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:09:54.872517 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04811ba0-a72d-44be-a87b-0f40a49be2f9 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:54.873933 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-04811ba0-a72d-44be-a87b-0f40a49be2f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:54.916039 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04811ba0-a72d-44be-a87b-0f40a49be2f9 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:54.919561 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5fc7b5-b985-4629-9b1e-78564ae47759 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:54.920167 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fc7b5-b985-4629-9b1e-78564ae47759 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:54.920445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fc7b5-b985-4629-9b1e-78564ae47759 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:54.920712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5fc7b5-b985-4629-9b1e-78564ae47759 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:54.949432 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fc7b5-b985-4629-9b1e-78564ae47759 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:54.950910 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5fc7b5-b985-4629-9b1e-78564ae47759 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:54.960551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1163/2347] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:09:54 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:09:59.313312 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b0e0e-fd5a-4c1c-afa2-f9fbce96c38e service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:59.391697 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:59.408779 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859b0e0e-fd5a-4c1c-afa2-f9fbce96c38e service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:59.413892 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdaa4bc-21f0-40f3-a047-578257ee30d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:59.414507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdaa4bc-21f0-40f3-a047-578257ee30d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:59.414779 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdaa4bc-21f0-40f3-a047-578257ee30d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:59.415046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdaa4bc-21f0-40f3-a047-578257ee30d5 admin admin] PATH_INFO: `/v3/users/abec6c7e16434895aedc32d3ce5d165d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:59.416140 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdaa4bc-21f0-40f3-a047-578257ee30d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abec6c7e16434895aedc32d3ce5d165d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:59.418060 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdaa4bc-21f0-40f3-a047-578257ee30d5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:59.588331 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4fdaa4bc-21f0-40f3-a047-578257ee30d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abec6c7e16434895aedc32d3ce5d165d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:59.662041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4fdaa4bc-21f0-40f3-a047-578257ee30d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abec6c7e16434895aedc32d3ce5d165d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:59.674438 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4fdaa4bc-21f0-40f3-a047-578257ee30d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abec6c7e16434895aedc32d3ce5d165d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:59.678191 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4fdaa4bc-21f0-40f3-a047-578257ee30d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abec6c7e16434895aedc32d3ce5d165d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:59.682014 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4fdaa4bc-21f0-40f3-a047-578257ee30d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abec6c7e16434895aedc32d3ce5d165d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:09:59.687826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1185/2348] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:09:59 2022] DELETE /identity/v3/users/abec6c7e16434895aedc32d3ce5d165d => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:09:59.692186 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3124d1b-871f-4b87-ba57-3700aae77aff None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:59.692633 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3124d1b-871f-4b87-ba57-3700aae77aff None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:59.692756 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3124d1b-871f-4b87-ba57-3700aae77aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:59.732539 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-a3124d1b-871f-4b87-ba57-3700aae77aff None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:09:59.733770 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a3124d1b-871f-4b87-ba57-3700aae77aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:59.766695 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:09:59.792748 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1164/2349] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:09:59.802538 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdaa4bc-21f0-40f3-a047-578257ee30d5 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:09:59.803944 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4fdaa4bc-21f0-40f3-a047-578257ee30d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:09:59.861052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdaa4bc-21f0-40f3-a047-578257ee30d5 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:09:59.864569 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e238590-546a-44a5-8df7-c5d91da3460d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:09:59.865171 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e238590-546a-44a5-8df7-c5d91da3460d service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:09:59.865477 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e238590-546a-44a5-8df7-c5d91da3460d service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:09:59.865784 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e238590-546a-44a5-8df7-c5d91da3460d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:09:59.874740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e238590-546a-44a5-8df7-c5d91da3460d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:09:59.879191 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e238590-546a-44a5-8df7-c5d91da3460d service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:09:59.886333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1186/2350] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:09:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:10:00.269199 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3124d1b-871f-4b87-ba57-3700aae77aff None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:00.271886 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a3124d1b-871f-4b87-ba57-3700aae77aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:00.284835 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3124d1b-871f-4b87-ba57-3700aae77aff None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:00.290580 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa59afd-f365-4cff-8ca1-31efcb0d175b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:00.291222 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa59afd-f365-4cff-8ca1-31efcb0d175b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:00.291574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa59afd-f365-4cff-8ca1-31efcb0d175b admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:00.291751 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa59afd-f365-4cff-8ca1-31efcb0d175b admin admin] PATH_INFO: `/v3/projects/2fe34e62a02144aab52a20bd2be00412` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:00.292886 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa59afd-f365-4cff-8ca1-31efcb0d175b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fe34e62a02144aab52a20bd2be00412)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:00.294896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa59afd-f365-4cff-8ca1-31efcb0d175b admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:00.400042 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-8aa59afd-f365-4cff-8ca1-31efcb0d175b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fe34e62a02144aab52a20bd2be00412', 'request_id': 'req-8aa59afd-f365-4cff-8ca1-31efcb0d175b'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:00.406028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-8aa59afd-f365-4cff-8ca1-31efcb0d175b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fe34e62a02144aab52a20bd2be00412', 'request_id': 'req-8aa59afd-f365-4cff-8ca1-31efcb0d175b'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:00.412434 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-8aa59afd-f365-4cff-8ca1-31efcb0d175b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fe34e62a02144aab52a20bd2be00412', 'request_id': 'req-8aa59afd-f365-4cff-8ca1-31efcb0d175b'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:00.510776 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-8aa59afd-f365-4cff-8ca1-31efcb0d175b admin admin] The token cache is being invalidate because project 2fe34e62a02144aab52a20bd2be00412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:10:00.511064 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-8aa59afd-f365-4cff-8ca1-31efcb0d175b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:00.511740 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-8aa59afd-f365-4cff-8ca1-31efcb0d175b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:00.513339 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1165/2351] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:10:00 2022] DELETE /identity/v3/projects/2fe34e62a02144aab52a20bd2be00412 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:00.517441 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e238590-546a-44a5-8df7-c5d91da3460d service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:00.527469 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e238590-546a-44a5-8df7-c5d91da3460d service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:00.588098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9e6460-e3eb-4bf0-910a-c94e9cdc7e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:00.588737 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e6460-e3eb-4bf0-910a-c94e9cdc7e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:00.589017 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e6460-e3eb-4bf0-910a-c94e9cdc7e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:00.589289 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9e6460-e3eb-4bf0-910a-c94e9cdc7e49 admin admin] PATH_INFO: `/v3/users/0a49050666db454396f8b681620274b7` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:00.590434 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e6460-e3eb-4bf0-910a-c94e9cdc7e49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a49050666db454396f8b681620274b7)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:00.592678 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab9e6460-e3eb-4bf0-910a-c94e9cdc7e49 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:00.598226 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:00.795881 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ab9e6460-e3eb-4bf0-910a-c94e9cdc7e49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a49050666db454396f8b681620274b7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:00.882791 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ab9e6460-e3eb-4bf0-910a-c94e9cdc7e49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a49050666db454396f8b681620274b7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:00.898668 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ab9e6460-e3eb-4bf0-910a-c94e9cdc7e49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a49050666db454396f8b681620274b7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:00.900417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ab9e6460-e3eb-4bf0-910a-c94e9cdc7e49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a49050666db454396f8b681620274b7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:00.906814 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ab9e6460-e3eb-4bf0-910a-c94e9cdc7e49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a49050666db454396f8b681620274b7'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:00.913437 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1187/2352] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:10:00 2022] DELETE /identity/v3/users/0a49050666db454396f8b681620274b7 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:01.387366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa59afd-f365-4cff-8ca1-31efcb0d175b admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:01.396069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8aa59afd-f365-4cff-8ca1-31efcb0d175b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:01.404837 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa59afd-f365-4cff-8ca1-31efcb0d175b admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:01.462944 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744a397-75fc-4174-aeaf-c028475f5128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:01.463493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744a397-75fc-4174-aeaf-c028475f5128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:01.463773 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744a397-75fc-4174-aeaf-c028475f5128 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:01.464048 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744a397-75fc-4174-aeaf-c028475f5128 admin admin] PATH_INFO: `/v3/projects/bb7047d814ac43e4b870800e7581ac13` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:01.465163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744a397-75fc-4174-aeaf-c028475f5128 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb7047d814ac43e4b870800e7581ac13)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:01.467122 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744a397-75fc-4174-aeaf-c028475f5128 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:01.582813 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1744a397-75fc-4174-aeaf-c028475f5128 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb7047d814ac43e4b870800e7581ac13', 'request_id': 'req-1744a397-75fc-4174-aeaf-c028475f5128'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:01.588844 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1744a397-75fc-4174-aeaf-c028475f5128 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb7047d814ac43e4b870800e7581ac13', 'request_id': 'req-1744a397-75fc-4174-aeaf-c028475f5128'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:01.595082 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1744a397-75fc-4174-aeaf-c028475f5128 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb7047d814ac43e4b870800e7581ac13', 'request_id': 'req-1744a397-75fc-4174-aeaf-c028475f5128'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:01.596737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:01.654796 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1744a397-75fc-4174-aeaf-c028475f5128 admin admin] The token cache is being invalidate because project bb7047d814ac43e4b870800e7581ac13 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:10:01.655087 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1744a397-75fc-4174-aeaf-c028475f5128 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:01.655709 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1744a397-75fc-4174-aeaf-c028475f5128 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:01.657297 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1166/2353] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:10:01 2022] DELETE /identity/v3/projects/bb7047d814ac43e4b870800e7581ac13 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:01.662392 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ba8c1-8d6c-4786-9356-400bc46d6950 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:01.667730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ba8c1-8d6c-4786-9356-400bc46d6950 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:01.667730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02ba8c1-8d6c-4786-9356-400bc46d6950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:01.712018 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c02ba8c1-8d6c-4786-9356-400bc46d6950 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:01.713283 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c02ba8c1-8d6c-4786-9356-400bc46d6950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:01.770558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1188/2354] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:01.778788 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa4868-3e57-4d53-942a-c2640f8c7d9a None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:01.779074 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa4868-3e57-4d53-942a-c2640f8c7d9a None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:01.779369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bfa4868-3e57-4d53-942a-c2640f8c7d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:01.799479 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-6bfa4868-3e57-4d53-942a-c2640f8c7d9a None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:01.800675 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6bfa4868-3e57-4d53-942a-c2640f8c7d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:01.808404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1167/2355] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:01.812564 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ba8c1-8d6c-4786-9356-400bc46d6950 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:01.822024 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02ba8c1-8d6c-4786-9356-400bc46d6950 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:01.826779 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac79221-e70a-4331-98c4-78089b0ce05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:01.827369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac79221-e70a-4331-98c4-78089b0ce05e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:01.827647 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac79221-e70a-4331-98c4-78089b0ce05e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:01.827919 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac79221-e70a-4331-98c4-78089b0ce05e admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:01.828561 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac79221-e70a-4331-98c4-78089b0ce05e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:10:01.828861 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac79221-e70a-4331-98c4-78089b0ce05e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:01.830507 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac79221-e70a-4331-98c4-78089b0ce05e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:01.842403 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1189/2356] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:10:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:10:01.846433 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa4868-3e57-4d53-942a-c2640f8c7d9a None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:01.855985 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bfa4868-3e57-4d53-942a-c2640f8c7d9a None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:01.860525 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecbcba-1244-448e-91a9-fe5739dac6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:01.861109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecbcba-1244-448e-91a9-fe5739dac6af admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:01.861383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecbcba-1244-448e-91a9-fe5739dac6af admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:01.861650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ecbcba-1244-448e-91a9-fe5739dac6af admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:01.862294 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ecbcba-1244-448e-91a9-fe5739dac6af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:01.864165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21ecbcba-1244-448e-91a9-fe5739dac6af admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:01.947607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1168/2357] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:10:01 2022] POST /identity/v3/projects => generated 381 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:10:01.952007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac79221-e70a-4331-98c4-78089b0ce05e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:01.962524 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac79221-e70a-4331-98c4-78089b0ce05e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:02.006374 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:02.017705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4dec6-bba1-41af-ab50-a0aa768b8587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:02.020132 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4dec6-bba1-41af-ab50-a0aa768b8587 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:02.020132 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4dec6-bba1-41af-ab50-a0aa768b8587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:02.020132 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df4dec6-bba1-41af-ab50-a0aa768b8587 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:02.020132 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4dec6-bba1-41af-ab50-a0aa768b8587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:02.022098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df4dec6-bba1-41af-ab50-a0aa768b8587 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:02.106598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1190/2358] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:10:01 2022] POST /identity/v3/users => generated 291 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:10:02.110677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecbcba-1244-448e-91a9-fe5739dac6af admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:02.120840 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ecbcba-1244-448e-91a9-fe5739dac6af admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:02.125676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2352398-41de-468a-80c1-63310bf3a8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:02.126306 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2352398-41de-468a-80c1-63310bf3a8de admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:02.126614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2352398-41de-468a-80c1-63310bf3a8de admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:02.126892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2352398-41de-468a-80c1-63310bf3a8de admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:02.127567 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2352398-41de-468a-80c1-63310bf3a8de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:02.129188 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2352398-41de-468a-80c1-63310bf3a8de admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:02.139892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1169/2359] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:10:02.143994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4dec6-bba1-41af-ab50-a0aa768b8587 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:02.154487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df4dec6-bba1-41af-ab50-a0aa768b8587 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:02.159170 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee29de8-21df-4113-8594-dfb8f3640fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:02.159761 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee29de8-21df-4113-8594-dfb8f3640fbf admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:02.160044 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee29de8-21df-4113-8594-dfb8f3640fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:02.160320 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee29de8-21df-4113-8594-dfb8f3640fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:02.160959 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee29de8-21df-4113-8594-dfb8f3640fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:02.162592 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee29de8-21df-4113-8594-dfb8f3640fbf admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:02.174561 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1191/2360] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:10:02.178592 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2352398-41de-468a-80c1-63310bf3a8de admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:02.188334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2352398-41de-468a-80c1-63310bf3a8de admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:02.192850 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff66f4-de3d-4016-aefb-9c80d6915ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:02.194024 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff66f4-de3d-4016-aefb-9c80d6915ad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:02.194293 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff66f4-de3d-4016-aefb-9c80d6915ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:02.194556 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caff66f4-de3d-4016-aefb-9c80d6915ad6 admin admin] PATH_INFO: `/v3/projects/6cef4c4465da432798c265150e5dd764/users/7c83107241254f8b9e540318a3db42dc/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:02.209723 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff66f4-de3d-4016-aefb-9c80d6915ad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cef4c4465da432798c265150e5dd764, user_id=7c83107241254f8b9e540318a3db42dc, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:02.212367 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caff66f4-de3d-4016-aefb-9c80d6915ad6 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:02.278583 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1170/2361] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:10:02 2022] PUT /identity/v3/projects/6cef4c4465da432798c265150e5dd764/users/7c83107241254f8b9e540318a3db42dc/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:02.288730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a69692-f56e-4627-b101-ce7192c0a91b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:02.289017 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a69692-f56e-4627-b101-ce7192c0a91b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:02.289290 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a69692-f56e-4627-b101-ce7192c0a91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:02.316459 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f1a69692-f56e-4627-b101-ce7192c0a91b None None] MFA Rules not processed for user `7c83107241254f8b9e540318a3db42dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:02.317674 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f1a69692-f56e-4627-b101-ce7192c0a91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:02.381538 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1192/2362] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:10:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:02.385978 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff66f4-de3d-4016-aefb-9c80d6915ad6 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:02.446123 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caff66f4-de3d-4016-aefb-9c80d6915ad6 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:02.450997 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dbcf9-764a-4db8-adf3-29f66a38a16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:02.451600 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dbcf9-764a-4db8-adf3-29f66a38a16d admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:02.451879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dbcf9-764a-4db8-adf3-29f66a38a16d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:02.452176 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8dbcf9-764a-4db8-adf3-29f66a38a16d admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:02.452793 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dbcf9-764a-4db8-adf3-29f66a38a16d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:02.454715 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8dbcf9-764a-4db8-adf3-29f66a38a16d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:02.548063 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1171/2363] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:10:02 2022] POST /identity/v3/projects => generated 383 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:10:02.551852 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a69692-f56e-4627-b101-ce7192c0a91b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:02.563016 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a69692-f56e-4627-b101-ce7192c0a91b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:02.619631 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c51c3f-ba87-4485-a86b-629f3a209a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:02.620235 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c51c3f-ba87-4485-a86b-629f3a209a09 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:02.620518 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c51c3f-ba87-4485-a86b-629f3a209a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:02.620794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c51c3f-ba87-4485-a86b-629f3a209a09 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:02.621419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c51c3f-ba87-4485-a86b-629f3a209a09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:02.623381 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c51c3f-ba87-4485-a86b-629f3a209a09 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:02.689907 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1193/2364] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:10:02 2022] POST /identity/v3/users => generated 298 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:10:02.694666 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dbcf9-764a-4db8-adf3-29f66a38a16d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:02.705453 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8dbcf9-764a-4db8-adf3-29f66a38a16d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:02.710163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf973b-6c2b-43a5-bb89-1398ac19b703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:02.710765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf973b-6c2b-43a5-bb89-1398ac19b703 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:02.711048 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf973b-6c2b-43a5-bb89-1398ac19b703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:02.711326 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdf973b-6c2b-43a5-bb89-1398ac19b703 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:02.711972 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf973b-6c2b-43a5-bb89-1398ac19b703 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:02.713600 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdf973b-6c2b-43a5-bb89-1398ac19b703 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:02.724338 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1172/2365] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:10:02.729009 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c51c3f-ba87-4485-a86b-629f3a209a09 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:02.739113 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c51c3f-ba87-4485-a86b-629f3a209a09 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:02.744283 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9d93e-88f3-43c3-ab25-6f8cba64e07e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:02.744919 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9d93e-88f3-43c3-ab25-6f8cba64e07e admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:02.748899 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9d93e-88f3-43c3-ab25-6f8cba64e07e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:02.748899 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff9d93e-88f3-43c3-ab25-6f8cba64e07e admin admin] PATH_INFO: `/v3/projects/f5c17e71b07d45c38cfbfe4c1a37cf44/users/40eb6fdc815849f99efb6d819dec8a3e/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:02.760236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9d93e-88f3-43c3-ab25-6f8cba64e07e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5c17e71b07d45c38cfbfe4c1a37cf44, user_id=40eb6fdc815849f99efb6d819dec8a3e, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:02.762928 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff9d93e-88f3-43c3-ab25-6f8cba64e07e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:02.825197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1194/2366] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:10:02 2022] PUT /identity/v3/projects/f5c17e71b07d45c38cfbfe4c1a37cf44/users/40eb6fdc815849f99efb6d819dec8a3e/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:02.829166 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf973b-6c2b-43a5-bb89-1398ac19b703 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:02.839339 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdf973b-6c2b-43a5-bb89-1398ac19b703 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:02.895052 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3942550-4123-4303-a5ae-c0bfc5fadadd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:02.895052 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3942550-4123-4303-a5ae-c0bfc5fadadd admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:02.895341 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3942550-4123-4303-a5ae-c0bfc5fadadd admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:02.895612 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3942550-4123-4303-a5ae-c0bfc5fadadd admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:02.896246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3942550-4123-4303-a5ae-c0bfc5fadadd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:02.898240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3942550-4123-4303-a5ae-c0bfc5fadadd admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:02.900277 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:02.908576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1173/2367] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:10:02.913165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9d93e-88f3-43c3-ab25-6f8cba64e07e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:02.923112 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff9d93e-88f3-43c3-ab25-6f8cba64e07e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:02.928498 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234dff52-38c7-4f8f-9159-5053503fb8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:02.929154 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234dff52-38c7-4f8f-9159-5053503fb8af admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:02.929436 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234dff52-38c7-4f8f-9159-5053503fb8af admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:02.929811 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234dff52-38c7-4f8f-9159-5053503fb8af admin admin] PATH_INFO: `/v3/projects/f5c17e71b07d45c38cfbfe4c1a37cf44/users/40eb6fdc815849f99efb6d819dec8a3e/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:02.931713 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234dff52-38c7-4f8f-9159-5053503fb8af admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5c17e71b07d45c38cfbfe4c1a37cf44, user_id=40eb6fdc815849f99efb6d819dec8a3e, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:02.934410 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234dff52-38c7-4f8f-9159-5053503fb8af admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:02.944728 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1195/2368] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:10:02 2022] PUT /identity/v3/projects/f5c17e71b07d45c38cfbfe4c1a37cf44/users/40eb6fdc815849f99efb6d819dec8a3e/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:02.955910 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a1c3f-a518-46b6-a85a-8a2f26451bf4 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:02.956447 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a1c3f-a518-46b6-a85a-8a2f26451bf4 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:02.956897 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a1c3f-a518-46b6-a85a-8a2f26451bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:02.985060 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-546a1c3f-a518-46b6-a85a-8a2f26451bf4 None None] MFA Rules not processed for user `40eb6fdc815849f99efb6d819dec8a3e`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:02.986729 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-546a1c3f-a518-46b6-a85a-8a2f26451bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:03.054277 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1174/2369] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:10:02 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:03.064802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234dff52-38c7-4f8f-9159-5053503fb8af admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:03.066472 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-234dff52-38c7-4f8f-9159-5053503fb8af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:03.077482 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:03.124041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234dff52-38c7-4f8f-9159-5053503fb8af admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:03.127664 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af451aa8-0223-447b-8ffe-e94bfc9a359a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:03.128255 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af451aa8-0223-447b-8ffe-e94bfc9a359a service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:03.128538 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af451aa8-0223-447b-8ffe-e94bfc9a359a service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:03.128813 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af451aa8-0223-447b-8ffe-e94bfc9a359a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:03.138345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af451aa8-0223-447b-8ffe-e94bfc9a359a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:03.139788 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af451aa8-0223-447b-8ffe-e94bfc9a359a service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:03.149589 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1196/2370] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:03 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:10:03.251930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a1c3f-a518-46b6-a85a-8a2f26451bf4 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:03.261724 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a1c3f-a518-46b6-a85a-8a2f26451bf4 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:03.265344 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f3297-bcec-40f1-a45a-b0286bf4bf7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:03.266468 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f3297-bcec-40f1-a45a-b0286bf4bf7e service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:03.266750 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f3297-bcec-40f1-a45a-b0286bf4bf7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:03.267024 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f3297-bcec-40f1-a45a-b0286bf4bf7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:03.324970 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f3297-bcec-40f1-a45a-b0286bf4bf7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:03.326420 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f3297-bcec-40f1-a45a-b0286bf4bf7e service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:03.335688 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1175/2371] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:03 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:10:05.859848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af451aa8-0223-447b-8ffe-e94bfc9a359a service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:05.861267 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-af451aa8-0223-447b-8ffe-e94bfc9a359a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:05.953307 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af451aa8-0223-447b-8ffe-e94bfc9a359a service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:05.958370 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e9662b-02b3-472a-86a1-772d65a022f2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e7df5170c841abb449f3b4a547ec4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:05.958971 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9662b-02b3-472a-86a1-772d65a022f2 service placement] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:05.959249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9662b-02b3-472a-86a1-772d65a022f2 service placement] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:05.959519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e9662b-02b3-472a-86a1-772d65a022f2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:05.961222 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-95e9662b-02b3-472a-86a1-772d65a022f2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:05.972186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9662b-02b3-472a-86a1-772d65a022f2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:05.973777 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e9662b-02b3-472a-86a1-772d65a022f2 service placement] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:05.983835 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1197/2372] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:05 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:10:06.355993 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f3297-bcec-40f1-a45a-b0286bf4bf7e service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:06.421026 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f3297-bcec-40f1-a45a-b0286bf4bf7e service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:06.425885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0b077-d404-4c98-899b-ec10b7908c3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:06.426537 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0b077-d404-4c98-899b-ec10b7908c3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:06.426816 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0b077-d404-4c98-899b-ec10b7908c3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:06.427088 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0b077-d404-4c98-899b-ec10b7908c3c admin admin] PATH_INFO: `/v3/users/7c83107241254f8b9e540318a3db42dc` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:06.428194 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0b077-d404-4c98-899b-ec10b7908c3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=7c83107241254f8b9e540318a3db42dc)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:06.430137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0b077-d404-4c98-899b-ec10b7908c3c admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:06.453741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:06.636215 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-18c0b077-d404-4c98-899b-ec10b7908c3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7c83107241254f8b9e540318a3db42dc'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:06.695613 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-18c0b077-d404-4c98-899b-ec10b7908c3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7c83107241254f8b9e540318a3db42dc'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:06.709054 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-18c0b077-d404-4c98-899b-ec10b7908c3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7c83107241254f8b9e540318a3db42dc'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:06.709733 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-18c0b077-d404-4c98-899b-ec10b7908c3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7c83107241254f8b9e540318a3db42dc'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:06.716589 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-18c0b077-d404-4c98-899b-ec10b7908c3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7c83107241254f8b9e540318a3db42dc'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:06.722715 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1176/2373] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:10:06 2022] DELETE /identity/v3/users/7c83107241254f8b9e540318a3db42dc => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:06.727277 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68d0aa-0196-422d-809b-f303352cc319 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:06.727654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68d0aa-0196-422d-809b-f303352cc319 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:06.727935 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68d0aa-0196-422d-809b-f303352cc319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:06.746823 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ab68d0aa-0196-422d-809b-f303352cc319 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:06.748074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ab68d0aa-0196-422d-809b-f303352cc319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:06.805575 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1198/2374] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:06.815296 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0b077-d404-4c98-899b-ec10b7908c3c admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:06.816737 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-18c0b077-d404-4c98-899b-ec10b7908c3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:06.873392 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0b077-d404-4c98-899b-ec10b7908c3c admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:06.876981 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3504d-80fa-4c6a-aaa3-728ee5bd29b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:06.877582 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3504d-80fa-4c6a-aaa3-728ee5bd29b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:06.877892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3504d-80fa-4c6a-aaa3-728ee5bd29b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:06.878162 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc3504d-80fa-4c6a-aaa3-728ee5bd29b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:06.887695 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3504d-80fa-4c6a-aaa3-728ee5bd29b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:06.889112 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc3504d-80fa-4c6a-aaa3-728ee5bd29b6 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:06.898732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1177/2375] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:10:07.251377 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68d0aa-0196-422d-809b-f303352cc319 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:07.256082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ab68d0aa-0196-422d-809b-f303352cc319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:07.265021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68d0aa-0196-422d-809b-f303352cc319 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:07.269995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96b714-53b5-4651-804b-b7335e5ca751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:07.270628 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96b714-53b5-4651-804b-b7335e5ca751 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:07.270900 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96b714-53b5-4651-804b-b7335e5ca751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:07.271170 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e96b714-53b5-4651-804b-b7335e5ca751 admin admin] PATH_INFO: `/v3/projects/6cef4c4465da432798c265150e5dd764` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:07.272638 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96b714-53b5-4651-804b-b7335e5ca751 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cef4c4465da432798c265150e5dd764)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:07.274599 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e96b714-53b5-4651-804b-b7335e5ca751 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:07.292030 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:07.355661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8e96b714-53b5-4651-804b-b7335e5ca751 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cef4c4465da432798c265150e5dd764', 'request_id': 'req-8e96b714-53b5-4651-804b-b7335e5ca751'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:07.415351 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8e96b714-53b5-4651-804b-b7335e5ca751 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cef4c4465da432798c265150e5dd764', 'request_id': 'req-8e96b714-53b5-4651-804b-b7335e5ca751'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:07.421840 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8e96b714-53b5-4651-804b-b7335e5ca751 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cef4c4465da432798c265150e5dd764', 'request_id': 'req-8e96b714-53b5-4651-804b-b7335e5ca751'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:07.434240 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8e96b714-53b5-4651-804b-b7335e5ca751 admin admin] The token cache is being invalidate because project 6cef4c4465da432798c265150e5dd764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:10:07.434453 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8e96b714-53b5-4651-804b-b7335e5ca751 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:07.435085 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8e96b714-53b5-4651-804b-b7335e5ca751 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:07.436576 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1199/2376] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:10:07 2022] DELETE /identity/v3/projects/6cef4c4465da432798c265150e5dd764 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:07.440655 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3504d-80fa-4c6a-aaa3-728ee5bd29b6 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:07.450945 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc3504d-80fa-4c6a-aaa3-728ee5bd29b6 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:07.507856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f01649a-2d1a-4f28-9052-4ecc0f186129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:07.508515 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01649a-2d1a-4f28-9052-4ecc0f186129 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:07.508853 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01649a-2d1a-4f28-9052-4ecc0f186129 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:07.509207 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f01649a-2d1a-4f28-9052-4ecc0f186129 admin admin] PATH_INFO: `/v3/users/40eb6fdc815849f99efb6d819dec8a3e` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:07.510427 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01649a-2d1a-4f28-9052-4ecc0f186129 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40eb6fdc815849f99efb6d819dec8a3e)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:07.512451 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f01649a-2d1a-4f28-9052-4ecc0f186129 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:07.644429 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:07.646096 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1f01649a-2d1a-4f28-9052-4ecc0f186129 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40eb6fdc815849f99efb6d819dec8a3e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:07.733647 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1f01649a-2d1a-4f28-9052-4ecc0f186129 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40eb6fdc815849f99efb6d819dec8a3e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:07.746364 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1f01649a-2d1a-4f28-9052-4ecc0f186129 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40eb6fdc815849f99efb6d819dec8a3e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:07.747094 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1f01649a-2d1a-4f28-9052-4ecc0f186129 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40eb6fdc815849f99efb6d819dec8a3e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:07.754096 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1f01649a-2d1a-4f28-9052-4ecc0f186129 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40eb6fdc815849f99efb6d819dec8a3e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:07.760583 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1178/2377] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:10:07 2022] DELETE /identity/v3/users/40eb6fdc815849f99efb6d819dec8a3e => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:10:08.120149 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96b714-53b5-4651-804b-b7335e5ca751 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:08.121679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8e96b714-53b5-4651-804b-b7335e5ca751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:08.138415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e96b714-53b5-4651-804b-b7335e5ca751 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:08.195105 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7decb-5072-4113-9b56-cd5854752c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:08.195721 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7decb-5072-4113-9b56-cd5854752c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:08.195999 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7decb-5072-4113-9b56-cd5854752c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:08.196265 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7decb-5072-4113-9b56-cd5854752c29 admin admin] PATH_INFO: `/v3/projects/f5c17e71b07d45c38cfbfe4c1a37cf44` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:08.197648 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7decb-5072-4113-9b56-cd5854752c29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5c17e71b07d45c38cfbfe4c1a37cf44)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:08.199561 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7decb-5072-4113-9b56-cd5854752c29 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:08.295356 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d6e7decb-5072-4113-9b56-cd5854752c29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5c17e71b07d45c38cfbfe4c1a37cf44', 'request_id': 'req-d6e7decb-5072-4113-9b56-cd5854752c29'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:08.341155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d6e7decb-5072-4113-9b56-cd5854752c29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5c17e71b07d45c38cfbfe4c1a37cf44', 'request_id': 'req-d6e7decb-5072-4113-9b56-cd5854752c29'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:08.347154 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d6e7decb-5072-4113-9b56-cd5854752c29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5c17e71b07d45c38cfbfe4c1a37cf44', 'request_id': 'req-d6e7decb-5072-4113-9b56-cd5854752c29'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:08.358403 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d6e7decb-5072-4113-9b56-cd5854752c29 admin admin] The token cache is being invalidate because project f5c17e71b07d45c38cfbfe4c1a37cf44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:10:08.358688 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d6e7decb-5072-4113-9b56-cd5854752c29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:08.359377 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d6e7decb-5072-4113-9b56-cd5854752c29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:08.360856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1200/2378] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:10:08 2022] DELETE /identity/v3/projects/f5c17e71b07d45c38cfbfe4c1a37cf44 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:08.366291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5985d7-e6ab-4f13-bfc3-50b6ee0a1a36 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:08.366587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5985d7-e6ab-4f13-bfc3-50b6ee0a1a36 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:08.366862 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5985d7-e6ab-4f13-bfc3-50b6ee0a1a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:08.386503 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-fb5985d7-e6ab-4f13-bfc3-50b6ee0a1a36 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:08.387699 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-fb5985d7-e6ab-4f13-bfc3-50b6ee0a1a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:08.444622 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1179/2379] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:08.452587 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06983d7e-6d52-4428-beb3-2cb523647d9e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:08.452870 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06983d7e-6d52-4428-beb3-2cb523647d9e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:08.453166 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06983d7e-6d52-4428-beb3-2cb523647d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:08.472269 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-06983d7e-6d52-4428-beb3-2cb523647d9e None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:08.473442 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-06983d7e-6d52-4428-beb3-2cb523647d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:08.481482 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1201/2380] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:08.485482 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5985d7-e6ab-4f13-bfc3-50b6ee0a1a36 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:08.495483 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5985d7-e6ab-4f13-bfc3-50b6ee0a1a36 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:08.499977 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9871e6-fa0c-4c77-91fb-a91f63a6fb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:08.500574 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9871e6-fa0c-4c77-91fb-a91f63a6fb59 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:08.500855 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9871e6-fa0c-4c77-91fb-a91f63a6fb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:08.501130 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9871e6-fa0c-4c77-91fb-a91f63a6fb59 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:08.501810 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9871e6-fa0c-4c77-91fb-a91f63a6fb59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:10:08.502115 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9871e6-fa0c-4c77-91fb-a91f63a6fb59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:08.503702 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9871e6-fa0c-4c77-91fb-a91f63a6fb59 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:08.515762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1180/2381] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:10:08.519844 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06983d7e-6d52-4428-beb3-2cb523647d9e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:08.528956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06983d7e-6d52-4428-beb3-2cb523647d9e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:08.533566 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b62f8-c817-4635-a603-70f07d449738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:08.534186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b62f8-c817-4635-a603-70f07d449738 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:08.534467 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b62f8-c817-4635-a603-70f07d449738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:08.534743 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b62f8-c817-4635-a603-70f07d449738 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:08.535380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b62f8-c817-4635-a603-70f07d449738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:08.537289 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b62f8-c817-4635-a603-70f07d449738 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:08.632616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1202/2382] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:10:08 2022] POST /identity/v3/projects => generated 387 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:10:08.637012 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9871e6-fa0c-4c77-91fb-a91f63a6fb59 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:08.647088 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9871e6-fa0c-4c77-91fb-a91f63a6fb59 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:08.704917 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccb794-5001-4ba8-b885-831b063afe85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:08.705522 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccb794-5001-4ba8-b885-831b063afe85 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:08.705837 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccb794-5001-4ba8-b885-831b063afe85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:08.706115 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ccb794-5001-4ba8-b885-831b063afe85 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:08.706886 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ccb794-5001-4ba8-b885-831b063afe85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:08.708730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ccb794-5001-4ba8-b885-831b063afe85 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:08.791331 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1181/2383] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:10:08 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:10:08.795711 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b62f8-c817-4635-a603-70f07d449738 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:08.807051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b62f8-c817-4635-a603-70f07d449738 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:08.811631 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311ff4a-1e9c-4f2d-9246-805458234e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:08.812222 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311ff4a-1e9c-4f2d-9246-805458234e61 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:08.812503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311ff4a-1e9c-4f2d-9246-805458234e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:08.812778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311ff4a-1e9c-4f2d-9246-805458234e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:08.813487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311ff4a-1e9c-4f2d-9246-805458234e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:08.815116 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0311ff4a-1e9c-4f2d-9246-805458234e61 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:08.816323 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:08.825768 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1203/2384] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:10:08.830234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccb794-5001-4ba8-b885-831b063afe85 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:08.839706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ccb794-5001-4ba8-b885-831b063afe85 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:08.844408 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f45215-e89a-4eff-8a2b-a7955776655e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:08.845002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f45215-e89a-4eff-8a2b-a7955776655e admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:08.845367 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f45215-e89a-4eff-8a2b-a7955776655e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:08.845652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f45215-e89a-4eff-8a2b-a7955776655e admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:08.846352 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f45215-e89a-4eff-8a2b-a7955776655e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:08.848071 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f45215-e89a-4eff-8a2b-a7955776655e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:08.859290 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1182/2385] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:10:08 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:10:08.863265 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311ff4a-1e9c-4f2d-9246-805458234e61 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:08.873771 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311ff4a-1e9c-4f2d-9246-805458234e61 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:08.880231 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3bb25-234a-4852-92da-335ffcab62f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:08.880879 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3bb25-234a-4852-92da-335ffcab62f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:08.881151 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3bb25-234a-4852-92da-335ffcab62f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:08.881419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb3bb25-234a-4852-92da-335ffcab62f7 admin admin] PATH_INFO: `/v3/projects/adc7f54c333843f0816aed5647135b4f/users/588b34c9e72a40919301b613aee2dff9/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:08.896165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3bb25-234a-4852-92da-335ffcab62f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=adc7f54c333843f0816aed5647135b4f, user_id=588b34c9e72a40919301b613aee2dff9, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:08.898856 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb3bb25-234a-4852-92da-335ffcab62f7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:08.963658 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1204/2386] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:10:08 2022] PUT /identity/v3/projects/adc7f54c333843f0816aed5647135b4f/users/588b34c9e72a40919301b613aee2dff9/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:08.974294 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b770e-4290-4f46-80b7-9dcc40747d31 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:08.974578 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b770e-4290-4f46-80b7-9dcc40747d31 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:08.974850 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b770e-4290-4f46-80b7-9dcc40747d31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:09.002877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-476b770e-4290-4f46-80b7-9dcc40747d31 None None] MFA Rules not processed for user `588b34c9e72a40919301b613aee2dff9`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:09.004061 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-476b770e-4290-4f46-80b7-9dcc40747d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:09.020043 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:09.067076 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1183/2387] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:10:08 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:09.071430 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3bb25-234a-4852-92da-335ffcab62f7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:09.133198 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb3bb25-234a-4852-92da-335ffcab62f7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:09.137836 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237c50b-3292-4995-af58-381daa283223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:09.138433 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237c50b-3292-4995-af58-381daa283223 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:09.138716 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237c50b-3292-4995-af58-381daa283223 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:09.138987 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6237c50b-3292-4995-af58-381daa283223 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:09.139612 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237c50b-3292-4995-af58-381daa283223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:09.141515 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6237c50b-3292-4995-af58-381daa283223 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:09.227332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1205/2388] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:10:09 2022] POST /identity/v3/projects => generated 385 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:10:09.231376 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b770e-4290-4f46-80b7-9dcc40747d31 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:09.242421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b770e-4290-4f46-80b7-9dcc40747d31 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:09.300148 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351773da-b76b-40fb-acbd-118f52590452 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:09.300759 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351773da-b76b-40fb-acbd-118f52590452 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:09.301041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351773da-b76b-40fb-acbd-118f52590452 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:09.301322 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351773da-b76b-40fb-acbd-118f52590452 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:09.302030 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351773da-b76b-40fb-acbd-118f52590452 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:09.303986 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351773da-b76b-40fb-acbd-118f52590452 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:09.379291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1184/2389] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:10:09 2022] POST /identity/v3/users => generated 299 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:10:09.383036 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237c50b-3292-4995-af58-381daa283223 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:09.393392 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6237c50b-3292-4995-af58-381daa283223 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:09.399596 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36696c59-1027-41aa-8a86-6bc0357d2c1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:09.400307 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36696c59-1027-41aa-8a86-6bc0357d2c1c admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:09.400614 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36696c59-1027-41aa-8a86-6bc0357d2c1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:09.400885 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36696c59-1027-41aa-8a86-6bc0357d2c1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:09.401524 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36696c59-1027-41aa-8a86-6bc0357d2c1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:09.403155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36696c59-1027-41aa-8a86-6bc0357d2c1c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:09.414672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1206/2390] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:10:09.418788 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351773da-b76b-40fb-acbd-118f52590452 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:09.428762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351773da-b76b-40fb-acbd-118f52590452 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:09.433281 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cf72f-4525-459a-b28e-e3dbd78dbe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:09.433953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cf72f-4525-459a-b28e-e3dbd78dbe60 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:09.434232 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cf72f-4525-459a-b28e-e3dbd78dbe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:09.434499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534cf72f-4525-459a-b28e-e3dbd78dbe60 admin admin] PATH_INFO: `/v3/projects/f3d42f20f5724644b99c58ab9ee6b642/users/ef19a3d5357b4ea390583890326997e2/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:09.449743 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cf72f-4525-459a-b28e-e3dbd78dbe60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3d42f20f5724644b99c58ab9ee6b642, user_id=ef19a3d5357b4ea390583890326997e2, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:09.452379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534cf72f-4525-459a-b28e-e3dbd78dbe60 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:09.517800 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1185/2391] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:10:09 2022] PUT /identity/v3/projects/f3d42f20f5724644b99c58ab9ee6b642/users/ef19a3d5357b4ea390583890326997e2/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:09.521665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36696c59-1027-41aa-8a86-6bc0357d2c1c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:09.532490 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36696c59-1027-41aa-8a86-6bc0357d2c1c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:09.587494 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e528f1f9-f6fa-4fb1-9fea-cbef8bce584c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:09.588088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528f1f9-f6fa-4fb1-9fea-cbef8bce584c admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:09.588365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528f1f9-f6fa-4fb1-9fea-cbef8bce584c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:09.588635 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e528f1f9-f6fa-4fb1-9fea-cbef8bce584c admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:09.589260 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e528f1f9-f6fa-4fb1-9fea-cbef8bce584c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:09.590877 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e528f1f9-f6fa-4fb1-9fea-cbef8bce584c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:09.600283 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1207/2392] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:10:09.604548 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cf72f-4525-459a-b28e-e3dbd78dbe60 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:09.614734 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534cf72f-4525-459a-b28e-e3dbd78dbe60 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:09.619288 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d1f68-96b2-46dd-ad46-5acdcb4f00cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:09.619936 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d1f68-96b2-46dd-ad46-5acdcb4f00cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:09.620216 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d1f68-96b2-46dd-ad46-5acdcb4f00cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:09.620490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479d1f68-96b2-46dd-ad46-5acdcb4f00cd admin admin] PATH_INFO: `/v3/projects/f3d42f20f5724644b99c58ab9ee6b642/users/ef19a3d5357b4ea390583890326997e2/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:09.622385 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d1f68-96b2-46dd-ad46-5acdcb4f00cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3d42f20f5724644b99c58ab9ee6b642, user_id=ef19a3d5357b4ea390583890326997e2, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:09.625022 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479d1f68-96b2-46dd-ad46-5acdcb4f00cd admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:09.635435 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1186/2393] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:10:09 2022] PUT /identity/v3/projects/f3d42f20f5724644b99c58ab9ee6b642/users/ef19a3d5357b4ea390583890326997e2/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:09.701843 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e135b5-3856-4c9d-811f-8401b2fd3af3 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:09.702254 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e135b5-3856-4c9d-811f-8401b2fd3af3 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:09.702571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e135b5-3856-4c9d-811f-8401b2fd3af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:09.731035 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d2e135b5-3856-4c9d-811f-8401b2fd3af3 None None] MFA Rules not processed for user `ef19a3d5357b4ea390583890326997e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:09.732236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d2e135b5-3856-4c9d-811f-8401b2fd3af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:09.762133 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:09.799031 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1208/2394] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:10:09 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:09.810052 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d1f68-96b2-46dd-ad46-5acdcb4f00cd admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:09.811770 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-479d1f68-96b2-46dd-ad46-5acdcb4f00cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:09.871048 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479d1f68-96b2-46dd-ad46-5acdcb4f00cd admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:09.874680 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3657b-2791-456a-a14d-36e7edcda443 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:09.875361 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3657b-2791-456a-a14d-36e7edcda443 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:09.875756 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3657b-2791-456a-a14d-36e7edcda443 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:09.876037 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3657b-2791-456a-a14d-36e7edcda443 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:09.885167 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3657b-2791-456a-a14d-36e7edcda443 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:09.886671 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3657b-2791-456a-a14d-36e7edcda443 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:09.897719 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1187/2395] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:10:10.943601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e135b5-3856-4c9d-811f-8401b2fd3af3 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:11.004936 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e135b5-3856-4c9d-811f-8401b2fd3af3 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:11.009928 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ad174-118c-4c94-aa47-1aed8a7b8103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:11.010549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ad174-118c-4c94-aa47-1aed8a7b8103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:11.010830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ad174-118c-4c94-aa47-1aed8a7b8103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:11.011102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219ad174-118c-4c94-aa47-1aed8a7b8103 admin admin] PATH_INFO: `/v3/users/588b34c9e72a40919301b613aee2dff9` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:11.012223 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ad174-118c-4c94-aa47-1aed8a7b8103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=588b34c9e72a40919301b613aee2dff9)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:11.014160 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219ad174-118c-4c94-aa47-1aed8a7b8103 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:11.171586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-219ad174-118c-4c94-aa47-1aed8a7b8103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '588b34c9e72a40919301b613aee2dff9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:11.220864 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-219ad174-118c-4c94-aa47-1aed8a7b8103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '588b34c9e72a40919301b613aee2dff9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:11.233230 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-219ad174-118c-4c94-aa47-1aed8a7b8103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '588b34c9e72a40919301b613aee2dff9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:11.233882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-219ad174-118c-4c94-aa47-1aed8a7b8103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '588b34c9e72a40919301b613aee2dff9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:11.241098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-219ad174-118c-4c94-aa47-1aed8a7b8103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '588b34c9e72a40919301b613aee2dff9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:11.247695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1209/2396] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:10:10 2022] DELETE /identity/v3/users/588b34c9e72a40919301b613aee2dff9 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:11.252150 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d20d1-52af-4aed-966b-a52d24e7a1fe None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:11.252736 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d20d1-52af-4aed-966b-a52d24e7a1fe None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:11.252736 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d20d1-52af-4aed-966b-a52d24e7a1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:11.273280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-fd5d20d1-52af-4aed-966b-a52d24e7a1fe None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:11.274513 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-fd5d20d1-52af-4aed-966b-a52d24e7a1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:11.282682 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:11.333270 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1188/2397] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:10:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:10:11.343143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ad174-118c-4c94-aa47-1aed8a7b8103 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:11.344555 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-219ad174-118c-4c94-aa47-1aed8a7b8103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:11.396333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:11.401332 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219ad174-118c-4c94-aa47-1aed8a7b8103 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:11.405044 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799e3b6-c9bb-413b-822c-e4978d892d72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:11.405639 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799e3b6-c9bb-413b-822c-e4978d892d72 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:11.405947 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799e3b6-c9bb-413b-822c-e4978d892d72 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:11.409017 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b799e3b6-c9bb-413b-822c-e4978d892d72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:11.415093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799e3b6-c9bb-413b-822c-e4978d892d72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:11.416545 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b799e3b6-c9bb-413b-822c-e4978d892d72 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:11.425736 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1210/2398] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:10:11.793778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d20d1-52af-4aed-966b-a52d24e7a1fe None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:11.795268 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-fd5d20d1-52af-4aed-966b-a52d24e7a1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:11.807341 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d20d1-52af-4aed-966b-a52d24e7a1fe None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:11.811958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c7b7a-96fd-47c5-9957-deec32951e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:11.812593 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c7b7a-96fd-47c5-9957-deec32951e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:11.812869 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c7b7a-96fd-47c5-9957-deec32951e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:11.813158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2c7b7a-96fd-47c5-9957-deec32951e6e admin admin] PATH_INFO: `/v3/projects/adc7f54c333843f0816aed5647135b4f` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:11.814288 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c7b7a-96fd-47c5-9957-deec32951e6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=adc7f54c333843f0816aed5647135b4f)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:11.816205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2c7b7a-96fd-47c5-9957-deec32951e6e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:11.896185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4b2c7b7a-96fd-47c5-9957-deec32951e6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'adc7f54c333843f0816aed5647135b4f', 'request_id': 'req-4b2c7b7a-96fd-47c5-9957-deec32951e6e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:11.902417 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4b2c7b7a-96fd-47c5-9957-deec32951e6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'adc7f54c333843f0816aed5647135b4f', 'request_id': 'req-4b2c7b7a-96fd-47c5-9957-deec32951e6e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:11.908843 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4b2c7b7a-96fd-47c5-9957-deec32951e6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'adc7f54c333843f0816aed5647135b4f', 'request_id': 'req-4b2c7b7a-96fd-47c5-9957-deec32951e6e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:11.957437 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4b2c7b7a-96fd-47c5-9957-deec32951e6e admin admin] The token cache is being invalidate because project adc7f54c333843f0816aed5647135b4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:10:11.957679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4b2c7b7a-96fd-47c5-9957-deec32951e6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:11.958323 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4b2c7b7a-96fd-47c5-9957-deec32951e6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:11.959830 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1189/2399] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:10:11 2022] DELETE /identity/v3/projects/adc7f54c333843f0816aed5647135b4f => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:10:11.964478 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799e3b6-c9bb-413b-822c-e4978d892d72 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:11.974051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b799e3b6-c9bb-413b-822c-e4978d892d72 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:12.030120 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45c053b-6ebf-415a-a3d7-d93d5354cd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:12.030737 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c053b-6ebf-415a-a3d7-d93d5354cd53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:12.031017 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c053b-6ebf-415a-a3d7-d93d5354cd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:12.031295 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45c053b-6ebf-415a-a3d7-d93d5354cd53 admin admin] PATH_INFO: `/v3/users/ef19a3d5357b4ea390583890326997e2` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:12.032394 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c053b-6ebf-415a-a3d7-d93d5354cd53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef19a3d5357b4ea390583890326997e2)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:12.034343 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45c053b-6ebf-415a-a3d7-d93d5354cd53 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:12.170773 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b45c053b-6ebf-415a-a3d7-d93d5354cd53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef19a3d5357b4ea390583890326997e2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:12.214653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b45c053b-6ebf-415a-a3d7-d93d5354cd53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef19a3d5357b4ea390583890326997e2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:12.226963 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b45c053b-6ebf-415a-a3d7-d93d5354cd53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef19a3d5357b4ea390583890326997e2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:12.227766 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b45c053b-6ebf-415a-a3d7-d93d5354cd53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef19a3d5357b4ea390583890326997e2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:12.234712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b45c053b-6ebf-415a-a3d7-d93d5354cd53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef19a3d5357b4ea390583890326997e2'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:12.240763 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1211/2400] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:10:11 2022] DELETE /identity/v3/users/ef19a3d5357b4ea390583890326997e2 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:12.656884 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c7b7a-96fd-47c5-9957-deec32951e6e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:12.658399 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4b2c7b7a-96fd-47c5-9957-deec32951e6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:12.671710 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2c7b7a-96fd-47c5-9957-deec32951e6e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:12.733846 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ce1cd3-5176-4901-893a-b615ed898ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:12.735081 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce1cd3-5176-4901-893a-b615ed898ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:12.735081 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce1cd3-5176-4901-893a-b615ed898ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:12.735281 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ce1cd3-5176-4901-893a-b615ed898ca5 admin admin] PATH_INFO: `/v3/projects/f3d42f20f5724644b99c58ab9ee6b642` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:12.736240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce1cd3-5176-4901-893a-b615ed898ca5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3d42f20f5724644b99c58ab9ee6b642)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:12.738228 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ce1cd3-5176-4901-893a-b615ed898ca5 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:12.831535 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:12.838801 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b2ce1cd3-5176-4901-893a-b615ed898ca5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3d42f20f5724644b99c58ab9ee6b642', 'request_id': 'req-b2ce1cd3-5176-4901-893a-b615ed898ca5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:12.844481 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b2ce1cd3-5176-4901-893a-b615ed898ca5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3d42f20f5724644b99c58ab9ee6b642', 'request_id': 'req-b2ce1cd3-5176-4901-893a-b615ed898ca5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:12.850678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b2ce1cd3-5176-4901-893a-b615ed898ca5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3d42f20f5724644b99c58ab9ee6b642', 'request_id': 'req-b2ce1cd3-5176-4901-893a-b615ed898ca5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:12.934491 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b2ce1cd3-5176-4901-893a-b615ed898ca5 admin admin] The token cache is being invalidate because project f3d42f20f5724644b99c58ab9ee6b642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:10:12.934767 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b2ce1cd3-5176-4901-893a-b615ed898ca5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:12.935425 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b2ce1cd3-5176-4901-893a-b615ed898ca5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:12.937070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1190/2401] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:10:12 2022] DELETE /identity/v3/projects/f3d42f20f5724644b99c58ab9ee6b642 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:12.942187 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cee39-ddab-48b6-a67e-64572a81e334 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:12.942477 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cee39-ddab-48b6-a67e-64572a81e334 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:12.942756 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198cee39-ddab-48b6-a67e-64572a81e334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:12.962955 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-198cee39-ddab-48b6-a67e-64572a81e334 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:12.967310 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-198cee39-ddab-48b6-a67e-64572a81e334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:13.021815 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1212/2402] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:10:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:13.029787 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce4bf4-b23e-46f1-9a65-76c1db2af441 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:13.030073 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce4bf4-b23e-46f1-9a65-76c1db2af441 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:13.030350 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce4bf4-b23e-46f1-9a65-76c1db2af441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:13.050376 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-dfce4bf4-b23e-46f1-9a65-76c1db2af441 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:13.051571 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-dfce4bf4-b23e-46f1-9a65-76c1db2af441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:13.059324 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1191/2403] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:13.063257 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cee39-ddab-48b6-a67e-64572a81e334 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:13.072802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198cee39-ddab-48b6-a67e-64572a81e334 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:13.077253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c97c5-bac1-43ed-8988-22c3705234c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:13.077872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c97c5-bac1-43ed-8988-22c3705234c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:13.078154 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c97c5-bac1-43ed-8988-22c3705234c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:13.078417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33c97c5-bac1-43ed-8988-22c3705234c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:13.079051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c97c5-bac1-43ed-8988-22c3705234c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:10:13.079345 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c97c5-bac1-43ed-8988-22c3705234c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:13.080913 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33c97c5-bac1-43ed-8988-22c3705234c5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:13.083195 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:13.092937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1213/2404] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:10:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:10:13.096944 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce4bf4-b23e-46f1-9a65-76c1db2af441 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:13.106570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce4bf4-b23e-46f1-9a65-76c1db2af441 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:13.111282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faf89a-c7a9-4563-9e7c-92fa9c0ffb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:13.111875 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faf89a-c7a9-4563-9e7c-92fa9c0ffb4d admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:13.112149 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faf89a-c7a9-4563-9e7c-92fa9c0ffb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:13.112415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9faf89a-c7a9-4563-9e7c-92fa9c0ffb4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:13.113030 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9faf89a-c7a9-4563-9e7c-92fa9c0ffb4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:13.114946 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9faf89a-c7a9-4563-9e7c-92fa9c0ffb4d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:13.199566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1192/2405] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:10:13 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:10:13.203678 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c97c5-bac1-43ed-8988-22c3705234c5 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:13.214294 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33c97c5-bac1-43ed-8988-22c3705234c5 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:13.268641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53fe21-0133-49e2-b2a6-7f3cd18c6b94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:13.269233 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53fe21-0133-49e2-b2a6-7f3cd18c6b94 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:13.269508 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53fe21-0133-49e2-b2a6-7f3cd18c6b94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:13.269809 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d53fe21-0133-49e2-b2a6-7f3cd18c6b94 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:13.270441 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53fe21-0133-49e2-b2a6-7f3cd18c6b94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:13.272421 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d53fe21-0133-49e2-b2a6-7f3cd18c6b94 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:13.329180 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1214/2406] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:10:13 2022] POST /identity/v3/users => generated 292 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:10:13.333242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faf89a-c7a9-4563-9e7c-92fa9c0ffb4d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:13.343689 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9faf89a-c7a9-4563-9e7c-92fa9c0ffb4d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:13.348229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc49939-9253-41b7-a057-0fe99a9a73ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:13.348823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc49939-9253-41b7-a057-0fe99a9a73ff admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:13.349102 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc49939-9253-41b7-a057-0fe99a9a73ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:13.349369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc49939-9253-41b7-a057-0fe99a9a73ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:13.350037 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc49939-9253-41b7-a057-0fe99a9a73ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:13.352164 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc49939-9253-41b7-a057-0fe99a9a73ff admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:13.361973 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1193/2407] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:10:13.365678 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53fe21-0133-49e2-b2a6-7f3cd18c6b94 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:13.375851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d53fe21-0133-49e2-b2a6-7f3cd18c6b94 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:13.380402 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b8f8fd-ccda-440a-ba8a-10762ffc677a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:13.380982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8f8fd-ccda-440a-ba8a-10762ffc677a admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:13.381257 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8f8fd-ccda-440a-ba8a-10762ffc677a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:13.381525 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b8f8fd-ccda-440a-ba8a-10762ffc677a admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:13.382190 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8f8fd-ccda-440a-ba8a-10762ffc677a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:13.383816 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b8f8fd-ccda-440a-ba8a-10762ffc677a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:13.394054 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1215/2408] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:10:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:10:13.398479 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc49939-9253-41b7-a057-0fe99a9a73ff admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:13.408629 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc49939-9253-41b7-a057-0fe99a9a73ff admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:13.413267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b8cca-f369-494d-865a-3cc1daee8b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:13.414443 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b8cca-f369-494d-865a-3cc1daee8b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:13.414774 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b8cca-f369-494d-865a-3cc1daee8b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:13.415169 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78b8cca-f369-494d-865a-3cc1daee8b28 admin admin] PATH_INFO: `/v3/projects/a1f415b949b247da9314c07ad8aefc96/users/792ffc121cf4412c892e9fa4da0e061d/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:13.430368 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b8cca-f369-494d-865a-3cc1daee8b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1f415b949b247da9314c07ad8aefc96, user_id=792ffc121cf4412c892e9fa4da0e061d, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:13.433050 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78b8cca-f369-494d-865a-3cc1daee8b28 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:13.517587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1194/2409] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:10:13 2022] PUT /identity/v3/projects/a1f415b949b247da9314c07ad8aefc96/users/792ffc121cf4412c892e9fa4da0e061d/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:13.529412 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491001f-7b68-4918-8556-27dd25b9f5b2 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:13.529635 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491001f-7b68-4918-8556-27dd25b9f5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:13.529941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b491001f-7b68-4918-8556-27dd25b9f5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:13.557658 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b491001f-7b68-4918-8556-27dd25b9f5b2 None None] MFA Rules not processed for user `792ffc121cf4412c892e9fa4da0e061d`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:13.558878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b491001f-7b68-4918-8556-27dd25b9f5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:13.620365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1216/2410] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:10:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:13.631284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b8cca-f369-494d-865a-3cc1daee8b28 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:13.632971 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e78b8cca-f369-494d-865a-3cc1daee8b28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:13.691417 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78b8cca-f369-494d-865a-3cc1daee8b28 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:13.695048 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a481da2f-206b-4240-8fea-839f8fdccc7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:13.698140 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481da2f-206b-4240-8fea-839f8fdccc7e service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:13.698140 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481da2f-206b-4240-8fea-839f8fdccc7e service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:13.698140 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a481da2f-206b-4240-8fea-839f8fdccc7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:13.704809 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481da2f-206b-4240-8fea-839f8fdccc7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:13.706286 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a481da2f-206b-4240-8fea-839f8fdccc7e service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:13.715424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1195/2411] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:10:16.739445 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491001f-7b68-4918-8556-27dd25b9f5b2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:16.801056 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b491001f-7b68-4918-8556-27dd25b9f5b2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:16.806007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c310e-95e0-42ad-90c1-fffac596e9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:16.806623 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c310e-95e0-42ad-90c1-fffac596e9cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:16.806898 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c310e-95e0-42ad-90c1-fffac596e9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:16.807166 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668c310e-95e0-42ad-90c1-fffac596e9cc admin admin] PATH_INFO: `/v3/users/792ffc121cf4412c892e9fa4da0e061d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:16.808317 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c310e-95e0-42ad-90c1-fffac596e9cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=792ffc121cf4412c892e9fa4da0e061d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:16.810258 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668c310e-95e0-42ad-90c1-fffac596e9cc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:16.815138 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:16.982877 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-668c310e-95e0-42ad-90c1-fffac596e9cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '792ffc121cf4412c892e9fa4da0e061d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:17.053438 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-668c310e-95e0-42ad-90c1-fffac596e9cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '792ffc121cf4412c892e9fa4da0e061d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:17.066448 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-668c310e-95e0-42ad-90c1-fffac596e9cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '792ffc121cf4412c892e9fa4da0e061d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:17.067128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-668c310e-95e0-42ad-90c1-fffac596e9cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '792ffc121cf4412c892e9fa4da0e061d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:17.074644 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-668c310e-95e0-42ad-90c1-fffac596e9cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '792ffc121cf4412c892e9fa4da0e061d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:17.080560 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1217/2412] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:10:16 2022] DELETE /identity/v3/users/792ffc121cf4412c892e9fa4da0e061d => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:17.085009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90892896-ffb4-4831-a57b-14a4aa0eee11 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:17.087316 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90892896-ffb4-4831-a57b-14a4aa0eee11 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:17.087316 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90892896-ffb4-4831-a57b-14a4aa0eee11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:17.104665 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-90892896-ffb4-4831-a57b-14a4aa0eee11 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:17.105885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-90892896-ffb4-4831-a57b-14a4aa0eee11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:17.164793 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1196/2413] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:17.174898 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c310e-95e0-42ad-90c1-fffac596e9cc admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:17.176274 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-668c310e-95e0-42ad-90c1-fffac596e9cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:17.257448 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668c310e-95e0-42ad-90c1-fffac596e9cc admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:17.261029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd43cc9-9b74-46c6-b2fc-ad93842622c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:17.261651 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd43cc9-9b74-46c6-b2fc-ad93842622c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:17.261954 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd43cc9-9b74-46c6-b2fc-ad93842622c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:17.262221 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd43cc9-9b74-46c6-b2fc-ad93842622c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:17.270984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd43cc9-9b74-46c6-b2fc-ad93842622c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:17.272392 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd43cc9-9b74-46c6-b2fc-ad93842622c0 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:17.282280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1218/2414] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:10:17.729567 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90892896-ffb4-4831-a57b-14a4aa0eee11 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:17.731104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-90892896-ffb4-4831-a57b-14a4aa0eee11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:17.743702 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90892896-ffb4-4831-a57b-14a4aa0eee11 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:17.750084 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faeada7-bef6-4961-b370-3eadfe38e344 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:17.750755 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faeada7-bef6-4961-b370-3eadfe38e344 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:17.750940 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faeada7-bef6-4961-b370-3eadfe38e344 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:17.751197 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faeada7-bef6-4961-b370-3eadfe38e344 admin admin] PATH_INFO: `/v3/projects/a1f415b949b247da9314c07ad8aefc96` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:17.752517 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faeada7-bef6-4961-b370-3eadfe38e344 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1f415b949b247da9314c07ad8aefc96)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:17.754406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faeada7-bef6-4961-b370-3eadfe38e344 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:17.756268 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:17.845220 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5faeada7-bef6-4961-b370-3eadfe38e344 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1f415b949b247da9314c07ad8aefc96', 'request_id': 'req-5faeada7-bef6-4961-b370-3eadfe38e344'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:17.850847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5faeada7-bef6-4961-b370-3eadfe38e344 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1f415b949b247da9314c07ad8aefc96', 'request_id': 'req-5faeada7-bef6-4961-b370-3eadfe38e344'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:17.857714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5faeada7-bef6-4961-b370-3eadfe38e344 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1f415b949b247da9314c07ad8aefc96', 'request_id': 'req-5faeada7-bef6-4961-b370-3eadfe38e344'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:17.926780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5faeada7-bef6-4961-b370-3eadfe38e344 admin admin] The token cache is being invalidate because project a1f415b949b247da9314c07ad8aefc96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:10:17.927069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5faeada7-bef6-4961-b370-3eadfe38e344 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:17.927693 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5faeada7-bef6-4961-b370-3eadfe38e344 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:17.929183 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1197/2415] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:10:17 2022] DELETE /identity/v3/projects/a1f415b949b247da9314c07ad8aefc96 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:17.934819 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172cefba-a8fe-4e12-bef6-81580a8113e9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:17.935266 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172cefba-a8fe-4e12-bef6-81580a8113e9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:17.935383 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172cefba-a8fe-4e12-bef6-81580a8113e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:17.954950 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-172cefba-a8fe-4e12-bef6-81580a8113e9 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:17.956142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-172cefba-a8fe-4e12-bef6-81580a8113e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:18.028010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1219/2416] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:18.030759 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4af6e-7afd-4c5f-b538-80fe8afd21e4 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:18.031047 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4af6e-7afd-4c5f-b538-80fe8afd21e4 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:18.031325 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b4af6e-7afd-4c5f-b538-80fe8afd21e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:18.051300 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-c9b4af6e-7afd-4c5f-b538-80fe8afd21e4 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:18.052501 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c9b4af6e-7afd-4c5f-b538-80fe8afd21e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:18.060352 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1198/2417] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:10:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:18.064494 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172cefba-a8fe-4e12-bef6-81580a8113e9 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:18.074262 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172cefba-a8fe-4e12-bef6-81580a8113e9 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:18.079117 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43250a-1ad2-43a3-88f6-5b1776f1e49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:18.079718 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43250a-1ad2-43a3-88f6-5b1776f1e49e admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:18.085493 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43250a-1ad2-43a3-88f6-5b1776f1e49e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:18.085493 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43250a-1ad2-43a3-88f6-5b1776f1e49e admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:18.085493 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43250a-1ad2-43a3-88f6-5b1776f1e49e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:10:18.085493 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43250a-1ad2-43a3-88f6-5b1776f1e49e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:18.085493 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43250a-1ad2-43a3-88f6-5b1776f1e49e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:18.085493 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:18.096048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1220/2418] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:10:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:10:18.100553 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4af6e-7afd-4c5f-b538-80fe8afd21e4 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:18.110597 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b4af6e-7afd-4c5f-b538-80fe8afd21e4 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:18.116734 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1214aeb-bc80-4a67-bd5c-0bbf73fc5348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:18.116734 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1214aeb-bc80-4a67-bd5c-0bbf73fc5348 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:18.116734 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1214aeb-bc80-4a67-bd5c-0bbf73fc5348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:18.116734 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1214aeb-bc80-4a67-bd5c-0bbf73fc5348 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:18.117120 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1214aeb-bc80-4a67-bd5c-0bbf73fc5348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:18.118889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1214aeb-bc80-4a67-bd5c-0bbf73fc5348 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:18.227441 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1199/2419] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:10:18 2022] POST /identity/v3/projects => generated 391 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:10:18.232250 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43250a-1ad2-43a3-88f6-5b1776f1e49e admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:18.242142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43250a-1ad2-43a3-88f6-5b1776f1e49e admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:18.307903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d4d44-4b2e-4730-92db-798e9a11eaaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:18.307903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d4d44-4b2e-4730-92db-798e9a11eaaf admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:18.307903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d4d44-4b2e-4730-92db-798e9a11eaaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:18.307903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f1d4d44-4b2e-4730-92db-798e9a11eaaf admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:18.308461 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d4d44-4b2e-4730-92db-798e9a11eaaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:18.310419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f1d4d44-4b2e-4730-92db-798e9a11eaaf admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:18.419348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1221/2420] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:10:18 2022] POST /identity/v3/users => generated 296 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:10:18.423430 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1214aeb-bc80-4a67-bd5c-0bbf73fc5348 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:18.433570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1214aeb-bc80-4a67-bd5c-0bbf73fc5348 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:18.438176 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c53fa-e83c-4083-b320-bf84b0c678ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:18.438766 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c53fa-e83c-4083-b320-bf84b0c678ad admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:18.439041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c53fa-e83c-4083-b320-bf84b0c678ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:18.439311 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9c53fa-e83c-4083-b320-bf84b0c678ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:18.440359 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c53fa-e83c-4083-b320-bf84b0c678ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:18.441502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9c53fa-e83c-4083-b320-bf84b0c678ad admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:18.451986 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1200/2421] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:10:18.455800 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d4d44-4b2e-4730-92db-798e9a11eaaf admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:18.466956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f1d4d44-4b2e-4730-92db-798e9a11eaaf admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:18.471558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9fde2a-effb-4cb5-b730-dcfebde63b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:18.472143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fde2a-effb-4cb5-b730-dcfebde63b51 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:18.472420 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fde2a-effb-4cb5-b730-dcfebde63b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:18.472688 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9fde2a-effb-4cb5-b730-dcfebde63b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:18.473319 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fde2a-effb-4cb5-b730-dcfebde63b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:18.475012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9fde2a-effb-4cb5-b730-dcfebde63b51 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:18.485665 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1222/2422] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:10:18.490067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c53fa-e83c-4083-b320-bf84b0c678ad admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:18.500362 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9c53fa-e83c-4083-b320-bf84b0c678ad admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:18.505259 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40686d32-85ac-4836-9734-376a8725a31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:18.505962 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40686d32-85ac-4836-9734-376a8725a31d admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:18.506264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40686d32-85ac-4836-9734-376a8725a31d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:18.506541 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40686d32-85ac-4836-9734-376a8725a31d admin admin] PATH_INFO: `/v3/projects/9e5f808f807748e9b7ee64a6c692355b/users/47cf6157f46248ada253f7d583d22915/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:18.521930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40686d32-85ac-4836-9734-376a8725a31d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e5f808f807748e9b7ee64a6c692355b, user_id=47cf6157f46248ada253f7d583d22915, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:18.525178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40686d32-85ac-4836-9734-376a8725a31d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:18.591778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1201/2423] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:10:18 2022] PUT /identity/v3/projects/9e5f808f807748e9b7ee64a6c692355b/users/47cf6157f46248ada253f7d583d22915/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:18.602359 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942663a-ef04-43d7-8c42-99883cf50ee9 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:18.602633 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942663a-ef04-43d7-8c42-99883cf50ee9 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:18.602908 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a942663a-ef04-43d7-8c42-99883cf50ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:18.631239 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a942663a-ef04-43d7-8c42-99883cf50ee9 None None] MFA Rules not processed for user `47cf6157f46248ada253f7d583d22915`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:18.632430 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a942663a-ef04-43d7-8c42-99883cf50ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:18.699991 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1223/2424] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:10:18 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:18.711055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40686d32-85ac-4836-9734-376a8725a31d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:18.713330 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-40686d32-85ac-4836-9734-376a8725a31d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:18.771508 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40686d32-85ac-4836-9734-376a8725a31d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:18.775189 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cffc48b-6b76-4f16-af07-84b9dbd6b42e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:18.775793 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffc48b-6b76-4f16-af07-84b9dbd6b42e service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:18.776072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffc48b-6b76-4f16-af07-84b9dbd6b42e service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:18.776348 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cffc48b-6b76-4f16-af07-84b9dbd6b42e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:18.784628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cffc48b-6b76-4f16-af07-84b9dbd6b42e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:18.786101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cffc48b-6b76-4f16-af07-84b9dbd6b42e service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:18.794846 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1202/2425] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:18 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:10:28.696372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=69,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:28.790891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:30.468816 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942663a-ef04-43d7-8c42-99883cf50ee9 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:30.532265 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a942663a-ef04-43d7-8c42-99883cf50ee9 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:30.536616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebdbeb-09d9-4143-b482-f01e6c395753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:30.537238 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebdbeb-09d9-4143-b482-f01e6c395753 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:30.537514 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebdbeb-09d9-4143-b482-f01e6c395753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:30.537822 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aebdbeb-09d9-4143-b482-f01e6c395753 admin admin] PATH_INFO: `/v3/users/47cf6157f46248ada253f7d583d22915` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:30.538919 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebdbeb-09d9-4143-b482-f01e6c395753 admin admin] RBAC: Authorizing `identity:delete_user(user_id=47cf6157f46248ada253f7d583d22915)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:30.540836 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aebdbeb-09d9-4143-b482-f01e6c395753 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:30.735811 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5aebdbeb-09d9-4143-b482-f01e6c395753 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47cf6157f46248ada253f7d583d22915'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:30.842837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5aebdbeb-09d9-4143-b482-f01e6c395753 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47cf6157f46248ada253f7d583d22915'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:30.855982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5aebdbeb-09d9-4143-b482-f01e6c395753 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47cf6157f46248ada253f7d583d22915'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:30.856624 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5aebdbeb-09d9-4143-b482-f01e6c395753 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47cf6157f46248ada253f7d583d22915'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:30.863469 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-5aebdbeb-09d9-4143-b482-f01e6c395753 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47cf6157f46248ada253f7d583d22915'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:30.869375 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1224/2426] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:10:30 2022] DELETE /identity/v3/users/47cf6157f46248ada253f7d583d22915 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:30.874478 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3d359-06a1-4bbd-acd9-a593944bb34e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:30.878315 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3d359-06a1-4bbd-acd9-a593944bb34e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:30.878315 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe3d359-06a1-4bbd-acd9-a593944bb34e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:30.895320 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-9fe3d359-06a1-4bbd-acd9-a593944bb34e None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:30.895923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9fe3d359-06a1-4bbd-acd9-a593944bb34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:30.962371 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1203/2427] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:30.972067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebdbeb-09d9-4143-b482-f01e6c395753 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:30.973571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-5aebdbeb-09d9-4143-b482-f01e6c395753 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:31.039024 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aebdbeb-09d9-4143-b482-f01e6c395753 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:31.044603 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907e84a-8389-4acf-9659-7e02156b6347 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:31.045215 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907e84a-8389-4acf-9659-7e02156b6347 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:31.045490 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907e84a-8389-4acf-9659-7e02156b6347 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:31.045786 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907e84a-8389-4acf-9659-7e02156b6347 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:31.055412 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907e84a-8389-4acf-9659-7e02156b6347 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:31.061869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5907e84a-8389-4acf-9659-7e02156b6347 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:31.067099 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1225/2428] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:10:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:10:31.516104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3d359-06a1-4bbd-acd9-a593944bb34e None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:31.520168 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9fe3d359-06a1-4bbd-acd9-a593944bb34e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:31.532716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe3d359-06a1-4bbd-acd9-a593944bb34e None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:31.538240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f911e47a-6c2e-45ee-b1f5-d3f72358269a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:31.538652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911e47a-6c2e-45ee-b1f5-d3f72358269a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:31.538928 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911e47a-6c2e-45ee-b1f5-d3f72358269a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:31.539202 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f911e47a-6c2e-45ee-b1f5-d3f72358269a admin admin] PATH_INFO: `/v3/projects/9e5f808f807748e9b7ee64a6c692355b` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:31.540452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911e47a-6c2e-45ee-b1f5-d3f72358269a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e5f808f807748e9b7ee64a6c692355b)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:31.543415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f911e47a-6c2e-45ee-b1f5-d3f72358269a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:31.674882 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f911e47a-6c2e-45ee-b1f5-d3f72358269a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e5f808f807748e9b7ee64a6c692355b', 'request_id': 'req-f911e47a-6c2e-45ee-b1f5-d3f72358269a'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:31.695972 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f911e47a-6c2e-45ee-b1f5-d3f72358269a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e5f808f807748e9b7ee64a6c692355b', 'request_id': 'req-f911e47a-6c2e-45ee-b1f5-d3f72358269a'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:31.703120 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f911e47a-6c2e-45ee-b1f5-d3f72358269a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e5f808f807748e9b7ee64a6c692355b', 'request_id': 'req-f911e47a-6c2e-45ee-b1f5-d3f72358269a'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:31.824324 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f911e47a-6c2e-45ee-b1f5-d3f72358269a admin admin] The token cache is being invalidate because project 9e5f808f807748e9b7ee64a6c692355b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:10:31.824721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f911e47a-6c2e-45ee-b1f5-d3f72358269a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:31.827338 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-f911e47a-6c2e-45ee-b1f5-d3f72358269a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:10:31.827338 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1204/2429] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:10:31 2022] DELETE /identity/v3/projects/9e5f808f807748e9b7ee64a6c692355b => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:10:33.375489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087c996-2996-413f-b4f2-85cc01c319e4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:33.375987 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087c996-2996-413f-b4f2-85cc01c319e4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:33.376098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7087c996-2996-413f-b4f2-85cc01c319e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:33.395567 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7087c996-2996-413f-b4f2-85cc01c319e4 None None] MFA Rules not processed for user `75a27959e4354f11bcf13a1d254a6b56`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:33.396767 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7087c996-2996-413f-b4f2-85cc01c319e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:33.414149 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:33.451751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1226/2430] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:10:33 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:37.062987 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063e18a-7dbe-4669-8974-069dbf33cdd2 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:37.063489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063e18a-7dbe-4669-8974-069dbf33cdd2 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:37.063731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c063e18a-7dbe-4669-8974-069dbf33cdd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:37.097223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-c063e18a-7dbe-4669-8974-069dbf33cdd2 None None] MFA Rules not processed for user `9fd7a80714874e73bf64dfa392632391`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:37.098752 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c063e18a-7dbe-4669-8974-069dbf33cdd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:37.164814 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1205/2431] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Sep 13 20:10:37 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:37.318695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087c996-2996-413f-b4f2-85cc01c319e4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:37.320364 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7087c996-2996-413f-b4f2-85cc01c319e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:37.390187 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7087c996-2996-413f-b4f2-85cc01c319e4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:37.396107 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e4787-205f-4af7-8bd8-d9ebe1c2a226 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00e78bf5e5c4db29c47dce1e87f3f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:37.396717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e4787-205f-4af7-8bd8-d9ebe1c2a226 service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:37.396998 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e4787-205f-4af7-8bd8-d9ebe1c2a226 service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:37.397272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e4787-205f-4af7-8bd8-d9ebe1c2a226 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:37.406566 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e4787-205f-4af7-8bd8-d9ebe1c2a226 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:37.408309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e4787-205f-4af7-8bd8-d9ebe1c2a226 service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:37.417198 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1227/2432] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Sep 13 20:10:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:10:47.157369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:47.413134 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=47 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:10:59.539479 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fa484-6494-4968-84c5-cbc9500c0b90 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:59.540004 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fa484-6494-4968-84c5-cbc9500c0b90 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:59.540004 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613fa484-6494-4968-84c5-cbc9500c0b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:59.562004 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-613fa484-6494-4968-84c5-cbc9500c0b90 None None] MFA Rules not processed for user `9fd7a80714874e73bf64dfa392632391`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:10:59.566819 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-613fa484-6494-4968-84c5-cbc9500c0b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:10:59.570651 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1206/2433] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Sep 13 20:10:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:10:59.583739 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e4787-205f-4af7-8bd8-d9ebe1c2a226 service swift] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:10:59.594837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e4787-205f-4af7-8bd8-d9ebe1c2a226 service swift] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:10:59.604441 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7c249-b0c5-4678-bd59-fade6d0b134e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00e78bf5e5c4db29c47dce1e87f3f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:10:59.605208 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7c249-b0c5-4678-bd59-fade6d0b134e service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:10:59.605805 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7c249-b0c5-4678-bd59-fade6d0b134e service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:10:59.606150 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f7c249-b0c5-4678-bd59-fade6d0b134e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:10:59.615272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7c249-b0c5-4678-bd59-fade6d0b134e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:10:59.616869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f7c249-b0c5-4678-bd59-fade6d0b134e service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:10:59.625494 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1228/2434] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Sep 13 20:10:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:11:09.555333 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:09.621644 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=6 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:20.831905 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9735d-7f1d-463e-9858-c91371036004 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:20.835604 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9735d-7f1d-463e-9858-c91371036004 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:20.835604 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda9735d-7f1d-463e-9858-c91371036004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:20.852579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-fda9735d-7f1d-463e-9858-c91371036004 None None] MFA Rules not processed for user `9fd7a80714874e73bf64dfa392632391`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:11:20.853848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-fda9735d-7f1d-463e-9858-c91371036004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:20.868205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1207/2435] 10.222.0.59 () {58 vars in 967 bytes} [Tue Sep 13 20:11:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:11:20.875361 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7c249-b0c5-4678-bd59-fade6d0b134e service swift] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:20.885934 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f7c249-b0c5-4678-bd59-fade6d0b134e service swift] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:20.890931 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f34b15-5b6c-4d31-9dc0-ac0102d38a41 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00e78bf5e5c4db29c47dce1e87f3f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:20.891528 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f34b15-5b6c-4d31-9dc0-ac0102d38a41 service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:20.891801 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f34b15-5b6c-4d31-9dc0-ac0102d38a41 service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:20.892069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f34b15-5b6c-4d31-9dc0-ac0102d38a41 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:20.901825 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f34b15-5b6c-4d31-9dc0-ac0102d38a41 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:20.901825 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f34b15-5b6c-4d31-9dc0-ac0102d38a41 service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:20.910179 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1229/2436] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Sep 13 20:11:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:11:30.846542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:30.906401 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=6 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:33.640728 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9735d-7f1d-463e-9858-c91371036004 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:33.642267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-fda9735d-7f1d-463e-9858-c91371036004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:33.705986 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda9735d-7f1d-463e-9858-c91371036004 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:33.711315 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb3c2e-d9f4-4398-973d-3cb1580008d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:33.711315 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb3c2e-d9f4-4398-973d-3cb1580008d4 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:33.711315 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb3c2e-d9f4-4398-973d-3cb1580008d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:33.711315 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fb3c2e-d9f4-4398-973d-3cb1580008d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:33.712732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-68fb3c2e-d9f4-4398-973d-3cb1580008d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:33.779619 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb3c2e-d9f4-4398-973d-3cb1580008d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:33.781132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fb3c2e-d9f4-4398-973d-3cb1580008d4 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:33.791047 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1208/2437] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:11:33 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:11:39.384002 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f34b15-5b6c-4d31-9dc0-ac0102d38a41 service swift] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:39.385429 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-90f34b15-5b6c-4d31-9dc0-ac0102d38a41 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:39.397048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f34b15-5b6c-4d31-9dc0-ac0102d38a41 service swift] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:39.401083 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953425f8-d1f7-4916-88a7-246a3951a7b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:39.401668 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953425f8-d1f7-4916-88a7-246a3951a7b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:39.401973 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953425f8-d1f7-4916-88a7-246a3951a7b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:39.402241 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953425f8-d1f7-4916-88a7-246a3951a7b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:39.403838 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-953425f8-d1f7-4916-88a7-246a3951a7b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:39.465953 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953425f8-d1f7-4916-88a7-246a3951a7b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:39.467372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953425f8-d1f7-4916-88a7-246a3951a7b0 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:39.477025 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1230/2438] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:11:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:11:40.126324 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb3c2e-d9f4-4398-973d-3cb1580008d4 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:40.134913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fb3c2e-d9f4-4398-973d-3cb1580008d4 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:40.138838 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44696865-44e5-4e9c-b68a-8245f7c92500 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:40.139451 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44696865-44e5-4e9c-b68a-8245f7c92500 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:40.139728 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44696865-44e5-4e9c-b68a-8245f7c92500 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:40.139997 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44696865-44e5-4e9c-b68a-8245f7c92500 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:40.141747 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-44696865-44e5-4e9c-b68a-8245f7c92500 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:40.154068 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44696865-44e5-4e9c-b68a-8245f7c92500 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:40.155423 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44696865-44e5-4e9c-b68a-8245f7c92500 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:40.165290 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1209/2439] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:11:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:11:43.874093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953425f8-d1f7-4916-88a7-246a3951a7b0 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:43.884940 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-953425f8-d1f7-4916-88a7-246a3951a7b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:43.890677 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953425f8-d1f7-4916-88a7-246a3951a7b0 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:43.896854 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182cbafa-fc51-43cb-a17e-0b14e76f4492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:43.897821 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cbafa-fc51-43cb-a17e-0b14e76f4492 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:43.898506 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cbafa-fc51-43cb-a17e-0b14e76f4492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:43.899005 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182cbafa-fc51-43cb-a17e-0b14e76f4492 admin admin] PATH_INFO: `/v3/users/abb30d0c8b764bed8ca98f35ea070e86` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:43.901146 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182cbafa-fc51-43cb-a17e-0b14e76f4492 admin admin] RBAC: Authorizing `identity:delete_user(user_id=abb30d0c8b764bed8ca98f35ea070e86)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:43.903350 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182cbafa-fc51-43cb-a17e-0b14e76f4492 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:44.129631 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-182cbafa-fc51-43cb-a17e-0b14e76f4492 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abb30d0c8b764bed8ca98f35ea070e86'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:44.200156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-182cbafa-fc51-43cb-a17e-0b14e76f4492 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abb30d0c8b764bed8ca98f35ea070e86'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:44.216441 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-182cbafa-fc51-43cb-a17e-0b14e76f4492 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abb30d0c8b764bed8ca98f35ea070e86'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:44.217149 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-182cbafa-fc51-43cb-a17e-0b14e76f4492 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abb30d0c8b764bed8ca98f35ea070e86'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:44.224620 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-182cbafa-fc51-43cb-a17e-0b14e76f4492 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abb30d0c8b764bed8ca98f35ea070e86'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:44.230900 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1231/2440] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:11:43 2022] DELETE /identity/v3/users/abb30d0c8b764bed8ca98f35ea070e86 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:11:44.498400 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44696865-44e5-4e9c-b68a-8245f7c92500 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:44.507426 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44696865-44e5-4e9c-b68a-8245f7c92500 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:44.573825 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1d0dcc-6799-4790-af2b-38a3c24d01cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:44.574468 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d0dcc-6799-4790-af2b-38a3c24d01cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:44.574746 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d0dcc-6799-4790-af2b-38a3c24d01cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:44.575015 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1d0dcc-6799-4790-af2b-38a3c24d01cf admin admin] PATH_INFO: `/v3/projects/aa26348a29224665a9c43fa81cbca5c3` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:44.576122 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d0dcc-6799-4790-af2b-38a3c24d01cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa26348a29224665a9c43fa81cbca5c3)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:44.578329 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1d0dcc-6799-4790-af2b-38a3c24d01cf admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:44.709916 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:44.713882 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-dd1d0dcc-6799-4790-af2b-38a3c24d01cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa26348a29224665a9c43fa81cbca5c3', 'request_id': 'req-dd1d0dcc-6799-4790-af2b-38a3c24d01cf'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:44.719839 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-dd1d0dcc-6799-4790-af2b-38a3c24d01cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa26348a29224665a9c43fa81cbca5c3', 'request_id': 'req-dd1d0dcc-6799-4790-af2b-38a3c24d01cf'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:44.726487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-dd1d0dcc-6799-4790-af2b-38a3c24d01cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa26348a29224665a9c43fa81cbca5c3', 'request_id': 'req-dd1d0dcc-6799-4790-af2b-38a3c24d01cf'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:44.794470 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-dd1d0dcc-6799-4790-af2b-38a3c24d01cf admin admin] The token cache is being invalidate because project aa26348a29224665a9c43fa81cbca5c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:11:44.794771 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-dd1d0dcc-6799-4790-af2b-38a3c24d01cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:44.795428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-dd1d0dcc-6799-4790-af2b-38a3c24d01cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:44.797166 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1210/2441] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:11:44 2022] DELETE /identity/v3/projects/aa26348a29224665a9c43fa81cbca5c3 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:11:44.802161 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c836c-9c0c-4ca4-812f-6d67d3b5afb7 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:44.802531 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c836c-9c0c-4ca4-812f-6d67d3b5afb7 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:44.802928 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f9c836c-9c0c-4ca4-812f-6d67d3b5afb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:44.823273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7f9c836c-9c0c-4ca4-812f-6d67d3b5afb7 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:11:44.824480 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7f9c836c-9c0c-4ca4-812f-6d67d3b5afb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:44.887811 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1232/2442] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:11:44.896267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de35ffd-e750-489f-9454-ab4f6a908633 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:44.896558 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de35ffd-e750-489f-9454-ab4f6a908633 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:44.896835 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de35ffd-e750-489f-9454-ab4f6a908633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:44.917226 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-0de35ffd-e750-489f-9454-ab4f6a908633 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:11:44.918532 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0de35ffd-e750-489f-9454-ab4f6a908633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:44.926618 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1211/2443] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:11:44.931029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c836c-9c0c-4ca4-812f-6d67d3b5afb7 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:44.941637 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f9c836c-9c0c-4ca4-812f-6d67d3b5afb7 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:44.946262 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97689bdc-f7c8-47a8-929c-a36f2eb5e314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:44.947052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97689bdc-f7c8-47a8-929c-a36f2eb5e314 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:44.947331 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97689bdc-f7c8-47a8-929c-a36f2eb5e314 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:44.948542 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97689bdc-f7c8-47a8-929c-a36f2eb5e314 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:44.948542 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97689bdc-f7c8-47a8-929c-a36f2eb5e314 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:11:44.948542 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97689bdc-f7c8-47a8-929c-a36f2eb5e314 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:44.950178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97689bdc-f7c8-47a8-929c-a36f2eb5e314 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:44.951738 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:44.964739 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1233/2444] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:11:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:11:44.972304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de35ffd-e750-489f-9454-ab4f6a908633 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:44.978037 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de35ffd-e750-489f-9454-ab4f6a908633 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:44.983531 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163574b0-d43b-42e8-854d-9a6ed9d326f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:44.984175 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163574b0-d43b-42e8-854d-9a6ed9d326f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:44.984458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163574b0-d43b-42e8-854d-9a6ed9d326f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:44.984732 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163574b0-d43b-42e8-854d-9a6ed9d326f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:44.985359 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163574b0-d43b-42e8-854d-9a6ed9d326f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:44.987520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163574b0-d43b-42e8-854d-9a6ed9d326f0 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:45.085503 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1212/2445] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:11:44 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:11:45.090794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97689bdc-f7c8-47a8-929c-a36f2eb5e314 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:45.101976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97689bdc-f7c8-47a8-929c-a36f2eb5e314 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:45.159498 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7e98f-2dc8-4097-b330-9059c4a3fc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:45.160050 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7e98f-2dc8-4097-b330-9059c4a3fc55 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:45.160365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7e98f-2dc8-4097-b330-9059c4a3fc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:45.160598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b7e98f-2dc8-4097-b330-9059c4a3fc55 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:45.161343 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7e98f-2dc8-4097-b330-9059c4a3fc55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:45.163181 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b7e98f-2dc8-4097-b330-9059c4a3fc55 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:45.238129 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1234/2446] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:11:45 2022] POST /identity/v3/users => generated 286 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:11:45.242454 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163574b0-d43b-42e8-854d-9a6ed9d326f0 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:45.253071 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163574b0-d43b-42e8-854d-9a6ed9d326f0 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:45.257739 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3267c-eb1a-4754-8fcc-9ddafd72fdf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:45.258380 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3267c-eb1a-4754-8fcc-9ddafd72fdf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:45.258663 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3267c-eb1a-4754-8fcc-9ddafd72fdf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:45.258935 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c3267c-eb1a-4754-8fcc-9ddafd72fdf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:45.259605 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3267c-eb1a-4754-8fcc-9ddafd72fdf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:45.261265 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c3267c-eb1a-4754-8fcc-9ddafd72fdf1 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:45.271499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1213/2447] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:11:45.276338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7e98f-2dc8-4097-b330-9059c4a3fc55 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:45.286647 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b7e98f-2dc8-4097-b330-9059c4a3fc55 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:45.291901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2737063b-1e02-41fe-8eea-e6f2c7199926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:45.292506 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737063b-1e02-41fe-8eea-e6f2c7199926 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:45.292782 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737063b-1e02-41fe-8eea-e6f2c7199926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:45.293076 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2737063b-1e02-41fe-8eea-e6f2c7199926 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:45.293740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737063b-1e02-41fe-8eea-e6f2c7199926 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:45.295368 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2737063b-1e02-41fe-8eea-e6f2c7199926 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:45.306280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1235/2448] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:11:45.310498 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3267c-eb1a-4754-8fcc-9ddafd72fdf1 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:45.320936 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c3267c-eb1a-4754-8fcc-9ddafd72fdf1 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:45.325797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83d537-44df-4c82-94f6-fac9c9fc6e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:45.326453 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83d537-44df-4c82-94f6-fac9c9fc6e9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:45.326740 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83d537-44df-4c82-94f6-fac9c9fc6e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:45.327015 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be83d537-44df-4c82-94f6-fac9c9fc6e9c admin admin] PATH_INFO: `/v3/projects/23084895e4f245199e083c34ce3f9ed0/users/d391011d11254d5a93dccf0af6d4ed35/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:45.342744 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83d537-44df-4c82-94f6-fac9c9fc6e9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=23084895e4f245199e083c34ce3f9ed0, user_id=d391011d11254d5a93dccf0af6d4ed35, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:45.345402 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be83d537-44df-4c82-94f6-fac9c9fc6e9c admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:45.411817 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1214/2449] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:11:45 2022] PUT /identity/v3/projects/23084895e4f245199e083c34ce3f9ed0/users/d391011d11254d5a93dccf0af6d4ed35/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:11:45.426778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60de5a-4c4e-48dc-9d02-8ebfe95edd8b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:45.427061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60de5a-4c4e-48dc-9d02-8ebfe95edd8b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:45.427334 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a60de5a-4c4e-48dc-9d02-8ebfe95edd8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:45.455097 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-0a60de5a-4c4e-48dc-9d02-8ebfe95edd8b None None] MFA Rules not processed for user `d391011d11254d5a93dccf0af6d4ed35`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:11:45.456288 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0a60de5a-4c4e-48dc-9d02-8ebfe95edd8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:45.522281 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1236/2450] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:11:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:11:45.527708 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83d537-44df-4c82-94f6-fac9c9fc6e9c admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:45.600912 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be83d537-44df-4c82-94f6-fac9c9fc6e9c admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:45.606608 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574a5db-34b7-46d8-999b-7b5cb2448e80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:45.607376 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574a5db-34b7-46d8-999b-7b5cb2448e80 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:45.607573 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574a5db-34b7-46d8-999b-7b5cb2448e80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:45.607850 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9574a5db-34b7-46d8-999b-7b5cb2448e80 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:45.608492 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574a5db-34b7-46d8-999b-7b5cb2448e80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:45.610448 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9574a5db-34b7-46d8-999b-7b5cb2448e80 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:45.729578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60de5a-4c4e-48dc-9d02-8ebfe95edd8b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:45.731351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1215/2451] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:11:45 2022] POST /identity/v3/projects => generated 371 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:11:45.744170 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a60de5a-4c4e-48dc-9d02-8ebfe95edd8b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:45.817097 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed73a8-a273-4a2b-a024-45507ae0ddc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:45.818038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed73a8-a273-4a2b-a024-45507ae0ddc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:45.818545 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed73a8-a273-4a2b-a024-45507ae0ddc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:45.819004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ed73a8-a273-4a2b-a024-45507ae0ddc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:45.819822 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed73a8-a273-4a2b-a024-45507ae0ddc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:45.821959 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ed73a8-a273-4a2b-a024-45507ae0ddc4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:45.832366 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:45.963297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1237/2452] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:11:45 2022] POST /identity/v3/users => generated 292 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:11:45.965154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574a5db-34b7-46d8-999b-7b5cb2448e80 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:45.975579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9574a5db-34b7-46d8-999b-7b5cb2448e80 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:45.980025 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf3967-5a5e-46ad-96d6-c31af5bcb5d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:45.980623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf3967-5a5e-46ad-96d6-c31af5bcb5d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:45.980906 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf3967-5a5e-46ad-96d6-c31af5bcb5d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:45.981195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf3967-5a5e-46ad-96d6-c31af5bcb5d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:45.981856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf3967-5a5e-46ad-96d6-c31af5bcb5d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:45.983471 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf3967-5a5e-46ad-96d6-c31af5bcb5d6 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:45.995660 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1216/2453] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:11:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:11:46.000024 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed73a8-a273-4a2b-a024-45507ae0ddc4 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:46.009961 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ed73a8-a273-4a2b-a024-45507ae0ddc4 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:46.015034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ff0d6-fb1a-4d3e-857f-cd432f99a98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:46.015740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ff0d6-fb1a-4d3e-857f-cd432f99a98a admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:46.016019 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ff0d6-fb1a-4d3e-857f-cd432f99a98a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:46.016288 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18ff0d6-fb1a-4d3e-857f-cd432f99a98a admin admin] PATH_INFO: `/v3/projects/bb92799ddb1445459a33859748cfd074/users/297e0d9992404850b61671ea05c3e9e8/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:46.036212 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ff0d6-fb1a-4d3e-857f-cd432f99a98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb92799ddb1445459a33859748cfd074, user_id=297e0d9992404850b61671ea05c3e9e8, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:46.039042 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18ff0d6-fb1a-4d3e-857f-cd432f99a98a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:46.121063 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1238/2454] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:11:45 2022] PUT /identity/v3/projects/bb92799ddb1445459a33859748cfd074/users/297e0d9992404850b61671ea05c3e9e8/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:11:46.125339 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf3967-5a5e-46ad-96d6-c31af5bcb5d6 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:46.139830 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf3967-5a5e-46ad-96d6-c31af5bcb5d6 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:46.184729 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:46.201763 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa7405a-4c00-4b30-8875-34c60ba1d60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:46.202474 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7405a-4c00-4b30-8875-34c60ba1d60e admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:46.202815 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7405a-4c00-4b30-8875-34c60ba1d60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:46.203150 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa7405a-4c00-4b30-8875-34c60ba1d60e admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:46.204408 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7405a-4c00-4b30-8875-34c60ba1d60e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:46.206112 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa7405a-4c00-4b30-8875-34c60ba1d60e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:46.217330 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1217/2455] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:11:46 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:11:46.221949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ff0d6-fb1a-4d3e-857f-cd432f99a98a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:46.233441 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18ff0d6-fb1a-4d3e-857f-cd432f99a98a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:46.238598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8f4a2-bcd1-424c-a828-b4b6993fdf9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:46.244372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8f4a2-bcd1-424c-a828-b4b6993fdf9c admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:46.244372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8f4a2-bcd1-424c-a828-b4b6993fdf9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:46.244372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c8f4a2-bcd1-424c-a828-b4b6993fdf9c admin admin] PATH_INFO: `/v3/projects/bb92799ddb1445459a33859748cfd074/users/297e0d9992404850b61671ea05c3e9e8/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:46.244372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8f4a2-bcd1-424c-a828-b4b6993fdf9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb92799ddb1445459a33859748cfd074, user_id=297e0d9992404850b61671ea05c3e9e8, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:46.245422 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c8f4a2-bcd1-424c-a828-b4b6993fdf9c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:46.256200 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1239/2456] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:11:46 2022] PUT /identity/v3/projects/bb92799ddb1445459a33859748cfd074/users/297e0d9992404850b61671ea05c3e9e8/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:11:46.266585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f2fb7-768a-4472-8147-9130b5262a03 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:46.266939 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f2fb7-768a-4472-8147-9130b5262a03 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:46.273446 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4f2fb7-768a-4472-8147-9130b5262a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:46.301620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-aa4f2fb7-768a-4472-8147-9130b5262a03 None None] MFA Rules not processed for user `297e0d9992404850b61671ea05c3e9e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:11:46.301620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-aa4f2fb7-768a-4472-8147-9130b5262a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:46.374277 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1218/2457] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:11:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:11:46.382131 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8f4a2-bcd1-424c-a828-b4b6993fdf9c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:46.383834 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-59c8f4a2-bcd1-424c-a828-b4b6993fdf9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:46.476670 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c8f4a2-bcd1-424c-a828-b4b6993fdf9c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:46.480973 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda0e66-597a-4cdc-9240-d6ab6e82f571 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:46.485255 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda0e66-597a-4cdc-9240-d6ab6e82f571 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:46.485255 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda0e66-597a-4cdc-9240-d6ab6e82f571 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:46.485255 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda0e66-597a-4cdc-9240-d6ab6e82f571 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:46.492398 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda0e66-597a-4cdc-9240-d6ab6e82f571 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:46.494198 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cda0e66-597a-4cdc-9240-d6ab6e82f571 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:46.506269 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1240/2458] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:11:46 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:11:46.733047 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f2fb7-768a-4472-8147-9130b5262a03 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:46.743452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4f2fb7-768a-4472-8147-9130b5262a03 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:46.747408 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6b931-6d01-4387-abc5-13323a7f8679 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:46.748016 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6b931-6d01-4387-abc5-13323a7f8679 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:46.748293 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6b931-6d01-4387-abc5-13323a7f8679 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:46.748564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a6b931-6d01-4387-abc5-13323a7f8679 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:46.809533 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6b931-6d01-4387-abc5-13323a7f8679 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:46.811048 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a6b931-6d01-4387-abc5-13323a7f8679 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:46.820402 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1219/2459] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:11:46 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:11:48.075103 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda0e66-597a-4cdc-9240-d6ab6e82f571 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:48.076605 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4cda0e66-597a-4cdc-9240-d6ab6e82f571 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:48.142168 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda0e66-597a-4cdc-9240-d6ab6e82f571 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:48.146646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88377edf-f59a-47b1-adcc-d6df515c9bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:48.147268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88377edf-f59a-47b1-adcc-d6df515c9bcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:48.147546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88377edf-f59a-47b1-adcc-d6df515c9bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:48.147816 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88377edf-f59a-47b1-adcc-d6df515c9bcf admin admin] PATH_INFO: `/v3/users/daa43ab7e8df457ea1540de347575a35` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:48.148946 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88377edf-f59a-47b1-adcc-d6df515c9bcf admin admin] RBAC: Authorizing `identity:delete_user(user_id=daa43ab7e8df457ea1540de347575a35)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:48.150906 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88377edf-f59a-47b1-adcc-d6df515c9bcf admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:48.333106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:INSERT=4,keystone:SELECT=91,keystone:DELETE=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:48.339094 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-88377edf-f59a-47b1-adcc-d6df515c9bcf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daa43ab7e8df457ea1540de347575a35'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:48.406171 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-88377edf-f59a-47b1-adcc-d6df515c9bcf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daa43ab7e8df457ea1540de347575a35'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:48.418919 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-88377edf-f59a-47b1-adcc-d6df515c9bcf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daa43ab7e8df457ea1540de347575a35'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:48.419656 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-88377edf-f59a-47b1-adcc-d6df515c9bcf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daa43ab7e8df457ea1540de347575a35'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:48.426752 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-88377edf-f59a-47b1-adcc-d6df515c9bcf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daa43ab7e8df457ea1540de347575a35'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:48.433580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1241/2460] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:11:48 2022] DELETE /identity/v3/users/daa43ab7e8df457ea1540de347575a35 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:11:48.703043 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6b931-6d01-4387-abc5-13323a7f8679 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:48.720581 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a6b931-6d01-4387-abc5-13323a7f8679 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:48.777813 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ce042-f3c4-429d-a2f7-32e5276b51d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:48.778451 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ce042-f3c4-429d-a2f7-32e5276b51d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:48.778735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ce042-f3c4-429d-a2f7-32e5276b51d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:48.779009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ce042-f3c4-429d-a2f7-32e5276b51d9 admin admin] PATH_INFO: `/v3/projects/edd4fa1455a647eca8e63a16b9ab0751` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:48.780156 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ce042-f3c4-429d-a2f7-32e5276b51d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edd4fa1455a647eca8e63a16b9ab0751)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:48.782124 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ce042-f3c4-429d-a2f7-32e5276b51d9 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:48.784510 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:11:48.932101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-468ce042-f3c4-429d-a2f7-32e5276b51d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edd4fa1455a647eca8e63a16b9ab0751', 'request_id': 'req-468ce042-f3c4-429d-a2f7-32e5276b51d9'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:48.938142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-468ce042-f3c4-429d-a2f7-32e5276b51d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edd4fa1455a647eca8e63a16b9ab0751', 'request_id': 'req-468ce042-f3c4-429d-a2f7-32e5276b51d9'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:48.944621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-468ce042-f3c4-429d-a2f7-32e5276b51d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edd4fa1455a647eca8e63a16b9ab0751', 'request_id': 'req-468ce042-f3c4-429d-a2f7-32e5276b51d9'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:49.034375 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-468ce042-f3c4-429d-a2f7-32e5276b51d9 admin admin] The token cache is being invalidate because project edd4fa1455a647eca8e63a16b9ab0751 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:11:49.034678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-468ce042-f3c4-429d-a2f7-32e5276b51d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:49.035321 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-468ce042-f3c4-429d-a2f7-32e5276b51d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:49.036837 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1220/2461] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:11:48 2022] DELETE /identity/v3/projects/edd4fa1455a647eca8e63a16b9ab0751 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:11:49.040845 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88377edf-f59a-47b1-adcc-d6df515c9bcf admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:49.042275 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-88377edf-f59a-47b1-adcc-d6df515c9bcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:49.055287 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88377edf-f59a-47b1-adcc-d6df515c9bcf admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:49.126680 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968765d-2013-43f3-85d2-04d40d3ddbda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:49.127401 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968765d-2013-43f3-85d2-04d40d3ddbda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:49.127684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968765d-2013-43f3-85d2-04d40d3ddbda admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:49.127955 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6968765d-2013-43f3-85d2-04d40d3ddbda admin admin] PATH_INFO: `/v3/users/d455fd45d43c4945ac1106b62ca65d7f` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:49.129057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968765d-2013-43f3-85d2-04d40d3ddbda admin admin] RBAC: Authorizing `identity:delete_user(user_id=d455fd45d43c4945ac1106b62ca65d7f)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:49.131048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6968765d-2013-43f3-85d2-04d40d3ddbda admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:49.343039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6968765d-2013-43f3-85d2-04d40d3ddbda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd455fd45d43c4945ac1106b62ca65d7f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:49.432026 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6968765d-2013-43f3-85d2-04d40d3ddbda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd455fd45d43c4945ac1106b62ca65d7f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:49.445043 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6968765d-2013-43f3-85d2-04d40d3ddbda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd455fd45d43c4945ac1106b62ca65d7f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:49.445765 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6968765d-2013-43f3-85d2-04d40d3ddbda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd455fd45d43c4945ac1106b62ca65d7f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:49.453970 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-6968765d-2013-43f3-85d2-04d40d3ddbda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd455fd45d43c4945ac1106b62ca65d7f'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:49.459927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1242/2462] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:11:49 2022] DELETE /identity/v3/users/d455fd45d43c4945ac1106b62ca65d7f => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:11:49.692819 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ce042-f3c4-429d-a2f7-32e5276b51d9 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:11:49.696280 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-468ce042-f3c4-429d-a2f7-32e5276b51d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:11:49.707469 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ce042-f3c4-429d-a2f7-32e5276b51d9 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:11:49.765338 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b413a-7060-43ce-9e77-020b93fb3f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:11:49.765972 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b413a-7060-43ce-9e77-020b93fb3f08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:11:49.766253 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b413a-7060-43ce-9e77-020b93fb3f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:11:49.766543 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b413a-7060-43ce-9e77-020b93fb3f08 admin admin] PATH_INFO: `/v3/projects/469dc0563e1e4d07b631dbdf249d4bb1` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:11:49.767682 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b413a-7060-43ce-9e77-020b93fb3f08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=469dc0563e1e4d07b631dbdf249d4bb1)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:11:49.770019 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b413a-7060-43ce-9e77-020b93fb3f08 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:11:49.930853 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6c4b413a-7060-43ce-9e77-020b93fb3f08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '469dc0563e1e4d07b631dbdf249d4bb1', 'request_id': 'req-6c4b413a-7060-43ce-9e77-020b93fb3f08'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:49.936496 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6c4b413a-7060-43ce-9e77-020b93fb3f08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '469dc0563e1e4d07b631dbdf249d4bb1', 'request_id': 'req-6c4b413a-7060-43ce-9e77-020b93fb3f08'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:49.942962 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6c4b413a-7060-43ce-9e77-020b93fb3f08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '469dc0563e1e4d07b631dbdf249d4bb1', 'request_id': 'req-6c4b413a-7060-43ce-9e77-020b93fb3f08'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:50.029428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6c4b413a-7060-43ce-9e77-020b93fb3f08 admin admin] The token cache is being invalidate because project 469dc0563e1e4d07b631dbdf249d4bb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:11:50.029638 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6c4b413a-7060-43ce-9e77-020b93fb3f08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:50.030287 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6c4b413a-7060-43ce-9e77-020b93fb3f08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:11:50.031791 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1221/2463] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:11:49 2022] DELETE /identity/v3/projects/469dc0563e1e4d07b631dbdf249d4bb1 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:11:59.456497 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=15,keystone:SELECT=67,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:00.025251 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=74,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:06.801849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968765d-2013-43f3-85d2-04d40d3ddbda admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:06.803262 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6968765d-2013-43f3-85d2-04d40d3ddbda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:06.859386 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6968765d-2013-43f3-85d2-04d40d3ddbda admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:06.906514 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa00dbc-9441-4a1f-b128-f2dd0883eca4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:06.907120 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa00dbc-9441-4a1f-b128-f2dd0883eca4 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:06.907398 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa00dbc-9441-4a1f-b128-f2dd0883eca4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:06.907667 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa00dbc-9441-4a1f-b128-f2dd0883eca4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:06.909405 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0aa00dbc-9441-4a1f-b128-f2dd0883eca4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:06.989727 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa00dbc-9441-4a1f-b128-f2dd0883eca4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:06.991033 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa00dbc-9441-4a1f-b128-f2dd0883eca4 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:07.010903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1243/2464] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:12:10.110390 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b413a-7060-43ce-9e77-020b93fb3f08 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:10.111785 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6c4b413a-7060-43ce-9e77-020b93fb3f08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:10.124459 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b413a-7060-43ce-9e77-020b93fb3f08 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:10.128078 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de36baf-45a8-429f-83bf-2342e53941f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:10.128675 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de36baf-45a8-429f-83bf-2342e53941f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:10.128955 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de36baf-45a8-429f-83bf-2342e53941f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:10.129224 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de36baf-45a8-429f-83bf-2342e53941f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:10.131463 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4de36baf-45a8-429f-83bf-2342e53941f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:10.144493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de36baf-45a8-429f-83bf-2342e53941f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:10.145952 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de36baf-45a8-429f-83bf-2342e53941f3 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:10.156709 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1222/2465] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:12:17.008272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=83 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:20.151832 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=6 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:22.801897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa00dbc-9441-4a1f-b128-f2dd0883eca4 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:22.803413 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-0aa00dbc-9441-4a1f-b128-f2dd0883eca4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:22.859921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa00dbc-9441-4a1f-b128-f2dd0883eca4 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:22.863447 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ee6e1b-9e5e-44d5-889d-f0524767c108 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:22.864042 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee6e1b-9e5e-44d5-889d-f0524767c108 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:22.864316 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee6e1b-9e5e-44d5-889d-f0524767c108 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:22.864582 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ee6e1b-9e5e-44d5-889d-f0524767c108 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:22.866264 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-39ee6e1b-9e5e-44d5-889d-f0524767c108 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:22.932575 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee6e1b-9e5e-44d5-889d-f0524767c108 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:22.934528 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ee6e1b-9e5e-44d5-889d-f0524767c108 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:22.944370 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1244/2466] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:12:23.838203 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de36baf-45a8-429f-83bf-2342e53941f3 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:23.850236 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4de36baf-45a8-429f-83bf-2342e53941f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:23.853974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de36baf-45a8-429f-83bf-2342e53941f3 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:23.858622 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99e14f-0ba0-46cd-baca-01b0f72cb0a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:23.859239 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99e14f-0ba0-46cd-baca-01b0f72cb0a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:23.859516 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99e14f-0ba0-46cd-baca-01b0f72cb0a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:23.859813 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c99e14f-0ba0-46cd-baca-01b0f72cb0a7 admin admin] PATH_INFO: `/v3/users/d391011d11254d5a93dccf0af6d4ed35` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:23.860931 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99e14f-0ba0-46cd-baca-01b0f72cb0a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d391011d11254d5a93dccf0af6d4ed35)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:23.862994 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c99e14f-0ba0-46cd-baca-01b0f72cb0a7 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:24.035370 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5c99e14f-0ba0-46cd-baca-01b0f72cb0a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd391011d11254d5a93dccf0af6d4ed35'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:24.117347 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5c99e14f-0ba0-46cd-baca-01b0f72cb0a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd391011d11254d5a93dccf0af6d4ed35'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:24.149035 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5c99e14f-0ba0-46cd-baca-01b0f72cb0a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd391011d11254d5a93dccf0af6d4ed35'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:24.150316 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5c99e14f-0ba0-46cd-baca-01b0f72cb0a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd391011d11254d5a93dccf0af6d4ed35'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:24.169240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5c99e14f-0ba0-46cd-baca-01b0f72cb0a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd391011d11254d5a93dccf0af6d4ed35'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:24.176754 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1223/2467] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:12:23 2022] DELETE /identity/v3/users/d391011d11254d5a93dccf0af6d4ed35 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:24.182456 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67817d-e206-4eca-a6b5-a9c59fea5c0d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:24.183516 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67817d-e206-4eca-a6b5-a9c59fea5c0d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:24.183611 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f67817d-e206-4eca-a6b5-a9c59fea5c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:24.204866 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2f67817d-e206-4eca-a6b5-a9c59fea5c0d None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:24.206120 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2f67817d-e206-4eca-a6b5-a9c59fea5c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:24.289581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1245/2468] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:24.306281 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99e14f-0ba0-46cd-baca-01b0f72cb0a7 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:24.308268 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5c99e14f-0ba0-46cd-baca-01b0f72cb0a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:24.376358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c99e14f-0ba0-46cd-baca-01b0f72cb0a7 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:24.381720 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575c219-f528-472b-889f-af0e017ef2d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:24.382363 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575c219-f528-472b-889f-af0e017ef2d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:24.382642 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575c219-f528-472b-889f-af0e017ef2d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:24.383507 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b575c219-f528-472b-889f-af0e017ef2d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:24.399028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575c219-f528-472b-889f-af0e017ef2d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:24.400890 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b575c219-f528-472b-889f-af0e017ef2d8 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:24.412530 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1224/2469] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:12:25.401054 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67817d-e206-4eca-a6b5-a9c59fea5c0d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:25.403465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2f67817d-e206-4eca-a6b5-a9c59fea5c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:25.424396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f67817d-e206-4eca-a6b5-a9c59fea5c0d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:25.432393 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e4195-d5ad-4d8d-aee4-61f0a8ee804d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:25.433972 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e4195-d5ad-4d8d-aee4-61f0a8ee804d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:25.434485 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e4195-d5ad-4d8d-aee4-61f0a8ee804d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:25.434975 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e4195-d5ad-4d8d-aee4-61f0a8ee804d admin admin] PATH_INFO: `/v3/projects/23084895e4f245199e083c34ce3f9ed0` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:25.436921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e4195-d5ad-4d8d-aee4-61f0a8ee804d admin admin] RBAC: Authorizing `identity:delete_project(project_id=23084895e4f245199e083c34ce3f9ed0)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:25.439266 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e4195-d5ad-4d8d-aee4-61f0a8ee804d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:25.573953 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:25.574370 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a57e4195-d5ad-4d8d-aee4-61f0a8ee804d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23084895e4f245199e083c34ce3f9ed0', 'request_id': 'req-a57e4195-d5ad-4d8d-aee4-61f0a8ee804d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:25.680413 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a57e4195-d5ad-4d8d-aee4-61f0a8ee804d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23084895e4f245199e083c34ce3f9ed0', 'request_id': 'req-a57e4195-d5ad-4d8d-aee4-61f0a8ee804d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:25.693842 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a57e4195-d5ad-4d8d-aee4-61f0a8ee804d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23084895e4f245199e083c34ce3f9ed0', 'request_id': 'req-a57e4195-d5ad-4d8d-aee4-61f0a8ee804d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:25.710855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a57e4195-d5ad-4d8d-aee4-61f0a8ee804d admin admin] The token cache is being invalidate because project 23084895e4f245199e083c34ce3f9ed0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:12:25.714756 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a57e4195-d5ad-4d8d-aee4-61f0a8ee804d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:25.720276 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a57e4195-d5ad-4d8d-aee4-61f0a8ee804d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:25.720276 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1246/2470] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:12:25 2022] DELETE /identity/v3/projects/23084895e4f245199e083c34ce3f9ed0 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:25.721862 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575c219-f528-472b-889f-af0e017ef2d8 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:25.734081 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b575c219-f528-472b-889f-af0e017ef2d8 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:25.858447 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ffdc1-9535-45bd-beca-2cbdf4d1aefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:25.860328 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ffdc1-9535-45bd-beca-2cbdf4d1aefa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:25.864630 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ffdc1-9535-45bd-beca-2cbdf4d1aefa admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:25.864630 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917ffdc1-9535-45bd-beca-2cbdf4d1aefa admin admin] PATH_INFO: `/v3/users/297e0d9992404850b61671ea05c3e9e8` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:25.864630 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ffdc1-9535-45bd-beca-2cbdf4d1aefa admin admin] RBAC: Authorizing `identity:delete_user(user_id=297e0d9992404850b61671ea05c3e9e8)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:25.864947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917ffdc1-9535-45bd-beca-2cbdf4d1aefa admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:25.886432 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:26.115285 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-917ffdc1-9535-45bd-beca-2cbdf4d1aefa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '297e0d9992404850b61671ea05c3e9e8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:26.213862 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-917ffdc1-9535-45bd-beca-2cbdf4d1aefa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '297e0d9992404850b61671ea05c3e9e8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:26.235111 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-917ffdc1-9535-45bd-beca-2cbdf4d1aefa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '297e0d9992404850b61671ea05c3e9e8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:26.235889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-917ffdc1-9535-45bd-beca-2cbdf4d1aefa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '297e0d9992404850b61671ea05c3e9e8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:26.243356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-917ffdc1-9535-45bd-beca-2cbdf4d1aefa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '297e0d9992404850b61671ea05c3e9e8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:26.249360 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1225/2471] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:12:25 2022] DELETE /identity/v3/users/297e0d9992404850b61671ea05c3e9e8 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:26.918664 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e4195-d5ad-4d8d-aee4-61f0a8ee804d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:26.920353 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a57e4195-d5ad-4d8d-aee4-61f0a8ee804d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:26.946962 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e4195-d5ad-4d8d-aee4-61f0a8ee804d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:27.032402 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8397ae2f-0101-4fe7-86ae-6ae39dfac7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:27.033894 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397ae2f-0101-4fe7-86ae-6ae39dfac7dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:27.038783 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397ae2f-0101-4fe7-86ae-6ae39dfac7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:27.038783 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8397ae2f-0101-4fe7-86ae-6ae39dfac7dd admin admin] PATH_INFO: `/v3/projects/bb92799ddb1445459a33859748cfd074` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:27.038783 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397ae2f-0101-4fe7-86ae-6ae39dfac7dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb92799ddb1445459a33859748cfd074)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:27.038783 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8397ae2f-0101-4fe7-86ae-6ae39dfac7dd admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:27.129404 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8397ae2f-0101-4fe7-86ae-6ae39dfac7dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb92799ddb1445459a33859748cfd074', 'request_id': 'req-8397ae2f-0101-4fe7-86ae-6ae39dfac7dd'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:27.136353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ffdc1-9535-45bd-beca-2cbdf4d1aefa admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:27.137835 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-917ffdc1-9535-45bd-beca-2cbdf4d1aefa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:27.151292 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917ffdc1-9535-45bd-beca-2cbdf4d1aefa admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:27.211721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce06e26-0e1c-43eb-b378-6d1c743d6e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:27.212361 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce06e26-0e1c-43eb-b378-6d1c743d6e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:27.212642 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce06e26-0e1c-43eb-b378-6d1c743d6e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:27.212908 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce06e26-0e1c-43eb-b378-6d1c743d6e7f admin admin] PATH_INFO: `/v3/users/75a27959e4354f11bcf13a1d254a6b56` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:27.227607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce06e26-0e1c-43eb-b378-6d1c743d6e7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=75a27959e4354f11bcf13a1d254a6b56)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:27.229721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce06e26-0e1c-43eb-b378-6d1c743d6e7f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:27.237494 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8397ae2f-0101-4fe7-86ae-6ae39dfac7dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb92799ddb1445459a33859748cfd074', 'request_id': 'req-8397ae2f-0101-4fe7-86ae-6ae39dfac7dd'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:27.245417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8397ae2f-0101-4fe7-86ae-6ae39dfac7dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb92799ddb1445459a33859748cfd074', 'request_id': 'req-8397ae2f-0101-4fe7-86ae-6ae39dfac7dd'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:27.259845 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8397ae2f-0101-4fe7-86ae-6ae39dfac7dd admin admin] The token cache is being invalidate because project bb92799ddb1445459a33859748cfd074 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:12:27.260142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8397ae2f-0101-4fe7-86ae-6ae39dfac7dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:27.260982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-8397ae2f-0101-4fe7-86ae-6ae39dfac7dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:27.262756 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1247/2472] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:12:26 2022] DELETE /identity/v3/projects/bb92799ddb1445459a33859748cfd074 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:27.267392 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b2e50-67dd-4490-a9f6-6c741b518c57 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:27.267623 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b2e50-67dd-4490-a9f6-6c741b518c57 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:27.267902 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862b2e50-67dd-4490-a9f6-6c741b518c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:27.291240 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-862b2e50-67dd-4490-a9f6-6c741b518c57 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:27.293413 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-862b2e50-67dd-4490-a9f6-6c741b518c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:27.301351 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1248/2473] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:12:27.309797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534ce93-c505-4da2-a5f9-23180055bdbe None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:27.310085 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534ce93-c505-4da2-a5f9-23180055bdbe None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:27.310358 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f534ce93-c505-4da2-a5f9-23180055bdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:27.331416 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f534ce93-c505-4da2-a5f9-23180055bdbe None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:27.332609 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f534ce93-c505-4da2-a5f9-23180055bdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:27.341276 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1249/2474] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:27.346669 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534ce93-c505-4da2-a5f9-23180055bdbe None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:27.355788 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f534ce93-c505-4da2-a5f9-23180055bdbe None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:27.360609 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbcb19-442a-431b-b351-7cffe89a8689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:27.361000 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbcb19-442a-431b-b351-7cffe89a8689 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:27.361284 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbcb19-442a-431b-b351-7cffe89a8689 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:27.361560 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdbcb19-442a-431b-b351-7cffe89a8689 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:27.362247 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbcb19-442a-431b-b351-7cffe89a8689 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:12:27.362550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbcb19-442a-431b-b351-7cffe89a8689 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:27.364174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdbcb19-442a-431b-b351-7cffe89a8689 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:27.376708 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1250/2475] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:12:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:12:27.380813 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbcb19-442a-431b-b351-7cffe89a8689 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:27.390995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdbcb19-442a-431b-b351-7cffe89a8689 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:27.395597 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd00482-087b-4a43-8199-ee1a523ea5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:27.396161 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd00482-087b-4a43-8199-ee1a523ea5a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:27.396434 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd00482-087b-4a43-8199-ee1a523ea5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:27.396700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd00482-087b-4a43-8199-ee1a523ea5a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:27.397429 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd00482-087b-4a43-8199-ee1a523ea5a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:27.399312 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd00482-087b-4a43-8199-ee1a523ea5a2 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:27.422490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7ce06e26-0e1c-43eb-b378-6d1c743d6e7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75a27959e4354f11bcf13a1d254a6b56'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:27.510770 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7ce06e26-0e1c-43eb-b378-6d1c743d6e7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75a27959e4354f11bcf13a1d254a6b56'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:27.521865 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1251/2476] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:12:27 2022] POST /identity/v3/projects => generated 381 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:12:27.526477 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd00482-087b-4a43-8199-ee1a523ea5a2 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:27.528524 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7ce06e26-0e1c-43eb-b378-6d1c743d6e7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75a27959e4354f11bcf13a1d254a6b56'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:27.529523 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7ce06e26-0e1c-43eb-b378-6d1c743d6e7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75a27959e4354f11bcf13a1d254a6b56'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:27.537869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:27.539778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-7ce06e26-0e1c-43eb-b378-6d1c743d6e7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75a27959e4354f11bcf13a1d254a6b56'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:27.550777 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1226/2477] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:12:27 2022] DELETE /identity/v3/users/75a27959e4354f11bcf13a1d254a6b56 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:27.613582 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd00482-087b-4a43-8199-ee1a523ea5a2 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:27.670068 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a2d77-2d82-4d94-a1bd-f52e986a1639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:27.670681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a2d77-2d82-4d94-a1bd-f52e986a1639 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:27.671046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a2d77-2d82-4d94-a1bd-f52e986a1639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:27.671323 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773a2d77-2d82-4d94-a1bd-f52e986a1639 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:27.671957 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a2d77-2d82-4d94-a1bd-f52e986a1639 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:27.673914 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773a2d77-2d82-4d94-a1bd-f52e986a1639 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:27.777745 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1252/2478] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:12:27 2022] POST /identity/v3/users => generated 291 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:12:27.779219 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce06e26-0e1c-43eb-b378-6d1c743d6e7f admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:27.780638 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7ce06e26-0e1c-43eb-b378-6d1c743d6e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:27.788654 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:27.795134 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce06e26-0e1c-43eb-b378-6d1c743d6e7f admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:27.800686 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ab6df-b36c-4327-8ec1-f00d199545ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:27.809206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ab6df-b36c-4327-8ec1-f00d199545ae admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:27.809206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ab6df-b36c-4327-8ec1-f00d199545ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:27.809206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398ab6df-b36c-4327-8ec1-f00d199545ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:27.809206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ab6df-b36c-4327-8ec1-f00d199545ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:27.809206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398ab6df-b36c-4327-8ec1-f00d199545ae admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:27.811630 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a2d77-2d82-4d94-a1bd-f52e986a1639 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:27.814971 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-773a2d77-2d82-4d94-a1bd-f52e986a1639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:27.819894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1227/2479] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:12:27.824962 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ab6df-b36c-4327-8ec1-f00d199545ae admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:27.829219 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773a2d77-2d82-4d94-a1bd-f52e986a1639 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:27.835347 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8e4d16-7069-4fb0-ba9c-e71492046ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:27.839494 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e4d16-7069-4fb0-ba9c-e71492046ed5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:27.839494 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e4d16-7069-4fb0-ba9c-e71492046ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:27.839494 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8e4d16-7069-4fb0-ba9c-e71492046ed5 admin admin] PATH_INFO: `/v3/projects/f01e074d7c91487c81374c1e45d81f9c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:27.843077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398ab6df-b36c-4327-8ec1-f00d199545ae admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:27.850739 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68555f3-9cf7-4b43-a802-818733f2b649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:27.851371 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68555f3-9cf7-4b43-a802-818733f2b649 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:27.851649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68555f3-9cf7-4b43-a802-818733f2b649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:27.851766 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e4d16-7069-4fb0-ba9c-e71492046ed5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f01e074d7c91487c81374c1e45d81f9c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:27.851918 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68555f3-9cf7-4b43-a802-818733f2b649 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:27.852676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68555f3-9cf7-4b43-a802-818733f2b649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:27.853919 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8e4d16-7069-4fb0-ba9c-e71492046ed5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:27.854479 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68555f3-9cf7-4b43-a802-818733f2b649 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:27.868991 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1228/2480] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:27 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:12:27.874523 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68555f3-9cf7-4b43-a802-818733f2b649 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:27.888193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68555f3-9cf7-4b43-a802-818733f2b649 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:27.903331 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a65b8c-c8ba-4e15-bffd-c8771ae0af6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:27.903331 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a65b8c-c8ba-4e15-bffd-c8771ae0af6d admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:27.903331 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a65b8c-c8ba-4e15-bffd-c8771ae0af6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:27.903331 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a65b8c-c8ba-4e15-bffd-c8771ae0af6d admin admin] PATH_INFO: `/v3/projects/5d76ad7921004d719c55d9fff2ed8551/users/1396ccf1f2c74288b2ab11f04ca64503/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:27.914556 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a65b8c-c8ba-4e15-bffd-c8771ae0af6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=5d76ad7921004d719c55d9fff2ed8551, user_id=1396ccf1f2c74288b2ab11f04ca64503, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:27.917202 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a65b8c-c8ba-4e15-bffd-c8771ae0af6d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:27.999349 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1229/2481] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:12:27 2022] PUT /identity/v3/projects/5d76ad7921004d719c55d9fff2ed8551/users/1396ccf1f2c74288b2ab11f04ca64503/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:12:28.007502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dc8e4d16-7069-4fb0-ba9c-e71492046ed5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f01e074d7c91487c81374c1e45d81f9c', 'request_id': 'req-dc8e4d16-7069-4fb0-ba9c-e71492046ed5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:28.009885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60df79b-b643-4a0b-8206-6e4d583bc9c2 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:28.010376 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60df79b-b643-4a0b-8206-6e4d583bc9c2 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:28.010658 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60df79b-b643-4a0b-8206-6e4d583bc9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:28.038555 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-b60df79b-b643-4a0b-8206-6e4d583bc9c2 None None] MFA Rules not processed for user `1396ccf1f2c74288b2ab11f04ca64503`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:28.040276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b60df79b-b643-4a0b-8206-6e4d583bc9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:28.062005 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dc8e4d16-7069-4fb0-ba9c-e71492046ed5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f01e074d7c91487c81374c1e45d81f9c', 'request_id': 'req-dc8e4d16-7069-4fb0-ba9c-e71492046ed5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:28.068330 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dc8e4d16-7069-4fb0-ba9c-e71492046ed5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f01e074d7c91487c81374c1e45d81f9c', 'request_id': 'req-dc8e4d16-7069-4fb0-ba9c-e71492046ed5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:28.080761 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dc8e4d16-7069-4fb0-ba9c-e71492046ed5 admin admin] The token cache is being invalidate because project f01e074d7c91487c81374c1e45d81f9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:12:28.081200 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dc8e4d16-7069-4fb0-ba9c-e71492046ed5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:28.081907 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dc8e4d16-7069-4fb0-ba9c-e71492046ed5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:28.083770 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1253/2482] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:12:27 2022] DELETE /identity/v3/projects/f01e074d7c91487c81374c1e45d81f9c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:28.088527 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9890f1-55c6-466d-8bb1-0a66ccef82dc None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:28.088813 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9890f1-55c6-466d-8bb1-0a66ccef82dc None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:28.089088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9890f1-55c6-466d-8bb1-0a66ccef82dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:28.106038 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1230/2483] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:12:28.107932 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8c9890f1-55c6-466d-8bb1-0a66ccef82dc None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:28.109132 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8c9890f1-55c6-466d-8bb1-0a66ccef82dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:28.110530 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60df79b-b643-4a0b-8206-6e4d583bc9c2 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:28.113985 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b60df79b-b643-4a0b-8206-6e4d583bc9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:28.167170 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1254/2484] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:12:28.174821 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd48ae-53e4-4bf5-8ebc-3bdb3d277a1f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:28.175119 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd48ae-53e4-4bf5-8ebc-3bdb3d277a1f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:28.175389 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfd48ae-53e4-4bf5-8ebc-3bdb3d277a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:28.175718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60df79b-b643-4a0b-8206-6e4d583bc9c2 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:28.180282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f2aa9-c582-4081-9c7d-f99c970c8513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:28.180882 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f2aa9-c582-4081-9c7d-f99c970c8513 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:28.181161 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f2aa9-c582-4081-9c7d-f99c970c8513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:28.181433 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661f2aa9-c582-4081-9c7d-f99c970c8513 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:28.182140 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f2aa9-c582-4081-9c7d-f99c970c8513 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:28.184634 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661f2aa9-c582-4081-9c7d-f99c970c8513 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:28.195022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-fdfd48ae-53e4-4bf5-8ebc-3bdb3d277a1f None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:28.196224 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-fdfd48ae-53e4-4bf5-8ebc-3bdb3d277a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:28.205901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1255/2485] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:28.210267 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd48ae-53e4-4bf5-8ebc-3bdb3d277a1f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:28.219351 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfd48ae-53e4-4bf5-8ebc-3bdb3d277a1f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:28.224240 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1dfb8a-aa65-4fdc-ad62-17f892c414e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:28.224819 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dfb8a-aa65-4fdc-ad62-17f892c414e9 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:28.225094 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dfb8a-aa65-4fdc-ad62-17f892c414e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:28.225365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dfb8a-aa65-4fdc-ad62-17f892c414e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:28.226032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1dfb8a-aa65-4fdc-ad62-17f892c414e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:12:28.226331 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1dfb8a-aa65-4fdc-ad62-17f892c414e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:28.228063 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1dfb8a-aa65-4fdc-ad62-17f892c414e9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:28.239501 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1256/2486] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:12:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:12:28.243612 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1dfb8a-aa65-4fdc-ad62-17f892c414e9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:28.253374 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1dfb8a-aa65-4fdc-ad62-17f892c414e9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:28.257835 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f54b5-d2ef-4e65-a8d4-bc371baae949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:28.258391 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f54b5-d2ef-4e65-a8d4-bc371baae949 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:28.258674 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f54b5-d2ef-4e65-a8d4-bc371baae949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:28.258945 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016f54b5-d2ef-4e65-a8d4-bc371baae949 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:28.259544 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f54b5-d2ef-4e65-a8d4-bc371baae949 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:28.262057 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-016f54b5-d2ef-4e65-a8d4-bc371baae949 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:28.289496 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1231/2487] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:12:28 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:12:28.294079 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f2aa9-c582-4081-9c7d-f99c970c8513 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:28.354282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661f2aa9-c582-4081-9c7d-f99c970c8513 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:28.359430 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b48e61-5ce2-4d26-83d8-705012bb5dc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:28.360041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b48e61-5ce2-4d26-83d8-705012bb5dc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:28.360325 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b48e61-5ce2-4d26-83d8-705012bb5dc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:28.360595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b48e61-5ce2-4d26-83d8-705012bb5dc4 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:28.361226 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b48e61-5ce2-4d26-83d8-705012bb5dc4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:28.363192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b48e61-5ce2-4d26-83d8-705012bb5dc4 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:28.367696 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1257/2488] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:12:28 2022] POST /identity/v3/projects => generated 405 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:12:28.368798 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f54b5-d2ef-4e65-a8d4-bc371baae949 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:28.381038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:28.434462 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1232/2489] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:12:28 2022] POST /identity/v3/users => generated 296 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:12:28.434661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016f54b5-d2ef-4e65-a8d4-bc371baae949 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:28.435526 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b48e61-5ce2-4d26-83d8-705012bb5dc4 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:28.437283 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99c338-51c7-4751-9a8d-71adb2988586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:28.437942 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99c338-51c7-4751-9a8d-71adb2988586 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:28.438225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99c338-51c7-4751-9a8d-71adb2988586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:28.438499 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad99c338-51c7-4751-9a8d-71adb2988586 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:28.439172 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99c338-51c7-4751-9a8d-71adb2988586 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:28.441163 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad99c338-51c7-4751-9a8d-71adb2988586 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:28.445466 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b48e61-5ce2-4d26-83d8-705012bb5dc4 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:28.448614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:28.452389 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276c725-1b35-4986-8192-5e456259bdc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:28.452978 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276c725-1b35-4986-8192-5e456259bdc7 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:28.453254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276c725-1b35-4986-8192-5e456259bdc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:28.453525 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a276c725-1b35-4986-8192-5e456259bdc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:28.454191 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276c725-1b35-4986-8192-5e456259bdc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:28.455795 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a276c725-1b35-4986-8192-5e456259bdc7 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:28.466182 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1233/2490] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:12:28.470203 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276c725-1b35-4986-8192-5e456259bdc7 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:28.479279 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a276c725-1b35-4986-8192-5e456259bdc7 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:28.484256 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10743260-7289-4e17-ad20-33d1246836fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:28.484854 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10743260-7289-4e17-ad20-33d1246836fe admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:28.485132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10743260-7289-4e17-ad20-33d1246836fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:28.489577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10743260-7289-4e17-ad20-33d1246836fe admin admin] PATH_INFO: `/v3/projects/d708da2024e149a4b3666905c747eaf6/users/1bd62444c4c24fa79bfadc17ec40775b/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:28.500306 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10743260-7289-4e17-ad20-33d1246836fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d708da2024e149a4b3666905c747eaf6, user_id=1bd62444c4c24fa79bfadc17ec40775b, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:28.503030 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10743260-7289-4e17-ad20-33d1246836fe admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:28.513858 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1258/2491] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:12:28 2022] POST /identity/v3/users => generated 303 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:12:28.517743 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99c338-51c7-4751-9a8d-71adb2988586 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:28.527894 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad99c338-51c7-4751-9a8d-71adb2988586 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:28.532524 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f207f4-4f3a-4800-9509-a78fa4c4c0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:28.533097 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f207f4-4f3a-4800-9509-a78fa4c4c0e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:28.533378 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f207f4-4f3a-4800-9509-a78fa4c4c0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:28.533652 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f207f4-4f3a-4800-9509-a78fa4c4c0e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:28.534316 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f207f4-4f3a-4800-9509-a78fa4c4c0e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:28.535900 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f207f4-4f3a-4800-9509-a78fa4c4c0e1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:28.548898 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1259/2492] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:12:28.551460 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f207f4-4f3a-4800-9509-a78fa4c4c0e1 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:28.561668 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f207f4-4f3a-4800-9509-a78fa4c4c0e1 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:28.566232 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da20ea5-c535-4269-8966-3e11f092e804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:28.566785 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da20ea5-c535-4269-8966-3e11f092e804 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:28.567071 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da20ea5-c535-4269-8966-3e11f092e804 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:28.567342 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da20ea5-c535-4269-8966-3e11f092e804 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:28.567958 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da20ea5-c535-4269-8966-3e11f092e804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:28.569489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da20ea5-c535-4269-8966-3e11f092e804 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:28.579751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1260/2493] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:12:28.586034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da20ea5-c535-4269-8966-3e11f092e804 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:28.595281 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da20ea5-c535-4269-8966-3e11f092e804 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:28.599973 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bdc43c-326a-45f8-b2e7-38eb15481057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:28.600634 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdc43c-326a-45f8-b2e7-38eb15481057 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:28.600911 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdc43c-326a-45f8-b2e7-38eb15481057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:28.601175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bdc43c-326a-45f8-b2e7-38eb15481057 admin admin] PATH_INFO: `/v3/projects/04f207de0bd8406aaf9bc0f6085eb730/users/849ec1757d40415a832b818f6bf90d97/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:28.608488 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1234/2494] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:12:28 2022] PUT /identity/v3/projects/d708da2024e149a4b3666905c747eaf6/users/1bd62444c4c24fa79bfadc17ec40775b/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:12:28.612424 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10743260-7289-4e17-ad20-33d1246836fe admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:28.616388 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bdc43c-326a-45f8-b2e7-38eb15481057 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04f207de0bd8406aaf9bc0f6085eb730, user_id=849ec1757d40415a832b818f6bf90d97, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:28.619111 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bdc43c-326a-45f8-b2e7-38eb15481057 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:28.674240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10743260-7289-4e17-ad20-33d1246836fe admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:28.678823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446606e-dbae-4376-a5c6-119e248def96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:28.679427 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446606e-dbae-4376-a5c6-119e248def96 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:28.679736 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446606e-dbae-4376-a5c6-119e248def96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:28.680013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1446606e-dbae-4376-a5c6-119e248def96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:28.680645 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446606e-dbae-4376-a5c6-119e248def96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:28.682291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1446606e-dbae-4376-a5c6-119e248def96 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:28.691930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1235/2495] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:12:28.696247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446606e-dbae-4376-a5c6-119e248def96 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:28.705251 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1261/2496] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:12:28 2022] PUT /identity/v3/projects/04f207de0bd8406aaf9bc0f6085eb730/users/849ec1757d40415a832b818f6bf90d97/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:12:28.714890 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1446606e-dbae-4376-a5c6-119e248def96 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:28.717161 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498ea85-a83b-4537-95ce-6ea9e03bb56d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:28.717730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498ea85-a83b-4537-95ce-6ea9e03bb56d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:28.717920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2498ea85-a83b-4537-95ce-6ea9e03bb56d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:28.747236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2498ea85-a83b-4537-95ce-6ea9e03bb56d None None] MFA Rules not processed for user `849ec1757d40415a832b818f6bf90d97`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:28.748706 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2498ea85-a83b-4537-95ce-6ea9e03bb56d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:28.765957 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b31c60-7e23-4e8f-a44d-2649641b6649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:28.766619 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b31c60-7e23-4e8f-a44d-2649641b6649 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:28.766907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b31c60-7e23-4e8f-a44d-2649641b6649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:28.767214 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b31c60-7e23-4e8f-a44d-2649641b6649 admin admin] PATH_INFO: `/v3/projects/d708da2024e149a4b3666905c747eaf6/users/1bd62444c4c24fa79bfadc17ec40775b/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:28.769091 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b31c60-7e23-4e8f-a44d-2649641b6649 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d708da2024e149a4b3666905c747eaf6, user_id=1bd62444c4c24fa79bfadc17ec40775b, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:28.771771 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b31c60-7e23-4e8f-a44d-2649641b6649 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:28.783478 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1236/2497] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:12:28 2022] PUT /identity/v3/projects/d708da2024e149a4b3666905c747eaf6/users/1bd62444c4c24fa79bfadc17ec40775b/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:12:28.795556 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e0ab5-faee-4502-ac29-a4b48ef01fcb None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:28.795886 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e0ab5-faee-4502-ac29-a4b48ef01fcb None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:28.799121 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9e0ab5-faee-4502-ac29-a4b48ef01fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:28.799267 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:28.815088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1262/2498] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:28 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:28.819457 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498ea85-a83b-4537-95ce-6ea9e03bb56d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:28.825836 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-2e9e0ab5-faee-4502-ac29-a4b48ef01fcb None None] MFA Rules not processed for user `1bd62444c4c24fa79bfadc17ec40775b`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:28.827099 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2e9e0ab5-faee-4502-ac29-a4b48ef01fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:28.830241 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2498ea85-a83b-4537-95ce-6ea9e03bb56d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:28.831096 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:28.902672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253875a0-dd8e-4b55-be3f-929a7a0a1f8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:28.903605 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253875a0-dd8e-4b55-be3f-929a7a0a1f8d admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:28.904623 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253875a0-dd8e-4b55-be3f-929a7a0a1f8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:28.904990 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253875a0-dd8e-4b55-be3f-929a7a0a1f8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:28.905769 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253875a0-dd8e-4b55-be3f-929a7a0a1f8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:28.907752 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253875a0-dd8e-4b55-be3f-929a7a0a1f8d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:28.912696 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1237/2499] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:12:28.931248 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e0ab5-faee-4502-ac29-a4b48ef01fcb None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:28.935034 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2e9e0ab5-faee-4502-ac29-a4b48ef01fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:28.998626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1263/2500] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:12:28 2022] POST /identity/v3/projects => generated 405 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:12:28.999653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253875a0-dd8e-4b55-be3f-929a7a0a1f8d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:29.004363 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9e0ab5-faee-4502-ac29-a4b48ef01fcb None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:29.059501 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e5b6f-8e54-47f4-99ec-ace02a470420 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:29.059832 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e5b6f-8e54-47f4-99ec-ace02a470420 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:29.060138 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e5b6f-8e54-47f4-99ec-ace02a470420 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:29.060470 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62e5b6f-8e54-47f4-99ec-ace02a470420 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:29.066470 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253875a0-dd8e-4b55-be3f-929a7a0a1f8d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:29.072249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598835d-bcb7-41d5-b094-1fe2ec765362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:29.072859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598835d-bcb7-41d5-b094-1fe2ec765362 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:29.073135 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598835d-bcb7-41d5-b094-1fe2ec765362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:29.073404 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8598835d-bcb7-41d5-b094-1fe2ec765362 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:29.074662 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598835d-bcb7-41d5-b094-1fe2ec765362 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:29.076634 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8598835d-bcb7-41d5-b094-1fe2ec765362 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:29.123660 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e5b6f-8e54-47f4-99ec-ace02a470420 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:29.125090 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62e5b6f-8e54-47f4-99ec-ace02a470420 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:29.134773 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1238/2501] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:12:29.194760 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1264/2502] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:12:28 2022] POST /identity/v3/users => generated 309 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:12:29.199591 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e5b6f-8e54-47f4-99ec-ace02a470420 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:29.211636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62e5b6f-8e54-47f4-99ec-ace02a470420 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:29.218872 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a836e26-1635-4bb5-ae64-88f8852cf598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:29.219588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a836e26-1635-4bb5-ae64-88f8852cf598 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:29.219926 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a836e26-1635-4bb5-ae64-88f8852cf598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:29.220258 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a836e26-1635-4bb5-ae64-88f8852cf598 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:29.221095 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a836e26-1635-4bb5-ae64-88f8852cf598 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:29.222823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a836e26-1635-4bb5-ae64-88f8852cf598 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:29.224397 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:29.234270 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1239/2503] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:12:29.238555 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598835d-bcb7-41d5-b094-1fe2ec765362 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:29.248458 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8598835d-bcb7-41d5-b094-1fe2ec765362 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:29.253005 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1793ed3-c19b-4328-ae0b-13fc4f08a8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:29.253643 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1793ed3-c19b-4328-ae0b-13fc4f08a8a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:29.253959 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1793ed3-c19b-4328-ae0b-13fc4f08a8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:29.254231 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1793ed3-c19b-4328-ae0b-13fc4f08a8a7 admin admin] PATH_INFO: `/v3/projects/4c408bfd3ef54c39b25aac4d2c93814f/users/9e6b82d91e2a4f91806df6437b49b12e/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:29.270069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1793ed3-c19b-4328-ae0b-13fc4f08a8a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c408bfd3ef54c39b25aac4d2c93814f, user_id=9e6b82d91e2a4f91806df6437b49b12e, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:29.273130 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1793ed3-c19b-4328-ae0b-13fc4f08a8a7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:29.349263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:29.354142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1265/2504] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:12:29 2022] PUT /identity/v3/projects/4c408bfd3ef54c39b25aac4d2c93814f/users/9e6b82d91e2a4f91806df6437b49b12e/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:12:29.359900 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a836e26-1635-4bb5-ae64-88f8852cf598 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:29.370005 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a836e26-1635-4bb5-ae64-88f8852cf598 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:29.428475 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74449055-7c80-4b00-b9a8-20eed8dd92df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:29.429082 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74449055-7c80-4b00-b9a8-20eed8dd92df admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:29.429357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74449055-7c80-4b00-b9a8-20eed8dd92df admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:29.429625 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74449055-7c80-4b00-b9a8-20eed8dd92df admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:29.430288 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74449055-7c80-4b00-b9a8-20eed8dd92df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:29.431868 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74449055-7c80-4b00-b9a8-20eed8dd92df admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:29.442001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1240/2505] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:29 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:12:29.446231 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1793ed3-c19b-4328-ae0b-13fc4f08a8a7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:29.456841 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1793ed3-c19b-4328-ae0b-13fc4f08a8a7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:29.461627 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb6042-64b4-4d7d-83f4-ecc387ffdad9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:29.462289 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb6042-64b4-4d7d-83f4-ecc387ffdad9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:29.462568 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb6042-64b4-4d7d-83f4-ecc387ffdad9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:29.462833 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cb6042-64b4-4d7d-83f4-ecc387ffdad9 admin admin] PATH_INFO: `/v3/projects/4c408bfd3ef54c39b25aac4d2c93814f/users/9e6b82d91e2a4f91806df6437b49b12e/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:29.464871 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb6042-64b4-4d7d-83f4-ecc387ffdad9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c408bfd3ef54c39b25aac4d2c93814f, user_id=9e6b82d91e2a4f91806df6437b49b12e, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:29.467525 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cb6042-64b4-4d7d-83f4-ecc387ffdad9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:29.477503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1266/2506] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:12:29 2022] PUT /identity/v3/projects/4c408bfd3ef54c39b25aac4d2c93814f/users/9e6b82d91e2a4f91806df6437b49b12e/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:29.489011 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba8c29-47b6-472b-9fdf-3bf34601ecf8 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:29.489301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba8c29-47b6-472b-9fdf-3bf34601ecf8 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:29.489576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ba8c29-47b6-472b-9fdf-3bf34601ecf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:29.518391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-e6ba8c29-47b6-472b-9fdf-3bf34601ecf8 None None] MFA Rules not processed for user `9e6b82d91e2a4f91806df6437b49b12e`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:29.519591 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e6ba8c29-47b6-472b-9fdf-3bf34601ecf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:29.587157 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1241/2507] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:29 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:29.597852 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb6042-64b4-4d7d-83f4-ecc387ffdad9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:29.655280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cb6042-64b4-4d7d-83f4-ecc387ffdad9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:29.658848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07add4fd-a493-4ced-81d7-cb14c5c5b2c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:29.659439 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07add4fd-a493-4ced-81d7-cb14c5c5b2c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:29.659715 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07add4fd-a493-4ced-81d7-cb14c5c5b2c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:29.659985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07add4fd-a493-4ced-81d7-cb14c5c5b2c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:29.668808 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07add4fd-a493-4ced-81d7-cb14c5c5b2c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:29.670257 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07add4fd-a493-4ced-81d7-cb14c5c5b2c9 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:29.680151 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1267/2508] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:29 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:12:29.817313 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba8c29-47b6-472b-9fdf-3bf34601ecf8 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:29.881604 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ba8c29-47b6-472b-9fdf-3bf34601ecf8 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:29.886383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24449e-bfd6-4af8-a445-d2a762ea20c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:29.887016 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24449e-bfd6-4af8-a445-d2a762ea20c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:29.887294 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24449e-bfd6-4af8-a445-d2a762ea20c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:29.887565 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc24449e-bfd6-4af8-a445-d2a762ea20c6 admin admin] PATH_INFO: `/v3/users/849ec1757d40415a832b818f6bf90d97` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:29.888750 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24449e-bfd6-4af8-a445-d2a762ea20c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=849ec1757d40415a832b818f6bf90d97)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:29.890752 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc24449e-bfd6-4af8-a445-d2a762ea20c6 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:29.912604 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:30.116274 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-bc24449e-bfd6-4af8-a445-d2a762ea20c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '849ec1757d40415a832b818f6bf90d97'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:30.216777 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-bc24449e-bfd6-4af8-a445-d2a762ea20c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '849ec1757d40415a832b818f6bf90d97'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:30.230072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-bc24449e-bfd6-4af8-a445-d2a762ea20c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '849ec1757d40415a832b818f6bf90d97'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:30.232906 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-bc24449e-bfd6-4af8-a445-d2a762ea20c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '849ec1757d40415a832b818f6bf90d97'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:30.242062 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-bc24449e-bfd6-4af8-a445-d2a762ea20c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '849ec1757d40415a832b818f6bf90d97'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:30.250310 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1242/2509] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:12:29 2022] DELETE /identity/v3/users/849ec1757d40415a832b818f6bf90d97 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:30.255489 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2fdb7-1d99-4b6f-82b9-ff8fd372af73 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:30.255933 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2fdb7-1d99-4b6f-82b9-ff8fd372af73 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:30.256093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e2fdb7-1d99-4b6f-82b9-ff8fd372af73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:30.257365 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24449e-bfd6-4af8-a445-d2a762ea20c6 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:30.258786 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bc24449e-bfd6-4af8-a445-d2a762ea20c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:30.275764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-c3e2fdb7-1d99-4b6f-82b9-ff8fd372af73 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:30.277501 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c3e2fdb7-1d99-4b6f-82b9-ff8fd372af73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:30.334043 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc24449e-bfd6-4af8-a445-d2a762ea20c6 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:30.345668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a831dc-8e87-49fe-992c-26c154319c88 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd62444c4c24fa79bfadc17ec40775b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd708da2024e149a4b3666905c747eaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:30.347717 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a831dc-8e87-49fe-992c-26c154319c88 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:30.347717 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a831dc-8e87-49fe-992c-26c154319c88 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:30.347717 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a831dc-8e87-49fe-992c-26c154319c88 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:30.348096 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a831dc-8e87-49fe-992c-26c154319c88 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:12:30.348206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a831dc-8e87-49fe-992c-26c154319c88 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:30.349841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a831dc-8e87-49fe-992c-26c154319c88 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:30.357321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1268/2510] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:30.360943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2fdb7-1d99-4b6f-82b9-ff8fd372af73 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:30.362595 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c3e2fdb7-1d99-4b6f-82b9-ff8fd372af73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:30.363708 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1243/2511] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:12:30.367267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a831dc-8e87-49fe-992c-26c154319c88 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:30.368855 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-65a831dc-8e87-49fe-992c-26c154319c88 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:30.420225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e2fdb7-1d99-4b6f-82b9-ff8fd372af73 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:30.423781 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ce3bb-459f-479d-bba8-745f120b21fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:30.424384 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ce3bb-459f-479d-bba8-745f120b21fa service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:30.424657 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ce3bb-459f-479d-bba8-745f120b21fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:30.424922 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480ce3bb-459f-479d-bba8-745f120b21fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:30.426619 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-480ce3bb-459f-479d-bba8-745f120b21fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:30.428935 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a831dc-8e87-49fe-992c-26c154319c88 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:30.432600 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e5307-94b9-40b0-b29e-2bae9aa7fc1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:30.433225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e5307-94b9-40b0-b29e-2bae9aa7fc1f service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:30.433511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e5307-94b9-40b0-b29e-2bae9aa7fc1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:30.433820 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903e5307-94b9-40b0-b29e-2bae9aa7fc1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:30.438207 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ce3bb-459f-479d-bba8-745f120b21fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:30.439620 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480ce3bb-459f-479d-bba8-745f120b21fa service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:30.443005 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e5307-94b9-40b0-b29e-2bae9aa7fc1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:30.444429 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903e5307-94b9-40b0-b29e-2bae9aa7fc1f service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:30.449545 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1269/2512] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:12:30.450354 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ce3bb-459f-479d-bba8-745f120b21fa service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:30.455803 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1244/2513] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:12:30.460485 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480ce3bb-459f-479d-bba8-745f120b21fa service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:30.465660 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487ae20-33e7-479d-a48a-ea20e0176556 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd62444c4c24fa79bfadc17ec40775b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd708da2024e149a4b3666905c747eaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:30.466309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487ae20-33e7-479d-a48a-ea20e0176556 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:30.466589 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487ae20-33e7-479d-a48a-ea20e0176556 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:30.466855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487ae20-33e7-479d-a48a-ea20e0176556 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:30.467485 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487ae20-33e7-479d-a48a-ea20e0176556 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:30.469351 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487ae20-33e7-479d-a48a-ea20e0176556 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:30.561949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1270/2514] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:12:30 2022] POST /identity/v3/projects => generated 355 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:12:30.566282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e5307-94b9-40b0-b29e-2bae9aa7fc1f service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:30.578031 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903e5307-94b9-40b0-b29e-2bae9aa7fc1f service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:30.610259 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:30.636197 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74775c3f-3468-4ed0-aeee-311e17e9fff0 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd62444c4c24fa79bfadc17ec40775b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd708da2024e149a4b3666905c747eaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:30.637316 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74775c3f-3468-4ed0-aeee-311e17e9fff0 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:30.637603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74775c3f-3468-4ed0-aeee-311e17e9fff0 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:30.637906 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74775c3f-3468-4ed0-aeee-311e17e9fff0 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:30.638550 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74775c3f-3468-4ed0-aeee-311e17e9fff0 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:12:30.638857 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74775c3f-3468-4ed0-aeee-311e17e9fff0 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:30.640453 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74775c3f-3468-4ed0-aeee-311e17e9fff0 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:30.652796 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1245/2515] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:12:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:12:30.690935 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487ae20-33e7-479d-a48a-ea20e0176556 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:30.702128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487ae20-33e7-479d-a48a-ea20e0176556 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:30.706679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9f924-7a17-4009-835e-ee44972c658a tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1bd62444c4c24fa79bfadc17ec40775b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd708da2024e149a4b3666905c747eaf6', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:30.707302 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9f924-7a17-4009-835e-ee44972c658a tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:30.707581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9f924-7a17-4009-835e-ee44972c658a tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:30.707851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e9f924-7a17-4009-835e-ee44972c658a tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] PATH_INFO: `/v3/projects/b7b3820989af42dba8ceef930f241ce9` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:30.709348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9f924-7a17-4009-835e-ee44972c658a tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] RBAC: Authorizing `identity:delete_project(project_id=b7b3820989af42dba8ceef930f241ce9)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:30.711328 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e9f924-7a17-4009-835e-ee44972c658a tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:30.718487 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:30.877537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-27e9f924-7a17-4009-835e-ee44972c658a tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7b3820989af42dba8ceef930f241ce9', 'request_id': 'req-27e9f924-7a17-4009-835e-ee44972c658a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:30.951173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-27e9f924-7a17-4009-835e-ee44972c658a tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7b3820989af42dba8ceef930f241ce9', 'request_id': 'req-27e9f924-7a17-4009-835e-ee44972c658a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:30.958440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-27e9f924-7a17-4009-835e-ee44972c658a tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7b3820989af42dba8ceef930f241ce9', 'request_id': 'req-27e9f924-7a17-4009-835e-ee44972c658a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:30.970169 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-27e9f924-7a17-4009-835e-ee44972c658a tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] The token cache is being invalidate because project b7b3820989af42dba8ceef930f241ce9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:12:30.970538 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-27e9f924-7a17-4009-835e-ee44972c658a tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:30.971205 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-27e9f924-7a17-4009-835e-ee44972c658a tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:30.972809 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1271/2516] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:12:30 2022] DELETE /identity/v3/projects/b7b3820989af42dba8ceef930f241ce9 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:31.235180 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74775c3f-3468-4ed0-aeee-311e17e9fff0 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:31.237647 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-74775c3f-3468-4ed0-aeee-311e17e9fff0 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:31.317764 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74775c3f-3468-4ed0-aeee-311e17e9fff0 tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:31.376195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60228d3-9916-4e13-8157-ac80cfe21834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:31.377207 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60228d3-9916-4e13-8157-ac80cfe21834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:31.377540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60228d3-9916-4e13-8157-ac80cfe21834 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:31.377847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60228d3-9916-4e13-8157-ac80cfe21834 admin admin] PATH_INFO: `/v3/projects/04f207de0bd8406aaf9bc0f6085eb730` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:31.378992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60228d3-9916-4e13-8157-ac80cfe21834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=04f207de0bd8406aaf9bc0f6085eb730)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:31.380920 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60228d3-9916-4e13-8157-ac80cfe21834 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:31.498080 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c60228d3-9916-4e13-8157-ac80cfe21834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04f207de0bd8406aaf9bc0f6085eb730', 'request_id': 'req-c60228d3-9916-4e13-8157-ac80cfe21834'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:31.503523 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c60228d3-9916-4e13-8157-ac80cfe21834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04f207de0bd8406aaf9bc0f6085eb730', 'request_id': 'req-c60228d3-9916-4e13-8157-ac80cfe21834'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:31.509913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c60228d3-9916-4e13-8157-ac80cfe21834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04f207de0bd8406aaf9bc0f6085eb730', 'request_id': 'req-c60228d3-9916-4e13-8157-ac80cfe21834'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:31.572206 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9f924-7a17-4009-835e-ee44972c658a tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:31.573705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-27e9f924-7a17-4009-835e-ee44972c658a tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:31.585808 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c60228d3-9916-4e13-8157-ac80cfe21834 admin admin] The token cache is being invalidate because project 04f207de0bd8406aaf9bc0f6085eb730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:12:31.586200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c60228d3-9916-4e13-8157-ac80cfe21834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:31.586902 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c60228d3-9916-4e13-8157-ac80cfe21834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:31.587778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e9f924-7a17-4009-835e-ee44972c658a tempest-VolumeQuotaClassesTest-150137876 tempest-VolumeQuotaClassesTest-150137876-project-admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:31.588843 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1246/2517] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:12:31 2022] DELETE /identity/v3/projects/04f207de0bd8406aaf9bc0f6085eb730 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:31.592504 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60228d3-9916-4e13-8157-ac80cfe21834 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:31.594937 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-c60228d3-9916-4e13-8157-ac80cfe21834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:31.600422 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:31.664702 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ab2f06-3ed0-41ff-aa19-17172efac88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:31.664970 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab2f06-3ed0-41ff-aa19-17172efac88a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:31.665324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab2f06-3ed0-41ff-aa19-17172efac88a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:31.665463 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ab2f06-3ed0-41ff-aa19-17172efac88a admin admin] PATH_INFO: `/v3/users/1396ccf1f2c74288b2ab11f04ca64503` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:31.666906 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab2f06-3ed0-41ff-aa19-17172efac88a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1396ccf1f2c74288b2ab11f04ca64503)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:31.669419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ab2f06-3ed0-41ff-aa19-17172efac88a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:31.688621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60228d3-9916-4e13-8157-ac80cfe21834 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:31.699537 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13a7b4-28bc-4789-b2ee-8ba686712745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:31.700306 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13a7b4-28bc-4789-b2ee-8ba686712745 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:31.707704 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13a7b4-28bc-4789-b2ee-8ba686712745 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:31.707704 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab13a7b4-28bc-4789-b2ee-8ba686712745 admin admin] PATH_INFO: `/v3/users/9e6b82d91e2a4f91806df6437b49b12e` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:31.707704 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13a7b4-28bc-4789-b2ee-8ba686712745 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e6b82d91e2a4f91806df6437b49b12e)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:31.707704 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab13a7b4-28bc-4789-b2ee-8ba686712745 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:31.917082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-72ab2f06-3ed0-41ff-aa19-17172efac88a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1396ccf1f2c74288b2ab11f04ca64503'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:31.930336 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ab13a7b4-28bc-4789-b2ee-8ba686712745 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e6b82d91e2a4f91806df6437b49b12e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:31.999591 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-72ab2f06-3ed0-41ff-aa19-17172efac88a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1396ccf1f2c74288b2ab11f04ca64503'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:32.013189 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-72ab2f06-3ed0-41ff-aa19-17172efac88a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1396ccf1f2c74288b2ab11f04ca64503'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:32.013885 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-72ab2f06-3ed0-41ff-aa19-17172efac88a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1396ccf1f2c74288b2ab11f04ca64503'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:32.021163 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-72ab2f06-3ed0-41ff-aa19-17172efac88a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1396ccf1f2c74288b2ab11f04ca64503'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:32.027841 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1272/2518] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:12:31 2022] DELETE /identity/v3/users/1396ccf1f2c74288b2ab11f04ca64503 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:12:32.032344 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b09f60-a806-45d2-9771-b1460f3feb23 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:32.037882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b09f60-a806-45d2-9771-b1460f3feb23 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:32.037882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b09f60-a806-45d2-9771-b1460f3feb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:32.051846 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f4b09f60-a806-45d2-9771-b1460f3feb23 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:32.053053 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f4b09f60-a806-45d2-9771-b1460f3feb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:32.056773 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ab13a7b4-28bc-4789-b2ee-8ba686712745 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e6b82d91e2a4f91806df6437b49b12e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:32.061491 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:32.075253 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ab13a7b4-28bc-4789-b2ee-8ba686712745 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e6b82d91e2a4f91806df6437b49b12e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:32.076080 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ab13a7b4-28bc-4789-b2ee-8ba686712745 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e6b82d91e2a4f91806df6437b49b12e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:32.084195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-ab13a7b4-28bc-4789-b2ee-8ba686712745 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e6b82d91e2a4f91806df6437b49b12e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:32.093056 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1247/2519] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:12:31 2022] DELETE /identity/v3/users/9e6b82d91e2a4f91806df6437b49b12e => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:32.119914 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1273/2520] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:12:32.128273 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13a7b4-28bc-4789-b2ee-8ba686712745 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:32.130368 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ab13a7b4-28bc-4789-b2ee-8ba686712745 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:32.227195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab13a7b4-28bc-4789-b2ee-8ba686712745 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:32.234906 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6a22e2-f6e0-4e6f-9b82-588d1e24e9ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:32.235644 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a22e2-f6e0-4e6f-9b82-588d1e24e9ef service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:32.236217 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a22e2-f6e0-4e6f-9b82-588d1e24e9ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:32.237741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6a22e2-f6e0-4e6f-9b82-588d1e24e9ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:32.281651 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:32.310382 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a22e2-f6e0-4e6f-9b82-588d1e24e9ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:32.311841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6a22e2-f6e0-4e6f-9b82-588d1e24e9ef service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:32.327210 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1248/2521] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:12:32.613751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b09f60-a806-45d2-9771-b1460f3feb23 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:32.615334 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f4b09f60-a806-45d2-9771-b1460f3feb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:32.628191 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b09f60-a806-45d2-9771-b1460f3feb23 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:32.633504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2948df57-6904-49fb-b979-c0b6b4c17543 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:32.634184 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948df57-6904-49fb-b979-c0b6b4c17543 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:32.634460 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948df57-6904-49fb-b979-c0b6b4c17543 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:32.635451 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2948df57-6904-49fb-b979-c0b6b4c17543 admin admin] PATH_INFO: `/v3/projects/4c408bfd3ef54c39b25aac4d2c93814f` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:32.635896 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2948df57-6904-49fb-b979-c0b6b4c17543 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c408bfd3ef54c39b25aac4d2c93814f)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:32.638545 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2948df57-6904-49fb-b979-c0b6b4c17543 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:32.751992 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2948df57-6904-49fb-b979-c0b6b4c17543 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c408bfd3ef54c39b25aac4d2c93814f', 'request_id': 'req-2948df57-6904-49fb-b979-c0b6b4c17543'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:32.839269 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2948df57-6904-49fb-b979-c0b6b4c17543 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c408bfd3ef54c39b25aac4d2c93814f', 'request_id': 'req-2948df57-6904-49fb-b979-c0b6b4c17543'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:32.845781 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2948df57-6904-49fb-b979-c0b6b4c17543 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c408bfd3ef54c39b25aac4d2c93814f', 'request_id': 'req-2948df57-6904-49fb-b979-c0b6b4c17543'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:32.859011 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2948df57-6904-49fb-b979-c0b6b4c17543 admin admin] The token cache is being invalidate because project 4c408bfd3ef54c39b25aac4d2c93814f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:12:32.859309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2948df57-6904-49fb-b979-c0b6b4c17543 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:32.860028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2948df57-6904-49fb-b979-c0b6b4c17543 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:32.861705 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1274/2522] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:12:32 2022] DELETE /identity/v3/projects/4c408bfd3ef54c39b25aac4d2c93814f => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:32.866714 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b03b3e-0c77-47fc-8e07-9e41d8213c8e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:32.867098 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b03b3e-0c77-47fc-8e07-9e41d8213c8e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:32.867380 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b03b3e-0c77-47fc-8e07-9e41d8213c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:32.890579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-87b03b3e-0c77-47fc-8e07-9e41d8213c8e None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:32.892051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-87b03b3e-0c77-47fc-8e07-9e41d8213c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:32.954007 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1249/2523] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:12:32.962037 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d0462-def1-45df-b430-a04a2efdcd29 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:32.962321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d0462-def1-45df-b430-a04a2efdcd29 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:32.962592 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6d0462-def1-45df-b430-a04a2efdcd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:32.972355 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b03b3e-0c77-47fc-8e07-9e41d8213c8e None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:32.973752 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-87b03b3e-0c77-47fc-8e07-9e41d8213c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:32.984010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-bf6d0462-def1-45df-b430-a04a2efdcd29 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:32.985311 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bf6d0462-def1-45df-b430-a04a2efdcd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:32.986493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b03b3e-0c77-47fc-8e07-9e41d8213c8e None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:32.994549 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e35f3-2aec-4679-a852-1aa05940e435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:32.994549 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e35f3-2aec-4679-a852-1aa05940e435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:32.994549 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e35f3-2aec-4679-a852-1aa05940e435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:32.994549 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411e35f3-2aec-4679-a852-1aa05940e435 admin admin] PATH_INFO: `/v3/projects/5d76ad7921004d719c55d9fff2ed8551` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:32.998809 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1275/2524] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:33.000769 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e35f3-2aec-4679-a852-1aa05940e435 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5d76ad7921004d719c55d9fff2ed8551)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:33.002793 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411e35f3-2aec-4679-a852-1aa05940e435 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:33.006789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d0462-def1-45df-b430-a04a2efdcd29 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:33.020458 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6d0462-def1-45df-b430-a04a2efdcd29 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:33.033053 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecd506-34a0-4e42-aeda-77070d98aac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:33.033053 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecd506-34a0-4e42-aeda-77070d98aac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:33.033053 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecd506-34a0-4e42-aeda-77070d98aac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:33.033053 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ecd506-34a0-4e42-aeda-77070d98aac9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:33.033556 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ecd506-34a0-4e42-aeda-77070d98aac9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:12:33.034053 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ecd506-34a0-4e42-aeda-77070d98aac9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:33.035712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ecd506-34a0-4e42-aeda-77070d98aac9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:33.049119 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1276/2525] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:12:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:12:33.053609 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecd506-34a0-4e42-aeda-77070d98aac9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:33.064491 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ecd506-34a0-4e42-aeda-77070d98aac9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:33.069137 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a141c-fbcc-430e-8d9c-eff72e76d894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:33.069761 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a141c-fbcc-430e-8d9c-eff72e76d894 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:33.070073 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a141c-fbcc-430e-8d9c-eff72e76d894 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:33.070346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2a141c-fbcc-430e-8d9c-eff72e76d894 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:33.070973 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a141c-fbcc-430e-8d9c-eff72e76d894 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:33.072872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2a141c-fbcc-430e-8d9c-eff72e76d894 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:33.113286 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-411e35f3-2aec-4679-a852-1aa05940e435 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5d76ad7921004d719c55d9fff2ed8551', 'request_id': 'req-411e35f3-2aec-4679-a852-1aa05940e435'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:33.119471 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-411e35f3-2aec-4679-a852-1aa05940e435 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5d76ad7921004d719c55d9fff2ed8551', 'request_id': 'req-411e35f3-2aec-4679-a852-1aa05940e435'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:33.127154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-411e35f3-2aec-4679-a852-1aa05940e435 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5d76ad7921004d719c55d9fff2ed8551', 'request_id': 'req-411e35f3-2aec-4679-a852-1aa05940e435'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:33.173267 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1277/2526] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:12:33 2022] POST /identity/v3/projects => generated 365 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:12:33.177175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a141c-fbcc-430e-8d9c-eff72e76d894 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:33.216236 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-411e35f3-2aec-4679-a852-1aa05940e435 admin admin] The token cache is being invalidate because project 5d76ad7921004d719c55d9fff2ed8551 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:12:33.218795 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-411e35f3-2aec-4679-a852-1aa05940e435 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:33.218795 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-411e35f3-2aec-4679-a852-1aa05940e435 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:33.219840 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1250/2527] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:12:32 2022] DELETE /identity/v3/projects/5d76ad7921004d719c55d9fff2ed8551 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:33.223748 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e35f3-2aec-4679-a852-1aa05940e435 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:33.225152 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-411e35f3-2aec-4679-a852-1aa05940e435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:33.260046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:33.265204 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2a141c-fbcc-430e-8d9c-eff72e76d894 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:33.270256 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c62ae8-f6ab-4c55-a722-6e3ebdd6ace4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:33.270887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c62ae8-f6ab-4c55-a722-6e3ebdd6ace4 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:33.271169 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c62ae8-f6ab-4c55-a722-6e3ebdd6ace4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:33.271444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c62ae8-f6ab-4c55-a722-6e3ebdd6ace4 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:33.272081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c62ae8-f6ab-4c55-a722-6e3ebdd6ace4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:33.274115 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c62ae8-f6ab-4c55-a722-6e3ebdd6ace4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:33.291765 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:33.295945 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411e35f3-2aec-4679-a852-1aa05940e435 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:33.300667 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46a81f-4aea-4837-a086-f2321dbcd20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:33.301225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46a81f-4aea-4837-a086-f2321dbcd20a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:33.301503 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46a81f-4aea-4837-a086-f2321dbcd20a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:33.301802 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46a81f-4aea-4837-a086-f2321dbcd20a admin admin] PATH_INFO: `/v3/users/1bd62444c4c24fa79bfadc17ec40775b` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:33.302921 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46a81f-4aea-4837-a086-f2321dbcd20a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bd62444c4c24fa79bfadc17ec40775b)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:33.304949 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46a81f-4aea-4837-a086-f2321dbcd20a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:33.344443 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1278/2528] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:12:33 2022] POST /identity/v3/users => generated 283 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:12:33.348561 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c62ae8-f6ab-4c55-a722-6e3ebdd6ace4 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:33.350443 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-17c62ae8-f6ab-4c55-a722-6e3ebdd6ace4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:33.363172 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c62ae8-f6ab-4c55-a722-6e3ebdd6ace4 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:33.367792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb29794-cb05-43ae-ba2a-c6ae8ffc91fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:33.368513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb29794-cb05-43ae-ba2a-c6ae8ffc91fa admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:33.368794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb29794-cb05-43ae-ba2a-c6ae8ffc91fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:33.369065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb29794-cb05-43ae-ba2a-c6ae8ffc91fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:33.369726 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb29794-cb05-43ae-ba2a-c6ae8ffc91fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:33.371385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb29794-cb05-43ae-ba2a-c6ae8ffc91fa admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:33.381583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1279/2529] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:12:33.385266 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb29794-cb05-43ae-ba2a-c6ae8ffc91fa admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:33.395107 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb29794-cb05-43ae-ba2a-c6ae8ffc91fa admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:33.399804 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d050d-00c7-430a-b88b-c6111315d0d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:33.400400 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d050d-00c7-430a-b88b-c6111315d0d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:33.400685 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d050d-00c7-430a-b88b-c6111315d0d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:33.400953 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d050d-00c7-430a-b88b-c6111315d0d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:33.401588 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d050d-00c7-430a-b88b-c6111315d0d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:33.403765 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d050d-00c7-430a-b88b-c6111315d0d7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:33.418638 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1280/2530] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:12:33.422151 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d050d-00c7-430a-b88b-c6111315d0d7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:33.432377 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d050d-00c7-430a-b88b-c6111315d0d7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:33.437144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429eaf95-5221-48bb-9284-bd65c934eb68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:33.438073 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429eaf95-5221-48bb-9284-bd65c934eb68 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:33.438371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429eaf95-5221-48bb-9284-bd65c934eb68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:33.438628 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429eaf95-5221-48bb-9284-bd65c934eb68 admin admin] PATH_INFO: `/v3/projects/4fa66d36b4f549f98916f300b561eade/users/61c72656816b4d27a17746453d195b19/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:33.455398 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4c46a81f-4aea-4837-a086-f2321dbcd20a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bd62444c4c24fa79bfadc17ec40775b'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:33.455638 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429eaf95-5221-48bb-9284-bd65c934eb68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4fa66d36b4f549f98916f300b561eade, user_id=61c72656816b4d27a17746453d195b19, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:33.458971 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429eaf95-5221-48bb-9284-bd65c934eb68 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:33.530572 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4c46a81f-4aea-4837-a086-f2321dbcd20a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bd62444c4c24fa79bfadc17ec40775b'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:33.540468 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1281/2531] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:12:33 2022] PUT /identity/v3/projects/4fa66d36b4f549f98916f300b561eade/users/61c72656816b4d27a17746453d195b19/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:33.551765 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374bf33-3ea0-4dc4-bf40-d1a78b524e5f None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:33.552025 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374bf33-3ea0-4dc4-bf40-d1a78b524e5f None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:33.552297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374bf33-3ea0-4dc4-bf40-d1a78b524e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:33.559479 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4c46a81f-4aea-4837-a086-f2321dbcd20a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bd62444c4c24fa79bfadc17ec40775b'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:33.561013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4c46a81f-4aea-4837-a086-f2321dbcd20a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bd62444c4c24fa79bfadc17ec40775b'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:33.573399 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4c46a81f-4aea-4837-a086-f2321dbcd20a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bd62444c4c24fa79bfadc17ec40775b'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:33.580782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1251/2532] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:12:33 2022] DELETE /identity/v3/users/1bd62444c4c24fa79bfadc17ec40775b => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:12:33.585010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3374bf33-3ea0-4dc4-bf40-d1a78b524e5f None None] MFA Rules not processed for user `61c72656816b4d27a17746453d195b19`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:33.586037 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3374bf33-3ea0-4dc4-bf40-d1a78b524e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:33.689381 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1282/2533] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:12:33.694231 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46a81f-4aea-4837-a086-f2321dbcd20a admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:33.699052 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4c46a81f-4aea-4837-a086-f2321dbcd20a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:33.826625 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46a81f-4aea-4837-a086-f2321dbcd20a admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:33.832153 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa97d4-c4a8-412d-be65-01ae09396142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:33.832886 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa97d4-c4a8-412d-be65-01ae09396142 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:33.833237 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa97d4-c4a8-412d-be65-01ae09396142 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:33.833856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aa97d4-c4a8-412d-be65-01ae09396142 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:33.834684 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa97d4-c4a8-412d-be65-01ae09396142 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:33.837312 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59aa97d4-c4a8-412d-be65-01ae09396142 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:33.983993 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1252/2534] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:12:33 2022] POST /identity/v3/projects => generated 363 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:12:33.986930 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374bf33-3ea0-4dc4-bf40-d1a78b524e5f None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:34.012876 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374bf33-3ea0-4dc4-bf40-d1a78b524e5f None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:34.087516 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cf658-82d3-4173-9e31-cceec3c380f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:34.088075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cf658-82d3-4173-9e31-cceec3c380f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:34.088338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cf658-82d3-4173-9e31-cceec3c380f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:34.088635 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1cf658-82d3-4173-9e31-cceec3c380f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:34.089240 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cf658-82d3-4173-9e31-cceec3c380f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:34.091290 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1cf658-82d3-4173-9e31-cceec3c380f6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:34.176190 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa97d4-c4a8-412d-be65-01ae09396142 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:34.179247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-59aa97d4-c4a8-412d-be65-01ae09396142 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:34.206024 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1283/2535] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:12:33 2022] POST /identity/v3/users => generated 288 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:12:34.209724 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aa97d4-c4a8-412d-be65-01ae09396142 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:34.211308 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cf658-82d3-4173-9e31-cceec3c380f6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:34.220131 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5cfb7-085f-402a-bb55-c018749569e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:34.221452 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5cfb7-085f-402a-bb55-c018749569e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:34.221971 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5cfb7-085f-402a-bb55-c018749569e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:34.222557 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd5cfb7-085f-402a-bb55-c018749569e9 admin admin] PATH_INFO: `/v3/projects/d708da2024e149a4b3666905c747eaf6` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:34.224417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1cf658-82d3-4173-9e31-cceec3c380f6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:34.225211 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5cfb7-085f-402a-bb55-c018749569e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d708da2024e149a4b3666905c747eaf6)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:34.228218 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd5cfb7-085f-402a-bb55-c018749569e9 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:34.231968 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15396c4f-dec5-4649-a95a-3381d52bea6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:34.232583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15396c4f-dec5-4649-a95a-3381d52bea6c admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:34.232860 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15396c4f-dec5-4649-a95a-3381d52bea6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:34.233128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15396c4f-dec5-4649-a95a-3381d52bea6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:34.234386 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15396c4f-dec5-4649-a95a-3381d52bea6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:34.236050 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15396c4f-dec5-4649-a95a-3381d52bea6c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:34.251529 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1284/2536] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:12:34.256111 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15396c4f-dec5-4649-a95a-3381d52bea6c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:34.267352 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15396c4f-dec5-4649-a95a-3381d52bea6c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:34.272498 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc375d-8574-4d99-9d0b-fd534a1f7d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:34.273206 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc375d-8574-4d99-9d0b-fd534a1f7d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:34.273491 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc375d-8574-4d99-9d0b-fd534a1f7d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:34.273816 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bc375d-8574-4d99-9d0b-fd534a1f7d69 admin admin] PATH_INFO: `/v3/projects/61f7e489eada4105a16a95dbdbfe7ca5/users/b944c23be6e24429b12c7c989611dab9/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:34.276137 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:34.289981 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc375d-8574-4d99-9d0b-fd534a1f7d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61f7e489eada4105a16a95dbdbfe7ca5, user_id=b944c23be6e24429b12c7c989611dab9, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:34.292643 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bc375d-8574-4d99-9d0b-fd534a1f7d69 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:34.375120 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1285/2537] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:12:34 2022] PUT /identity/v3/projects/61f7e489eada4105a16a95dbdbfe7ca5/users/b944c23be6e24429b12c7c989611dab9/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:34.378876 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc375d-8574-4d99-9d0b-fd534a1f7d69 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:34.386999 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-dbd5cfb7-085f-402a-bb55-c018749569e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd708da2024e149a4b3666905c747eaf6', 'request_id': 'req-dbd5cfb7-085f-402a-bb55-c018749569e9'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:34.392306 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:34.393926 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-dbd5cfb7-085f-402a-bb55-c018749569e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd708da2024e149a4b3666905c747eaf6', 'request_id': 'req-dbd5cfb7-085f-402a-bb55-c018749569e9'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:34.401620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-dbd5cfb7-085f-402a-bb55-c018749569e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd708da2024e149a4b3666905c747eaf6', 'request_id': 'req-dbd5cfb7-085f-402a-bb55-c018749569e9'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:34.444202 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bc375d-8574-4d99-9d0b-fd534a1f7d69 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:34.493640 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-dbd5cfb7-085f-402a-bb55-c018749569e9 admin admin] The token cache is being invalidate because project d708da2024e149a4b3666905c747eaf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:12:34.493976 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-dbd5cfb7-085f-402a-bb55-c018749569e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:34.494618 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-dbd5cfb7-085f-402a-bb55-c018749569e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:34.496684 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1253/2538] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:12:34 2022] DELETE /identity/v3/projects/d708da2024e149a4b3666905c747eaf6 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:12:34.500652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5cfb7-085f-402a-bb55-c018749569e9 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:34.501987 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-dbd5cfb7-085f-402a-bb55-c018749569e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:34.507262 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc12778-74a0-4fd6-b80b-5c0d0d1e93d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:34.507861 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc12778-74a0-4fd6-b80b-5c0d0d1e93d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:34.508139 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc12778-74a0-4fd6-b80b-5c0d0d1e93d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:34.508407 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc12778-74a0-4fd6-b80b-5c0d0d1e93d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:34.509121 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc12778-74a0-4fd6-b80b-5c0d0d1e93d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:34.510725 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc12778-74a0-4fd6-b80b-5c0d0d1e93d6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:34.514800 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd5cfb7-085f-402a-bb55-c018749569e9 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:34.519503 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e431a-84a9-4f33-bef2-8f3dd5ebdc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:34.520119 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e431a-84a9-4f33-bef2-8f3dd5ebdc93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:34.520432 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e431a-84a9-4f33-bef2-8f3dd5ebdc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:34.523776 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377e431a-84a9-4f33-bef2-8f3dd5ebdc93 admin admin] PATH_INFO: `/v3/users/0851425d841946f49c73af574b818ace` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:34.523914 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1286/2539] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:34 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:12:34.523914 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1e0d7-6f7b-4a3b-9bce-c0ac451342b6 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:34.523914 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1e0d7-6f7b-4a3b-9bce-c0ac451342b6 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:34.523914 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a1e0d7-6f7b-4a3b-9bce-c0ac451342b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:34.535085 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e431a-84a9-4f33-bef2-8f3dd5ebdc93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0851425d841946f49c73af574b818ace)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:34.537069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377e431a-84a9-4f33-bef2-8f3dd5ebdc93 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:34.542435 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-26a1e0d7-6f7b-4a3b-9bce-c0ac451342b6 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:34.544154 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-26a1e0d7-6f7b-4a3b-9bce-c0ac451342b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:34.551944 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1287/2540] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:34.553385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1e0d7-6f7b-4a3b-9bce-c0ac451342b6 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:34.553940 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-26a1e0d7-6f7b-4a3b-9bce-c0ac451342b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:34.566098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a1e0d7-6f7b-4a3b-9bce-c0ac451342b6 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:34.570675 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d49dc2e-ada4-4245-bef0-db739dbb3ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:34.571317 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49dc2e-ada4-4245-bef0-db739dbb3ef3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:34.571597 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49dc2e-ada4-4245-bef0-db739dbb3ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:34.571878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d49dc2e-ada4-4245-bef0-db739dbb3ef3 admin admin] PATH_INFO: `/v3/projects/61f7e489eada4105a16a95dbdbfe7ca5/users/b944c23be6e24429b12c7c989611dab9/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:34.573795 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49dc2e-ada4-4245-bef0-db739dbb3ef3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61f7e489eada4105a16a95dbdbfe7ca5, user_id=b944c23be6e24429b12c7c989611dab9, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:34.576447 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d49dc2e-ada4-4245-bef0-db739dbb3ef3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:34.586757 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1288/2541] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:12:34 2022] PUT /identity/v3/projects/61f7e489eada4105a16a95dbdbfe7ca5/users/b944c23be6e24429b12c7c989611dab9/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:34.595714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00f036-9894-4e5e-b2c6-e7ae3a543fc5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:34.595714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00f036-9894-4e5e-b2c6-e7ae3a543fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:34.595714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd00f036-9894-4e5e-b2c6-e7ae3a543fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:34.613453 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-cd00f036-9894-4e5e-b2c6-e7ae3a543fc5 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:34.614698 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cd00f036-9894-4e5e-b2c6-e7ae3a543fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:34.673069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1289/2542] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:34.674349 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858112e2-054c-488a-8240-9941047552c8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:34.674641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858112e2-054c-488a-8240-9941047552c8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:34.674907 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858112e2-054c-488a-8240-9941047552c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:34.701246 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-858112e2-054c-488a-8240-9941047552c8 None None] MFA Rules not processed for user `b944c23be6e24429b12c7c989611dab9`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:34.702466 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-858112e2-054c-488a-8240-9941047552c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:34.717531 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-377e431a-84a9-4f33-bef2-8f3dd5ebdc93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0851425d841946f49c73af574b818ace'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:34.772952 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1290/2543] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:34.773814 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858112e2-054c-488a-8240-9941047552c8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:34.784132 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858112e2-054c-488a-8240-9941047552c8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:34.788714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5241e-ddbe-4588-bd1b-5e0bdd16d4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:34.789303 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5241e-ddbe-4588-bd1b-5e0bdd16d4b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:34.789581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5241e-ddbe-4588-bd1b-5e0bdd16d4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:34.789884 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5241e-ddbe-4588-bd1b-5e0bdd16d4b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:34.790525 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5241e-ddbe-4588-bd1b-5e0bdd16d4b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:12:34.790828 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5241e-ddbe-4588-bd1b-5e0bdd16d4b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:34.792424 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5241e-ddbe-4588-bd1b-5e0bdd16d4b5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:34.804258 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1291/2544] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:12:34.805031 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5241e-ddbe-4588-bd1b-5e0bdd16d4b5 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:34.806594 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a6f5241e-ddbe-4588-bd1b-5e0bdd16d4b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:34.817009 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-377e431a-84a9-4f33-bef2-8f3dd5ebdc93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0851425d841946f49c73af574b818ace'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:34.829634 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-377e431a-84a9-4f33-bef2-8f3dd5ebdc93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0851425d841946f49c73af574b818ace'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:34.830332 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-377e431a-84a9-4f33-bef2-8f3dd5ebdc93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0851425d841946f49c73af574b818ace'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:34.837508 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-377e431a-84a9-4f33-bef2-8f3dd5ebdc93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0851425d841946f49c73af574b818ace'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:34.844515 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1254/2545] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:12:34 2022] DELETE /identity/v3/users/0851425d841946f49c73af574b818ace => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:34.845462 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e431a-84a9-4f33-bef2-8f3dd5ebdc93 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:34.846910 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-377e431a-84a9-4f33-bef2-8f3dd5ebdc93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:34.867463 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5241e-ddbe-4588-bd1b-5e0bdd16d4b5 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:34.888311 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:34.927162 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377e431a-84a9-4f33-bef2-8f3dd5ebdc93 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:34.928223 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff69f3-e6b1-4df6-a8f6-da93d875930a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:34.929608 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff69f3-e6b1-4df6-a8f6-da93d875930a service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:34.929796 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff69f3-e6b1-4df6-a8f6-da93d875930a service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:34.930075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff69f3-e6b1-4df6-a8f6-da93d875930a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:34.931994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-67ff69f3-e6b1-4df6-a8f6-da93d875930a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:34.932711 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6c123-cf63-476c-8a01-f72af0bafbdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:34.933328 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6c123-cf63-476c-8a01-f72af0bafbdc admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:34.933647 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6c123-cf63-476c-8a01-f72af0bafbdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:34.933980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b6c123-cf63-476c-8a01-f72af0bafbdc admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:34.934626 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6c123-cf63-476c-8a01-f72af0bafbdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:34.936534 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b6c123-cf63-476c-8a01-f72af0bafbdc admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:35.001027 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff69f3-e6b1-4df6-a8f6-da93d875930a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:35.002575 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff69f3-e6b1-4df6-a8f6-da93d875930a service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:35.013453 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1292/2546] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:34 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:12:35.019148 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1255/2547] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:12:34 2022] POST /identity/v3/projects => generated 383 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:12:35.024799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff69f3-e6b1-4df6-a8f6-da93d875930a service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:35.036010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff69f3-e6b1-4df6-a8f6-da93d875930a service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:35.091483 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c793fda-0218-45f0-bda6-c3d9e4115513 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:35.092018 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c793fda-0218-45f0-bda6-c3d9e4115513 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:35.092298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c793fda-0218-45f0-bda6-c3d9e4115513 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:35.092570 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c793fda-0218-45f0-bda6-c3d9e4115513 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:35.093194 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c793fda-0218-45f0-bda6-c3d9e4115513 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:35.095135 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c793fda-0218-45f0-bda6-c3d9e4115513 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:35.104178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6c123-cf63-476c-8a01-f72af0bafbdc admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:35.105911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-39b6c123-cf63-476c-8a01-f72af0bafbdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:35.119551 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b6c123-cf63-476c-8a01-f72af0bafbdc admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:35.128404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042dd09-ad59-4b98-a494-be00ffbf38c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:35.128404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042dd09-ad59-4b98-a494-be00ffbf38c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:35.128404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042dd09-ad59-4b98-a494-be00ffbf38c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:35.128404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0042dd09-ad59-4b98-a494-be00ffbf38c1 admin admin] PATH_INFO: `/v3/projects/9924c8e960e84d3fa49021d47a27fd32` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:35.141146 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042dd09-ad59-4b98-a494-be00ffbf38c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9924c8e960e84d3fa49021d47a27fd32)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:35.143237 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0042dd09-ad59-4b98-a494-be00ffbf38c1 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:35.188333 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=86,keystone:INSERT=3,keystone:DELETE=11 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:35.223422 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1293/2548] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:12:35 2022] POST /identity/v3/users => generated 292 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:12:35.227602 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c793fda-0218-45f0-bda6-c3d9e4115513 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:35.237773 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c793fda-0218-45f0-bda6-c3d9e4115513 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:35.242656 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6fe23-c6de-4442-8dd9-8d9b59b36d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:35.243279 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6fe23-c6de-4442-8dd9-8d9b59b36d48 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:35.243701 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6fe23-c6de-4442-8dd9-8d9b59b36d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:35.243835 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb6fe23-c6de-4442-8dd9-8d9b59b36d48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:35.244482 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6fe23-c6de-4442-8dd9-8d9b59b36d48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:35.246124 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb6fe23-c6de-4442-8dd9-8d9b59b36d48 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:35.256505 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1294/2549] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:12:35.257366 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6fe23-c6de-4442-8dd9-8d9b59b36d48 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:35.260500 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9bb6fe23-c6de-4442-8dd9-8d9b59b36d48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:35.263735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0042dd09-ad59-4b98-a494-be00ffbf38c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9924c8e960e84d3fa49021d47a27fd32', 'request_id': 'req-0042dd09-ad59-4b98-a494-be00ffbf38c1'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:35.269412 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0042dd09-ad59-4b98-a494-be00ffbf38c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9924c8e960e84d3fa49021d47a27fd32', 'request_id': 'req-0042dd09-ad59-4b98-a494-be00ffbf38c1'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:35.276805 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0042dd09-ad59-4b98-a494-be00ffbf38c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9924c8e960e84d3fa49021d47a27fd32', 'request_id': 'req-0042dd09-ad59-4b98-a494-be00ffbf38c1'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:35.314726 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:35.319636 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb6fe23-c6de-4442-8dd9-8d9b59b36d48 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:35.342649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0042dd09-ad59-4b98-a494-be00ffbf38c1 admin admin] The token cache is being invalidate because project 9924c8e960e84d3fa49021d47a27fd32 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:12:35.342871 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0042dd09-ad59-4b98-a494-be00ffbf38c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:35.343511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-0042dd09-ad59-4b98-a494-be00ffbf38c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:35.345042 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1256/2550] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:12:35 2022] DELETE /identity/v3/projects/9924c8e960e84d3fa49021d47a27fd32 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:12:35.346010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042dd09-ad59-4b98-a494-be00ffbf38c1 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:35.347471 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0042dd09-ad59-4b98-a494-be00ffbf38c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:35.373570 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1531434-736a-4277-b124-ec3b1f1f1496 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:35.374213 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1531434-736a-4277-b124-ec3b1f1f1496 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:35.374491 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1531434-736a-4277-b124-ec3b1f1f1496 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:35.374761 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1531434-736a-4277-b124-ec3b1f1f1496 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:35.376536 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f1531434-736a-4277-b124-ec3b1f1f1496 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:35.413673 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0042dd09-ad59-4b98-a494-be00ffbf38c1 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:35.418417 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f159094-d188-49f2-97cf-c78373f63856 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:35.419023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f159094-d188-49f2-97cf-c78373f63856 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:35.419303 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f159094-d188-49f2-97cf-c78373f63856 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:35.419575 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f159094-d188-49f2-97cf-c78373f63856 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:35.420209 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f159094-d188-49f2-97cf-c78373f63856 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:35.421844 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f159094-d188-49f2-97cf-c78373f63856 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:35.431999 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1257/2551] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:12:35.433241 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199271d2-21c5-4155-b21f-af10c8ae1f49 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:35.433531 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199271d2-21c5-4155-b21f-af10c8ae1f49 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:35.434347 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199271d2-21c5-4155-b21f-af10c8ae1f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:35.434902 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1531434-736a-4277-b124-ec3b1f1f1496 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:35.436411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1531434-736a-4277-b124-ec3b1f1f1496 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:35.445339 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1295/2552] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:35 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:12:35.446132 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1531434-736a-4277-b124-ec3b1f1f1496 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:35.454419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-199271d2-21c5-4155-b21f-af10c8ae1f49 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:35.455081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:35.455722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-199271d2-21c5-4155-b21f-af10c8ae1f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:35.459478 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1531434-736a-4277-b124-ec3b1f1f1496 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:35.464263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fff688e-efea-4786-acf6-30e7a2550fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:35.464958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1258/2553] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:35.465206 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff688e-efea-4786-acf6-30e7a2550fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:35.465319 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff688e-efea-4786-acf6-30e7a2550fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:35.465532 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fff688e-efea-4786-acf6-30e7a2550fb7 admin admin] PATH_INFO: `/v3/projects/eb47df9414d147e8b7fbb3a88e00614b/users/37c1c7620dab4f3eb968388f3a758890/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:35.473468 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f942fc-3986-4795-ae4f-92e3b0553cde None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:35.474320 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f942fc-3986-4795-ae4f-92e3b0553cde None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:35.474603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f942fc-3986-4795-ae4f-92e3b0553cde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:35.481985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff688e-efea-4786-acf6-30e7a2550fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb47df9414d147e8b7fbb3a88e00614b, user_id=37c1c7620dab4f3eb968388f3a758890, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:35.491838 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fff688e-efea-4786-acf6-30e7a2550fb7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:35.496933 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-45f942fc-3986-4795-ae4f-92e3b0553cde None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:35.498170 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-45f942fc-3986-4795-ae4f-92e3b0553cde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:35.506133 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1259/2554] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:12:35.510204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f942fc-3986-4795-ae4f-92e3b0553cde None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:35.519595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f942fc-3986-4795-ae4f-92e3b0553cde None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:35.524488 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b921fa-de24-4197-811e-6337540be8ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:35.525074 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b921fa-de24-4197-811e-6337540be8ec admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:35.525353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b921fa-de24-4197-811e-6337540be8ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:35.525623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b921fa-de24-4197-811e-6337540be8ec admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:35.526294 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b921fa-de24-4197-811e-6337540be8ec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:12:35.526596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b921fa-de24-4197-811e-6337540be8ec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:35.528213 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b921fa-de24-4197-811e-6337540be8ec admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:35.539812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1260/2555] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:12:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:12:35.543903 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b921fa-de24-4197-811e-6337540be8ec admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:35.553394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b921fa-de24-4197-811e-6337540be8ec admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:35.554505 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1296/2556] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:12:35 2022] PUT /identity/v3/projects/eb47df9414d147e8b7fbb3a88e00614b/users/37c1c7620dab4f3eb968388f3a758890/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:35.567423 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a152f-9e20-4e24-91b3-17bae4d9f397 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:35.567707 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a152f-9e20-4e24-91b3-17bae4d9f397 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:35.567980 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44a152f-9e20-4e24-91b3-17bae4d9f397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:35.601982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b44a152f-9e20-4e24-91b3-17bae4d9f397 None None] MFA Rules not processed for user `37c1c7620dab4f3eb968388f3a758890`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:35.603094 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b44a152f-9e20-4e24-91b3-17bae4d9f397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:35.612277 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e7211-d660-4de4-8c3b-7bd92d51bc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:35.612985 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e7211-d660-4de4-8c3b-7bd92d51bc2a admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:35.613270 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e7211-d660-4de4-8c3b-7bd92d51bc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:35.613549 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139e7211-d660-4de4-8c3b-7bd92d51bc2a admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:35.614245 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e7211-d660-4de4-8c3b-7bd92d51bc2a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:35.616144 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139e7211-d660-4de4-8c3b-7bd92d51bc2a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:35.666484 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1297/2557] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:35 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:12:35.670994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a152f-9e20-4e24-91b3-17bae4d9f397 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:35.681320 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44a152f-9e20-4e24-91b3-17bae4d9f397 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:35.686316 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b969804-43a9-4e9c-8972-ed7310ac144f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:35.691971 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b969804-43a9-4e9c-8972-ed7310ac144f admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:35.691971 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b969804-43a9-4e9c-8972-ed7310ac144f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:35.691971 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b969804-43a9-4e9c-8972-ed7310ac144f admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:35.691971 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b969804-43a9-4e9c-8972-ed7310ac144f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:35.691971 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b969804-43a9-4e9c-8972-ed7310ac144f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:35.718323 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1261/2558] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:12:35 2022] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:12:35.726630 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e7211-d660-4de4-8c3b-7bd92d51bc2a admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:35.781749 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1298/2559] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:12:35 2022] POST /identity/v3/projects => generated 385 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:12:35.785872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b969804-43a9-4e9c-8972-ed7310ac144f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:35.793680 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139e7211-d660-4de4-8c3b-7bd92d51bc2a admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:35.838502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:35.862387 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b969804-43a9-4e9c-8972-ed7310ac144f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:35.867479 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5847e95-8203-491d-8251-ae7b8a47d2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:35.867993 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a0392-2a6d-400e-8c84-923b945eb810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:35.868141 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5847e95-8203-491d-8251-ae7b8a47d2b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:35.868368 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5847e95-8203-491d-8251-ae7b8a47d2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:35.868649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5847e95-8203-491d-8251-ae7b8a47d2b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:35.868769 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a0392-2a6d-400e-8c84-923b945eb810 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:35.869444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a0392-2a6d-400e-8c84-923b945eb810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:35.869444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30a0392-2a6d-400e-8c84-923b945eb810 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:35.869634 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5847e95-8203-491d-8251-ae7b8a47d2b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:35.869927 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a0392-2a6d-400e-8c84-923b945eb810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:35.871860 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5847e95-8203-491d-8251-ae7b8a47d2b8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:35.874557 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30a0392-2a6d-400e-8c84-923b945eb810 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:35.977164 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1299/2560] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:12:35 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:12:35.977355 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1262/2561] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:12:35 2022] POST /identity/v3/users => generated 287 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:12:35.978440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5847e95-8203-491d-8251-ae7b8a47d2b8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:35.978616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a0392-2a6d-400e-8c84-923b945eb810 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:35.989402 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30a0392-2a6d-400e-8c84-923b945eb810 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:35.990284 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5847e95-8203-491d-8251-ae7b8a47d2b8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:35.994180 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601738ff-17fd-4dbf-9e7b-2691e0f0db65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:35.994755 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601738ff-17fd-4dbf-9e7b-2691e0f0db65 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:35.994915 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd15307-c6f7-44d8-8c0e-fc03e8cb3449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:35.995040 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601738ff-17fd-4dbf-9e7b-2691e0f0db65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:35.995446 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601738ff-17fd-4dbf-9e7b-2691e0f0db65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:35.995558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd15307-c6f7-44d8-8c0e-fc03e8cb3449 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:35.995836 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd15307-c6f7-44d8-8c0e-fc03e8cb3449 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:35.995961 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601738ff-17fd-4dbf-9e7b-2691e0f0db65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:35.996045 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd15307-c6f7-44d8-8c0e-fc03e8cb3449 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:35.997348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd15307-c6f7-44d8-8c0e-fc03e8cb3449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:35.998160 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601738ff-17fd-4dbf-9e7b-2691e0f0db65 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:35.998961 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd15307-c6f7-44d8-8c0e-fc03e8cb3449 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:36.008200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1263/2562] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:12:36.011171 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1300/2563] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:12:36.018155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601738ff-17fd-4dbf-9e7b-2691e0f0db65 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:36.018282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd15307-c6f7-44d8-8c0e-fc03e8cb3449 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:36.022853 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd15307-c6f7-44d8-8c0e-fc03e8cb3449 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:36.023376 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601738ff-17fd-4dbf-9e7b-2691e0f0db65 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:36.027419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a205a-567b-4740-98d6-fbfaf47c3c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:36.027998 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a205a-567b-4740-98d6-fbfaf47c3c13 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:36.028115 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6c301-3e9e-4f45-a379-823aa42a9f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:36.028271 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a205a-567b-4740-98d6-fbfaf47c3c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:36.028537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7a205a-567b-4740-98d6-fbfaf47c3c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:36.028637 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6c301-3e9e-4f45-a379-823aa42a9f40 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:36.028891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6c301-3e9e-4f45-a379-823aa42a9f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:36.029162 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a205a-567b-4740-98d6-fbfaf47c3c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:36.029294 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce6c301-3e9e-4f45-a379-823aa42a9f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:36.029819 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6c301-3e9e-4f45-a379-823aa42a9f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:36.030885 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7a205a-567b-4740-98d6-fbfaf47c3c13 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:36.031451 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce6c301-3e9e-4f45-a379-823aa42a9f40 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:36.042284 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1264/2564] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:12:36.046140 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1301/2565] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:12:36.050113 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6c301-3e9e-4f45-a379-823aa42a9f40 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:36.052617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a205a-567b-4740-98d6-fbfaf47c3c13 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:36.060865 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce6c301-3e9e-4f45-a379-823aa42a9f40 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:36.064758 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7a205a-567b-4740-98d6-fbfaf47c3c13 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:36.065752 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec353c0-b0dc-4148-bdd7-26ba41093b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:36.066410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec353c0-b0dc-4148-bdd7-26ba41093b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:36.066788 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec353c0-b0dc-4148-bdd7-26ba41093b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:36.067035 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec353c0-b0dc-4148-bdd7-26ba41093b4a admin admin] PATH_INFO: `/v3/projects/091495ac7f8d4edabff92063074b0cfe/users/b973f848a2e14bd5b3900caf435aa658/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:36.069596 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951dac2-1a21-4a59-8ffc-bd51228d579e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:36.074123 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951dac2-1a21-4a59-8ffc-bd51228d579e admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:36.074123 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951dac2-1a21-4a59-8ffc-bd51228d579e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:36.074123 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951dac2-1a21-4a59-8ffc-bd51228d579e admin admin] PATH_INFO: `/v3/projects/f72ef29d37bc4e2cb0f07ce9ab9b236d/users/63911ba22ea04a0ea499418eb233e1f4/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:36.082017 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec353c0-b0dc-4148-bdd7-26ba41093b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=091495ac7f8d4edabff92063074b0cfe, user_id=b973f848a2e14bd5b3900caf435aa658, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:36.085020 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec353c0-b0dc-4148-bdd7-26ba41093b4a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:36.086061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951dac2-1a21-4a59-8ffc-bd51228d579e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f72ef29d37bc4e2cb0f07ce9ab9b236d, user_id=63911ba22ea04a0ea499418eb233e1f4, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:36.088770 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951dac2-1a21-4a59-8ffc-bd51228d579e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:36.092584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:36.160572 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1302/2566] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:12:36 2022] PUT /identity/v3/projects/f72ef29d37bc4e2cb0f07ce9ab9b236d/users/63911ba22ea04a0ea499418eb233e1f4/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:36.161952 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1265/2567] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:12:36 2022] PUT /identity/v3/projects/091495ac7f8d4edabff92063074b0cfe/users/b973f848a2e14bd5b3900caf435aa658/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:12:36.171227 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635439b5-ffdd-41d0-a09c-b3eac0ab85da None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:36.171724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635439b5-ffdd-41d0-a09c-b3eac0ab85da None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:36.172093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635439b5-ffdd-41d0-a09c-b3eac0ab85da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:36.178367 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074642b-87c0-43e4-9e89-2fe8ae1dbb6f None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:36.178751 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074642b-87c0-43e4-9e89-2fe8ae1dbb6f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:36.178973 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b074642b-87c0-43e4-9e89-2fe8ae1dbb6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:36.199938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-635439b5-ffdd-41d0-a09c-b3eac0ab85da None None] MFA Rules not processed for user `63911ba22ea04a0ea499418eb233e1f4`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:36.201144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-635439b5-ffdd-41d0-a09c-b3eac0ab85da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:36.206993 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-b074642b-87c0-43e4-9e89-2fe8ae1dbb6f None None] MFA Rules not processed for user `b973f848a2e14bd5b3900caf435aa658`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:36.208200 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b074642b-87c0-43e4-9e89-2fe8ae1dbb6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:36.265892 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1303/2568] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:12:36.274066 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1266/2569] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:12:36.277218 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635439b5-ffdd-41d0-a09c-b3eac0ab85da None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:36.279270 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-635439b5-ffdd-41d0-a09c-b3eac0ab85da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:36.279489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074642b-87c0-43e4-9e89-2fe8ae1dbb6f None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:36.340446 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b074642b-87c0-43e4-9e89-2fe8ae1dbb6f None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:36.346341 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676dc2f-0292-48a3-95ad-12fa1b1a70a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:36.347496 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676dc2f-0292-48a3-95ad-12fa1b1a70a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:36.347496 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676dc2f-0292-48a3-95ad-12fa1b1a70a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:36.347496 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d676dc2f-0292-48a3-95ad-12fa1b1a70a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:36.348097 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676dc2f-0292-48a3-95ad-12fa1b1a70a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:36.350020 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d676dc2f-0292-48a3-95ad-12fa1b1a70a7 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:36.351684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635439b5-ffdd-41d0-a09c-b3eac0ab85da None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:36.357925 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd205f-7547-4d4d-8887-ffaccd0592af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:36.358530 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd205f-7547-4d4d-8887-ffaccd0592af service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:36.358802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd205f-7547-4d4d-8887-ffaccd0592af service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:36.359070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cd205f-7547-4d4d-8887-ffaccd0592af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:36.366917 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd205f-7547-4d4d-8887-ffaccd0592af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:36.368766 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cd205f-7547-4d4d-8887-ffaccd0592af service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:36.377670 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1304/2570] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:12:36.430061 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1267/2571] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:12:36 2022] POST /identity/v3/projects => generated 387 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:12:36.434642 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd205f-7547-4d4d-8887-ffaccd0592af service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:36.451258 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cd205f-7547-4d4d-8887-ffaccd0592af service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:36.505280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b21e8-9265-4410-adcb-534f17238e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:36.505495 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b21e8-9265-4410-adcb-534f17238e20 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:36.505810 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b21e8-9265-4410-adcb-534f17238e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:36.506090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0b21e8-9265-4410-adcb-534f17238e20 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:36.506772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b21e8-9265-4410-adcb-534f17238e20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:36.508804 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0b21e8-9265-4410-adcb-534f17238e20 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:36.543174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:36.607078 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676dc2f-0292-48a3-95ad-12fa1b1a70a7 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:36.614992 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1305/2572] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:12:36 2022] POST /identity/v3/users => generated 300 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:12:36.618049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d676dc2f-0292-48a3-95ad-12fa1b1a70a7 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:36.622744 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2622ad-23a1-4ae7-8f41-1acd3aaac4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:36.623891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2622ad-23a1-4ae7-8f41-1acd3aaac4e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:36.623891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2622ad-23a1-4ae7-8f41-1acd3aaac4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:36.624092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2622ad-23a1-4ae7-8f41-1acd3aaac4e7 admin admin] PATH_INFO: `/v3/users/63911ba22ea04a0ea499418eb233e1f4` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:36.625155 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2622ad-23a1-4ae7-8f41-1acd3aaac4e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63911ba22ea04a0ea499418eb233e1f4)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:36.626455 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b21e8-9265-4410-adcb-534f17238e20 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:36.627363 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2622ad-23a1-4ae7-8f41-1acd3aaac4e7 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:36.636312 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0b21e8-9265-4410-adcb-534f17238e20 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:36.641556 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccc78a-c671-4059-973a-17db825bd280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:36.642186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccc78a-c671-4059-973a-17db825bd280 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:36.642468 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccc78a-c671-4059-973a-17db825bd280 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:36.642744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dccc78a-c671-4059-973a-17db825bd280 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:36.643391 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dccc78a-c671-4059-973a-17db825bd280 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:36.645001 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dccc78a-c671-4059-973a-17db825bd280 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:36.646420 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:36.656040 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1306/2573] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:12:36.660052 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccc78a-c671-4059-973a-17db825bd280 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:36.669546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dccc78a-c671-4059-973a-17db825bd280 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:36.673941 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d35c8-4fb6-49f9-85a3-3b1151db5b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:36.674579 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d35c8-4fb6-49f9-85a3-3b1151db5b6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:36.674854 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d35c8-4fb6-49f9-85a3-3b1151db5b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:36.675124 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2d35c8-4fb6-49f9-85a3-3b1151db5b6a admin admin] PATH_INFO: `/v3/projects/c8ed9fb0819c40b78ef49edcdefc4c9e/users/75e643ad8b35435ab6d27fb996bf198a/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:36.689582 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d35c8-4fb6-49f9-85a3-3b1151db5b6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8ed9fb0819c40b78ef49edcdefc4c9e, user_id=75e643ad8b35435ab6d27fb996bf198a, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:36.692223 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2d35c8-4fb6-49f9-85a3-3b1151db5b6a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:36.777454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1307/2574] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:12:36 2022] PUT /identity/v3/projects/c8ed9fb0819c40b78ef49edcdefc4c9e/users/75e643ad8b35435ab6d27fb996bf198a/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:12:36.781967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d35c8-4fb6-49f9-85a3-3b1151db5b6a admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:36.834897 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4b2622ad-23a1-4ae7-8f41-1acd3aaac4e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63911ba22ea04a0ea499418eb233e1f4'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:36.842387 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2d35c8-4fb6-49f9-85a3-3b1151db5b6a admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:36.847365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614309b1-d0df-452d-845a-a185e604618d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:36.848092 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614309b1-d0df-452d-845a-a185e604618d admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:36.848376 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614309b1-d0df-452d-845a-a185e604618d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:36.848650 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614309b1-d0df-452d-845a-a185e604618d admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:36.849418 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614309b1-d0df-452d-845a-a185e604618d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:36.851188 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614309b1-d0df-452d-845a-a185e604618d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:36.861217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1308/2575] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:36 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:12:36.865253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614309b1-d0df-452d-845a-a185e604618d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:36.874996 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614309b1-d0df-452d-845a-a185e604618d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:36.879682 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86caa7cd-432e-41ec-9ed1-8cdcc406cc83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:36.880318 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86caa7cd-432e-41ec-9ed1-8cdcc406cc83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:36.880598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86caa7cd-432e-41ec-9ed1-8cdcc406cc83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:36.880876 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86caa7cd-432e-41ec-9ed1-8cdcc406cc83 admin admin] PATH_INFO: `/v3/projects/c8ed9fb0819c40b78ef49edcdefc4c9e/users/75e643ad8b35435ab6d27fb996bf198a/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:36.882865 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86caa7cd-432e-41ec-9ed1-8cdcc406cc83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8ed9fb0819c40b78ef49edcdefc4c9e, user_id=75e643ad8b35435ab6d27fb996bf198a, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:36.885484 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86caa7cd-432e-41ec-9ed1-8cdcc406cc83 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:36.896498 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1309/2576] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:12:36 2022] PUT /identity/v3/projects/c8ed9fb0819c40b78ef49edcdefc4c9e/users/75e643ad8b35435ab6d27fb996bf198a/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:12:36.906618 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1ea71-63c8-4051-b471-c3e76c141287 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:36.906908 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1ea71-63c8-4051-b471-c3e76c141287 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:36.907185 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe1ea71-63c8-4051-b471-c3e76c141287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:36.935107 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3fe1ea71-63c8-4051-b471-c3e76c141287 None None] MFA Rules not processed for user `75e643ad8b35435ab6d27fb996bf198a`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:36.938960 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3fe1ea71-63c8-4051-b471-c3e76c141287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:36.957887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4b2622ad-23a1-4ae7-8f41-1acd3aaac4e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63911ba22ea04a0ea499418eb233e1f4'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:36.973432 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4b2622ad-23a1-4ae7-8f41-1acd3aaac4e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63911ba22ea04a0ea499418eb233e1f4'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:36.974451 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4b2622ad-23a1-4ae7-8f41-1acd3aaac4e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63911ba22ea04a0ea499418eb233e1f4'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:36.983444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4b2622ad-23a1-4ae7-8f41-1acd3aaac4e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63911ba22ea04a0ea499418eb233e1f4'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:36.989738 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1268/2577] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:12:36 2022] DELETE /identity/v3/users/63911ba22ea04a0ea499418eb233e1f4 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:12:36.994166 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff91ab-e9ad-4180-9a74-6e0c5857bd31 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:36.994559 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff91ab-e9ad-4180-9a74-6e0c5857bd31 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:36.994962 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ff91ab-e9ad-4180-9a74-6e0c5857bd31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:37.010076 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1310/2578] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:36 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:12:37.018709 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-f6ff91ab-e9ad-4180-9a74-6e0c5857bd31 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:37.020067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f6ff91ab-e9ad-4180-9a74-6e0c5857bd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:37.023844 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1ea71-63c8-4051-b471-c3e76c141287 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:37.025473 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3fe1ea71-63c8-4051-b471-c3e76c141287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:37.033415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:37.088554 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe1ea71-63c8-4051-b471-c3e76c141287 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:37.089089 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1269/2579] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:12:37.096634 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff91ab-e9ad-4180-9a74-6e0c5857bd31 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:37.098236 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f6ff91ab-e9ad-4180-9a74-6e0c5857bd31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:37.139821 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dc4289-49b3-4e12-92c7-05f9f9d034ee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:37.140430 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc4289-49b3-4e12-92c7-05f9f9d034ee service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:37.140706 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc4289-49b3-4e12-92c7-05f9f9d034ee service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:37.140969 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dc4289-49b3-4e12-92c7-05f9f9d034ee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:37.156301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ff91ab-e9ad-4180-9a74-6e0c5857bd31 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:37.160007 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a85a7b-f4e3-4df7-bd15-c4bd4998aad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:37.163445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a85a7b-f4e3-4df7-bd15-c4bd4998aad3 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:37.163445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a85a7b-f4e3-4df7-bd15-c4bd4998aad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:37.163445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a85a7b-f4e3-4df7-bd15-c4bd4998aad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:37.170613 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a85a7b-f4e3-4df7-bd15-c4bd4998aad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:37.172030 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a85a7b-f4e3-4df7-bd15-c4bd4998aad3 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:37.181442 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1270/2580] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:12:37.201239 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc4289-49b3-4e12-92c7-05f9f9d034ee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:37.202712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62dc4289-49b3-4e12-92c7-05f9f9d034ee service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:37.212683 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1311/2581] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:37 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:12:37.223164 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:37.619197 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a85a7b-f4e3-4df7-bd15-c4bd4998aad3 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:37.620861 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-65a85a7b-f4e3-4df7-bd15-c4bd4998aad3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:37.647000 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a85a7b-f4e3-4df7-bd15-c4bd4998aad3 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:37.652472 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171fd9d2-cb73-4ac0-a75b-64ab2b4ad8b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:37.653194 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fd9d2-cb73-4ac0-a75b-64ab2b4ad8b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:37.654239 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fd9d2-cb73-4ac0-a75b-64ab2b4ad8b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:37.654585 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171fd9d2-cb73-4ac0-a75b-64ab2b4ad8b7 admin admin] PATH_INFO: `/v3/projects/f72ef29d37bc4e2cb0f07ce9ab9b236d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:37.655952 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fd9d2-cb73-4ac0-a75b-64ab2b4ad8b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f72ef29d37bc4e2cb0f07ce9ab9b236d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:37.658260 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171fd9d2-cb73-4ac0-a75b-64ab2b4ad8b7 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:37.806941 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-171fd9d2-cb73-4ac0-a75b-64ab2b4ad8b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f72ef29d37bc4e2cb0f07ce9ab9b236d', 'request_id': 'req-171fd9d2-cb73-4ac0-a75b-64ab2b4ad8b7'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:37.812908 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-171fd9d2-cb73-4ac0-a75b-64ab2b4ad8b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f72ef29d37bc4e2cb0f07ce9ab9b236d', 'request_id': 'req-171fd9d2-cb73-4ac0-a75b-64ab2b4ad8b7'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:37.819636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-171fd9d2-cb73-4ac0-a75b-64ab2b4ad8b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f72ef29d37bc4e2cb0f07ce9ab9b236d', 'request_id': 'req-171fd9d2-cb73-4ac0-a75b-64ab2b4ad8b7'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:37.909896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-171fd9d2-cb73-4ac0-a75b-64ab2b4ad8b7 admin admin] The token cache is being invalidate because project f72ef29d37bc4e2cb0f07ce9ab9b236d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:12:37.910193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-171fd9d2-cb73-4ac0-a75b-64ab2b4ad8b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:37.910818 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-171fd9d2-cb73-4ac0-a75b-64ab2b4ad8b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:37.912316 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1271/2582] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:12:37 2022] DELETE /identity/v3/projects/f72ef29d37bc4e2cb0f07ce9ab9b236d => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:37.917454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e4aa3-36dd-4e07-a25a-a9cfecfa9fe8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:37.917945 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e4aa3-36dd-4e07-a25a-a9cfecfa9fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:37.918044 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e4aa3-36dd-4e07-a25a-a9cfecfa9fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:37.937595 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-1f1e4aa3-36dd-4e07-a25a-a9cfecfa9fe8 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:37.938807 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-1f1e4aa3-36dd-4e07-a25a-a9cfecfa9fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:37.998580 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1312/2583] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:12:38.006880 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57a902-ef70-4703-a07b-8177eaeb3adc None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:38.007173 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57a902-ef70-4703-a07b-8177eaeb3adc None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:38.007456 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be57a902-ef70-4703-a07b-8177eaeb3adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:38.027949 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-be57a902-ef70-4703-a07b-8177eaeb3adc None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:38.029162 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-be57a902-ef70-4703-a07b-8177eaeb3adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:38.037316 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1272/2584] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:38.041735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e4aa3-36dd-4e07-a25a-a9cfecfa9fe8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:38.048299 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=100 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:38.051950 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e4aa3-36dd-4e07-a25a-a9cfecfa9fe8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:38.056622 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fbce8-6f21-478a-8eb8-2fe52c295467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:38.057206 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fbce8-6f21-478a-8eb8-2fe52c295467 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:38.058111 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fbce8-6f21-478a-8eb8-2fe52c295467 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:38.058111 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2fbce8-6f21-478a-8eb8-2fe52c295467 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:38.058450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2fbce8-6f21-478a-8eb8-2fe52c295467 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:12:38.059005 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2fbce8-6f21-478a-8eb8-2fe52c295467 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:38.060982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2fbce8-6f21-478a-8eb8-2fe52c295467 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:38.072434 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1313/2585] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:12:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:12:38.076962 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57a902-ef70-4703-a07b-8177eaeb3adc None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:38.086317 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be57a902-ef70-4703-a07b-8177eaeb3adc None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:38.091158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc9c65-bfe6-446f-a18d-817e018a1499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:38.091746 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc9c65-bfe6-446f-a18d-817e018a1499 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:38.092023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc9c65-bfe6-446f-a18d-817e018a1499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:38.092294 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfc9c65-bfe6-446f-a18d-817e018a1499 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:38.092911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc9c65-bfe6-446f-a18d-817e018a1499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:38.094987 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfc9c65-bfe6-446f-a18d-817e018a1499 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:38.232436 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1273/2586] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:12:38 2022] POST /identity/v3/projects => generated 355 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:12:38.234160 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fbce8-6f21-478a-8eb8-2fe52c295467 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:38.244526 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2fbce8-6f21-478a-8eb8-2fe52c295467 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:38.303945 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e14dbd-da0c-43d9-aa12-31416ec4c4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:38.304674 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e14dbd-da0c-43d9-aa12-31416ec4c4bb admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:38.304875 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e14dbd-da0c-43d9-aa12-31416ec4c4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:38.305154 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e14dbd-da0c-43d9-aa12-31416ec4c4bb admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:38.305820 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e14dbd-da0c-43d9-aa12-31416ec4c4bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:38.307724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e14dbd-da0c-43d9-aa12-31416ec4c4bb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:38.332827 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc9c65-bfe6-446f-a18d-817e018a1499 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:38.334846 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7cfc9c65-bfe6-446f-a18d-817e018a1499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:38.375723 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:38.392682 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfc9c65-bfe6-446f-a18d-817e018a1499 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:38.396327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7be4b0-a9de-4971-9e35-e19861a72615 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:38.396931 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7be4b0-a9de-4971-9e35-e19861a72615 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:38.397210 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7be4b0-a9de-4971-9e35-e19861a72615 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:38.397482 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7be4b0-a9de-4971-9e35-e19861a72615 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:38.399354 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3a7be4b0-a9de-4971-9e35-e19861a72615 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:38.409281 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1314/2587] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:12:38 2022] POST /identity/v3/users => generated 278 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:12:38.410863 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e14dbd-da0c-43d9-aa12-31416ec4c4bb admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:38.421527 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e14dbd-da0c-43d9-aa12-31416ec4c4bb admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:38.426180 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4faff-5330-4ddb-b2ad-c82a44751aab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:38.426778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4faff-5330-4ddb-b2ad-c82a44751aab admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:38.427058 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4faff-5330-4ddb-b2ad-c82a44751aab admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:38.427338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4faff-5330-4ddb-b2ad-c82a44751aab admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:38.427962 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4faff-5330-4ddb-b2ad-c82a44751aab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:38.429798 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4faff-5330-4ddb-b2ad-c82a44751aab admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:38.440547 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1315/2588] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:12:38.444593 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4faff-5330-4ddb-b2ad-c82a44751aab admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:38.454054 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4faff-5330-4ddb-b2ad-c82a44751aab admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:38.458646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4998fce9-2388-4958-b103-85c62b6e91ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:38.459551 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998fce9-2388-4958-b103-85c62b6e91ff admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:38.459829 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998fce9-2388-4958-b103-85c62b6e91ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:38.460101 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4998fce9-2388-4958-b103-85c62b6e91ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:38.460726 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998fce9-2388-4958-b103-85c62b6e91ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:38.461070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7be4b0-a9de-4971-9e35-e19861a72615 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:38.462419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4998fce9-2388-4958-b103-85c62b6e91ff admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:38.462602 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7be4b0-a9de-4971-9e35-e19861a72615 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:38.472018 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1274/2589] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:38 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:12:38.472681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1316/2590] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:38 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:12:38.476827 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7be4b0-a9de-4971-9e35-e19861a72615 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:38.488067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7be4b0-a9de-4971-9e35-e19861a72615 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:38.492759 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81635278-a385-4aa3-bd48-c6527ee00ee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:38.493410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81635278-a385-4aa3-bd48-c6527ee00ee2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:38.493715 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81635278-a385-4aa3-bd48-c6527ee00ee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:38.494129 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81635278-a385-4aa3-bd48-c6527ee00ee2 admin admin] PATH_INFO: `/v3/projects/a3faee39ab8e443eafe63069d4dcd5b2/users/c8fb0fa4156342f482a04db9ac1e405a/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:38.510857 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81635278-a385-4aa3-bd48-c6527ee00ee2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3faee39ab8e443eafe63069d4dcd5b2, user_id=c8fb0fa4156342f482a04db9ac1e405a, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:38.514185 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81635278-a385-4aa3-bd48-c6527ee00ee2 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:38.603777 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1275/2591] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:12:38 2022] PUT /identity/v3/projects/a3faee39ab8e443eafe63069d4dcd5b2/users/c8fb0fa4156342f482a04db9ac1e405a/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:38.614488 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01169c0-b7ae-42dd-bb32-ebc8ec3a24bb None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:38.614782 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01169c0-b7ae-42dd-bb32-ebc8ec3a24bb None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:38.615205 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01169c0-b7ae-42dd-bb32-ebc8ec3a24bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:38.644321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a01169c0-b7ae-42dd-bb32-ebc8ec3a24bb None None] MFA Rules not processed for user `c8fb0fa4156342f482a04db9ac1e405a`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:38.645528 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a01169c0-b7ae-42dd-bb32-ebc8ec3a24bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:38.710639 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1317/2592] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:38.715384 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81635278-a385-4aa3-bd48-c6527ee00ee2 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:38.779793 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81635278-a385-4aa3-bd48-c6527ee00ee2 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:38.784880 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bd282-e381-4c29-9164-bdab2bd555e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:38.785497 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bd282-e381-4c29-9164-bdab2bd555e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:38.791160 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bd282-e381-4c29-9164-bdab2bd555e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:38.791160 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607bd282-e381-4c29-9164-bdab2bd555e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:38.791160 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bd282-e381-4c29-9164-bdab2bd555e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:38.791160 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607bd282-e381-4c29-9164-bdab2bd555e7 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:38.914706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1276/2593] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:12:38 2022] POST /identity/v3/projects => generated 355 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:12:38.918276 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01169c0-b7ae-42dd-bb32-ebc8ec3a24bb None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:38.929518 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01169c0-b7ae-42dd-bb32-ebc8ec3a24bb None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:38.975950 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:38.987857 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d153910-2989-4c6c-8a60-5829ca5a9940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:38.988456 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d153910-2989-4c6c-8a60-5829ca5a9940 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:38.988735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d153910-2989-4c6c-8a60-5829ca5a9940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:38.989004 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d153910-2989-4c6c-8a60-5829ca5a9940 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:38.991082 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d153910-2989-4c6c-8a60-5829ca5a9940 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:38.991613 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d153910-2989-4c6c-8a60-5829ca5a9940 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:39.083403 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1318/2594] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:12:38 2022] POST /identity/v3/users => generated 284 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:12:39.087643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bd282-e381-4c29-9164-bdab2bd555e7 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:39.098010 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607bd282-e381-4c29-9164-bdab2bd555e7 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:39.103143 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b0dda-415a-4684-a5aa-815aed2626da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:39.103758 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b0dda-415a-4684-a5aa-815aed2626da admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:39.104045 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b0dda-415a-4684-a5aa-815aed2626da admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:39.104323 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b0dda-415a-4684-a5aa-815aed2626da admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:39.105258 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b0dda-415a-4684-a5aa-815aed2626da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:39.106705 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b0dda-415a-4684-a5aa-815aed2626da admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:39.118344 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1277/2595] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:12:39.123527 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d153910-2989-4c6c-8a60-5829ca5a9940 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:39.134165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d153910-2989-4c6c-8a60-5829ca5a9940 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:39.139229 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5066fd5-315d-4d3d-86f4-d917d3d0bd36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:39.140901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5066fd5-315d-4d3d-86f4-d917d3d0bd36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:39.140901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5066fd5-315d-4d3d-86f4-d917d3d0bd36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:39.140901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5066fd5-315d-4d3d-86f4-d917d3d0bd36 admin admin] PATH_INFO: `/v3/projects/9d747347a6f341549b474ca0634e157b/users/30ecf37981314bbda7fd5b1c19e6a824/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:39.157568 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5066fd5-315d-4d3d-86f4-d917d3d0bd36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d747347a6f341549b474ca0634e157b, user_id=30ecf37981314bbda7fd5b1c19e6a824, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:39.160275 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5066fd5-315d-4d3d-86f4-d917d3d0bd36 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:39.257782 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1319/2596] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:12:39 2022] PUT /identity/v3/projects/9d747347a6f341549b474ca0634e157b/users/30ecf37981314bbda7fd5b1c19e6a824/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:39.262090 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b0dda-415a-4684-a5aa-815aed2626da admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:39.272169 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b0dda-415a-4684-a5aa-815aed2626da admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:39.314679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:39.332858 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0cfd09-fef6-4f09-9187-af547deb3d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:39.333460 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cfd09-fef6-4f09-9187-af547deb3d03 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:39.333775 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cfd09-fef6-4f09-9187-af547deb3d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:39.334306 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0cfd09-fef6-4f09-9187-af547deb3d03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:39.335002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0cfd09-fef6-4f09-9187-af547deb3d03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:39.336632 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0cfd09-fef6-4f09-9187-af547deb3d03 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:39.347078 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1278/2597] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:39 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:12:39.351357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5066fd5-315d-4d3d-86f4-d917d3d0bd36 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:39.362148 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5066fd5-315d-4d3d-86f4-d917d3d0bd36 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:39.366791 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6edc86-6a1c-4cc3-a709-40587df34077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:39.367450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6edc86-6a1c-4cc3-a709-40587df34077 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:39.367734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6edc86-6a1c-4cc3-a709-40587df34077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:39.368013 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6edc86-6a1c-4cc3-a709-40587df34077 admin admin] PATH_INFO: `/v3/projects/9d747347a6f341549b474ca0634e157b/users/30ecf37981314bbda7fd5b1c19e6a824/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:39.370014 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6edc86-6a1c-4cc3-a709-40587df34077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d747347a6f341549b474ca0634e157b, user_id=30ecf37981314bbda7fd5b1c19e6a824, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:39.372694 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6edc86-6a1c-4cc3-a709-40587df34077 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:39.382964 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1320/2598] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:12:39 2022] PUT /identity/v3/projects/9d747347a6f341549b474ca0634e157b/users/30ecf37981314bbda7fd5b1c19e6a824/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:39.394581 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a1696-ee46-47b7-848f-afb960203a03 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:39.394869 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a1696-ee46-47b7-848f-afb960203a03 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:39.395146 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a1696-ee46-47b7-848f-afb960203a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:39.424721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-8c8a1696-ee46-47b7-848f-afb960203a03 None None] MFA Rules not processed for user `30ecf37981314bbda7fd5b1c19e6a824`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:39.425977 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8c8a1696-ee46-47b7-848f-afb960203a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:39.495171 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1279/2599] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:39 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:39.506308 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6edc86-6a1c-4cc3-a709-40587df34077 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:39.563208 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6edc86-6a1c-4cc3-a709-40587df34077 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:39.566864 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3ffc9-4a70-4375-84ee-039fc0b0aa1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:39.567466 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3ffc9-4a70-4375-84ee-039fc0b0aa1e service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:39.567747 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3ffc9-4a70-4375-84ee-039fc0b0aa1e service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:39.568021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc3ffc9-4a70-4375-84ee-039fc0b0aa1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:39.577484 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc3ffc9-4a70-4375-84ee-039fc0b0aa1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:39.578964 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc3ffc9-4a70-4375-84ee-039fc0b0aa1e service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:39.588590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1321/2600] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:39 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:12:39.775619 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a1696-ee46-47b7-848f-afb960203a03 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:39.786619 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a1696-ee46-47b7-848f-afb960203a03 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:39.790177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043581a-ab99-4343-a0e2-1580832f7067 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:39.790824 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043581a-ab99-4343-a0e2-1580832f7067 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:39.791099 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043581a-ab99-4343-a0e2-1580832f7067 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:39.791366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043581a-ab99-4343-a0e2-1580832f7067 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:39.853526 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043581a-ab99-4343-a0e2-1580832f7067 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:39.855018 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043581a-ab99-4343-a0e2-1580832f7067 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:39.864437 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1280/2601] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:39 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:12:43.527732 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3ffc9-4a70-4375-84ee-039fc0b0aa1e service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:43.536826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc3ffc9-4a70-4375-84ee-039fc0b0aa1e service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:43.540531 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca19f65-0cc5-4f45-b107-3bfc8b67fa5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:43.544575 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca19f65-0cc5-4f45-b107-3bfc8b67fa5e service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:43.544575 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca19f65-0cc5-4f45-b107-3bfc8b67fa5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:43.544575 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca19f65-0cc5-4f45-b107-3bfc8b67fa5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:43.544575 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cca19f65-0cc5-4f45-b107-3bfc8b67fa5e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:43.605386 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca19f65-0cc5-4f45-b107-3bfc8b67fa5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:43.606975 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca19f65-0cc5-4f45-b107-3bfc8b67fa5e service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:43.616562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1322/2602] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:43 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:12:44.195870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043581a-ab99-4343-a0e2-1580832f7067 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:44.197531 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8043581a-ab99-4343-a0e2-1580832f7067 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:44.262846 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043581a-ab99-4343-a0e2-1580832f7067 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:44.267915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f170b44-a8b0-40b2-a181-3337e576e072 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:44.268539 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f170b44-a8b0-40b2-a181-3337e576e072 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:44.268815 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f170b44-a8b0-40b2-a181-3337e576e072 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:44.269084 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f170b44-a8b0-40b2-a181-3337e576e072 admin admin] PATH_INFO: `/v3/users/61c72656816b4d27a17746453d195b19` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:44.270255 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f170b44-a8b0-40b2-a181-3337e576e072 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61c72656816b4d27a17746453d195b19)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:44.272151 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f170b44-a8b0-40b2-a181-3337e576e072 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:44.273673 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:44.496127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3f170b44-a8b0-40b2-a181-3337e576e072 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61c72656816b4d27a17746453d195b19'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:44.574730 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3f170b44-a8b0-40b2-a181-3337e576e072 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61c72656816b4d27a17746453d195b19'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:44.587547 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3f170b44-a8b0-40b2-a181-3337e576e072 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61c72656816b4d27a17746453d195b19'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:44.588196 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3f170b44-a8b0-40b2-a181-3337e576e072 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61c72656816b4d27a17746453d195b19'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:44.595866 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-3f170b44-a8b0-40b2-a181-3337e576e072 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61c72656816b4d27a17746453d195b19'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:44.602100 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1281/2603] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:12:44 2022] DELETE /identity/v3/users/61c72656816b4d27a17746453d195b19 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:44.606883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebca16-2614-4bda-9ad7-ef00f64eb8f5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:44.607425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebca16-2614-4bda-9ad7-ef00f64eb8f5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:44.607519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ebca16-2614-4bda-9ad7-ef00f64eb8f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:44.628819 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a4ebca16-2614-4bda-9ad7-ef00f64eb8f5 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:44.630078 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a4ebca16-2614-4bda-9ad7-ef00f64eb8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:44.675267 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:44.697419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1323/2604] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:44.707689 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f170b44-a8b0-40b2-a181-3337e576e072 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:44.709091 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3f170b44-a8b0-40b2-a181-3337e576e072 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:44.769438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f170b44-a8b0-40b2-a181-3337e576e072 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:44.773100 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205d195-7b98-4f31-9655-07e7a96a8a88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:44.773733 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205d195-7b98-4f31-9655-07e7a96a8a88 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:44.774021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205d195-7b98-4f31-9655-07e7a96a8a88 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:44.774298 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5205d195-7b98-4f31-9655-07e7a96a8a88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:44.784016 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205d195-7b98-4f31-9655-07e7a96a8a88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:44.789098 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5205d195-7b98-4f31-9655-07e7a96a8a88 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:44.795676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1282/2605] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:12:45.199686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebca16-2614-4bda-9ad7-ef00f64eb8f5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:45.201156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a4ebca16-2614-4bda-9ad7-ef00f64eb8f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:45.215851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ebca16-2614-4bda-9ad7-ef00f64eb8f5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:45.220644 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f7de6-6ef4-4f4f-bb00-3e238b569789 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:45.221918 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f7de6-6ef4-4f4f-bb00-3e238b569789 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:45.222214 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f7de6-6ef4-4f4f-bb00-3e238b569789 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:45.222486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9f7de6-6ef4-4f4f-bb00-3e238b569789 admin admin] PATH_INFO: `/v3/projects/4fa66d36b4f549f98916f300b561eade` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:45.223879 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f7de6-6ef4-4f4f-bb00-3e238b569789 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4fa66d36b4f549f98916f300b561eade)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:45.225908 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9f7de6-6ef4-4f4f-bb00-3e238b569789 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:45.352982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ee9f7de6-6ef4-4f4f-bb00-3e238b569789 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4fa66d36b4f549f98916f300b561eade', 'request_id': 'req-ee9f7de6-6ef4-4f4f-bb00-3e238b569789'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:45.420899 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ee9f7de6-6ef4-4f4f-bb00-3e238b569789 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4fa66d36b4f549f98916f300b561eade', 'request_id': 'req-ee9f7de6-6ef4-4f4f-bb00-3e238b569789'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:45.427256 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ee9f7de6-6ef4-4f4f-bb00-3e238b569789 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4fa66d36b4f549f98916f300b561eade', 'request_id': 'req-ee9f7de6-6ef4-4f4f-bb00-3e238b569789'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:45.439245 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ee9f7de6-6ef4-4f4f-bb00-3e238b569789 admin admin] The token cache is being invalidate because project 4fa66d36b4f549f98916f300b561eade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:12:45.439537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ee9f7de6-6ef4-4f4f-bb00-3e238b569789 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:45.440173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ee9f7de6-6ef4-4f4f-bb00-3e238b569789 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:45.441661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1324/2606] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:12:45 2022] DELETE /identity/v3/projects/4fa66d36b4f549f98916f300b561eade => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:45.445676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205d195-7b98-4f31-9655-07e7a96a8a88 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:45.455924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5205d195-7b98-4f31-9655-07e7a96a8a88 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:45.513462 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20721cd3-53bc-4876-b381-988964f84744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:45.514197 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20721cd3-53bc-4876-b381-988964f84744 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:45.514443 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20721cd3-53bc-4876-b381-988964f84744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:45.514735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20721cd3-53bc-4876-b381-988964f84744 admin admin] PATH_INFO: `/v3/users/b944c23be6e24429b12c7c989611dab9` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:45.515860 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20721cd3-53bc-4876-b381-988964f84744 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b944c23be6e24429b12c7c989611dab9)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:45.518221 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20721cd3-53bc-4876-b381-988964f84744 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:45.541061 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:45.734473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-20721cd3-53bc-4876-b381-988964f84744 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b944c23be6e24429b12c7c989611dab9'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:45.806572 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-20721cd3-53bc-4876-b381-988964f84744 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b944c23be6e24429b12c7c989611dab9'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:45.819840 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-20721cd3-53bc-4876-b381-988964f84744 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b944c23be6e24429b12c7c989611dab9'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:45.820494 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-20721cd3-53bc-4876-b381-988964f84744 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b944c23be6e24429b12c7c989611dab9'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:45.827359 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-20721cd3-53bc-4876-b381-988964f84744 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b944c23be6e24429b12c7c989611dab9'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:45.833203 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1283/2607] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:12:45 2022] DELETE /identity/v3/users/b944c23be6e24429b12c7c989611dab9 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:46.286006 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f7de6-6ef4-4f4f-bb00-3e238b569789 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:46.287525 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ee9f7de6-6ef4-4f4f-bb00-3e238b569789 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:46.300650 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9f7de6-6ef4-4f4f-bb00-3e238b569789 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:46.358758 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9573f-7568-4a29-abdd-d4b50850202b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:46.359395 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9573f-7568-4a29-abdd-d4b50850202b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:46.359792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9573f-7568-4a29-abdd-d4b50850202b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:46.360065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9573f-7568-4a29-abdd-d4b50850202b admin admin] PATH_INFO: `/v3/projects/61f7e489eada4105a16a95dbdbfe7ca5` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:46.361277 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9573f-7568-4a29-abdd-d4b50850202b admin admin] RBAC: Authorizing `identity:delete_project(project_id=61f7e489eada4105a16a95dbdbfe7ca5)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:46.363553 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9573f-7568-4a29-abdd-d4b50850202b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:46.482385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-10e9573f-7568-4a29-abdd-d4b50850202b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61f7e489eada4105a16a95dbdbfe7ca5', 'request_id': 'req-10e9573f-7568-4a29-abdd-d4b50850202b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:46.572181 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-10e9573f-7568-4a29-abdd-d4b50850202b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61f7e489eada4105a16a95dbdbfe7ca5', 'request_id': 'req-10e9573f-7568-4a29-abdd-d4b50850202b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:46.578567 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-10e9573f-7568-4a29-abdd-d4b50850202b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61f7e489eada4105a16a95dbdbfe7ca5', 'request_id': 'req-10e9573f-7568-4a29-abdd-d4b50850202b'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:46.580409 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:46.590212 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-10e9573f-7568-4a29-abdd-d4b50850202b admin admin] The token cache is being invalidate because project 61f7e489eada4105a16a95dbdbfe7ca5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:12:46.590504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-10e9573f-7568-4a29-abdd-d4b50850202b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:46.591138 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-10e9573f-7568-4a29-abdd-d4b50850202b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:46.593276 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1325/2608] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:12:46 2022] DELETE /identity/v3/projects/61f7e489eada4105a16a95dbdbfe7ca5 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:46.598190 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eba714-d949-4f4d-b78d-939d7c5ac2a4 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:46.598906 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eba714-d949-4f4d-b78d-939d7c5ac2a4 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:46.598906 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eba714-d949-4f4d-b78d-939d7c5ac2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:46.618431 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-08eba714-d949-4f4d-b78d-939d7c5ac2a4 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:46.619644 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-08eba714-d949-4f4d-b78d-939d7c5ac2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:46.678475 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1284/2609] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:46.687015 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01398e69-19c4-441a-be24-c04449981e6e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:46.687357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01398e69-19c4-441a-be24-c04449981e6e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:46.687636 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01398e69-19c4-441a-be24-c04449981e6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:46.707764 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-01398e69-19c4-441a-be24-c04449981e6e None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:46.708948 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-01398e69-19c4-441a-be24-c04449981e6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:46.717622 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1326/2610] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:46.721896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eba714-d949-4f4d-b78d-939d7c5ac2a4 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:46.731389 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eba714-d949-4f4d-b78d-939d7c5ac2a4 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:46.735845 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1edb84-b726-4b35-98fb-22bf5065eb01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:46.736440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1edb84-b726-4b35-98fb-22bf5065eb01 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:46.736721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1edb84-b726-4b35-98fb-22bf5065eb01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:46.737234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1edb84-b726-4b35-98fb-22bf5065eb01 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:46.737974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1edb84-b726-4b35-98fb-22bf5065eb01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:12:46.738278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1edb84-b726-4b35-98fb-22bf5065eb01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:46.739886 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1edb84-b726-4b35-98fb-22bf5065eb01 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:46.752304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1285/2611] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:12:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:12:46.756798 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01398e69-19c4-441a-be24-c04449981e6e None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:46.766362 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01398e69-19c4-441a-be24-c04449981e6e None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:46.773117 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da5fdb-457c-409a-8a9b-c5c9c255f639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:46.776711 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da5fdb-457c-409a-8a9b-c5c9c255f639 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:46.776711 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da5fdb-457c-409a-8a9b-c5c9c255f639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:46.776711 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22da5fdb-457c-409a-8a9b-c5c9c255f639 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:46.776711 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da5fdb-457c-409a-8a9b-c5c9c255f639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:46.777105 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22da5fdb-457c-409a-8a9b-c5c9c255f639 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:46.859787 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1327/2612] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:12:46 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:12:46.863958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1edb84-b726-4b35-98fb-22bf5065eb01 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:46.874467 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1edb84-b726-4b35-98fb-22bf5065eb01 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:46.931252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fecf6a-fd38-466e-9a07-f199376df22d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:46.931898 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fecf6a-fd38-466e-9a07-f199376df22d admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:46.932180 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fecf6a-fd38-466e-9a07-f199376df22d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:46.932458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fecf6a-fd38-466e-9a07-f199376df22d admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:46.933117 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fecf6a-fd38-466e-9a07-f199376df22d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:46.935092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fecf6a-fd38-466e-9a07-f199376df22d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:47.018026 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1286/2613] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:12:46 2022] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:12:47.022365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da5fdb-457c-409a-8a9b-c5c9c255f639 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:47.032499 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22da5fdb-457c-409a-8a9b-c5c9c255f639 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:47.037102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742e035-f25b-47d9-ad4b-09d9e23ee477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:47.037713 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742e035-f25b-47d9-ad4b-09d9e23ee477 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:47.038008 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742e035-f25b-47d9-ad4b-09d9e23ee477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:47.038282 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7742e035-f25b-47d9-ad4b-09d9e23ee477 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:47.038915 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742e035-f25b-47d9-ad4b-09d9e23ee477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:47.040648 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7742e035-f25b-47d9-ad4b-09d9e23ee477 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:47.051177 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1328/2614] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:12:47.055184 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fecf6a-fd38-466e-9a07-f199376df22d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:47.065912 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fecf6a-fd38-466e-9a07-f199376df22d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:47.070685 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec63e2c-5514-4f08-af44-123a455f8fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:47.071297 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec63e2c-5514-4f08-af44-123a455f8fbf admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:47.071567 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec63e2c-5514-4f08-af44-123a455f8fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:47.071837 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec63e2c-5514-4f08-af44-123a455f8fbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:47.072503 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec63e2c-5514-4f08-af44-123a455f8fbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:47.074142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec63e2c-5514-4f08-af44-123a455f8fbf admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:47.088592 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1287/2615] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:12:47.089811 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742e035-f25b-47d9-ad4b-09d9e23ee477 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:47.100274 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7742e035-f25b-47d9-ad4b-09d9e23ee477 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:47.105048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71497881-6188-4ce3-9fda-1c211ef8a541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:47.105883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71497881-6188-4ce3-9fda-1c211ef8a541 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:47.106166 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71497881-6188-4ce3-9fda-1c211ef8a541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:47.106438 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71497881-6188-4ce3-9fda-1c211ef8a541 admin admin] PATH_INFO: `/v3/projects/fff651eaf36249b6aabd55327a6bdd09/users/f58d3339b9e5413c82d0c7afb3cf68f9/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:47.123276 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71497881-6188-4ce3-9fda-1c211ef8a541 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fff651eaf36249b6aabd55327a6bdd09, user_id=f58d3339b9e5413c82d0c7afb3cf68f9, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:47.126601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71497881-6188-4ce3-9fda-1c211ef8a541 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:47.194628 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1329/2616] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:12:47 2022] PUT /identity/v3/projects/fff651eaf36249b6aabd55327a6bdd09/users/f58d3339b9e5413c82d0c7afb3cf68f9/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:47.206223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c8d8a-fae0-487b-9a27-6e56949955a1 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:47.206509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c8d8a-fae0-487b-9a27-6e56949955a1 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:47.206781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c8d8a-fae0-487b-9a27-6e56949955a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:47.220066 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:47.236519 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-482c8d8a-fae0-487b-9a27-6e56949955a1 None None] MFA Rules not processed for user `f58d3339b9e5413c82d0c7afb3cf68f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:47.237881 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-482c8d8a-fae0-487b-9a27-6e56949955a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:47.301661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1288/2617] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:47.306382 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71497881-6188-4ce3-9fda-1c211ef8a541 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:47.368209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71497881-6188-4ce3-9fda-1c211ef8a541 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:47.372738 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770868db-c622-45e2-b9d2-0d3ddb7097e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:47.373339 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770868db-c622-45e2-b9d2-0d3ddb7097e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:47.376470 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770868db-c622-45e2-b9d2-0d3ddb7097e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:47.376470 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770868db-c622-45e2-b9d2-0d3ddb7097e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:47.376470 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770868db-c622-45e2-b9d2-0d3ddb7097e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:47.377089 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770868db-c622-45e2-b9d2-0d3ddb7097e3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:47.495283 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1330/2618] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:12:47 2022] POST /identity/v3/projects => generated 383 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:12:47.499911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c8d8a-fae0-487b-9a27-6e56949955a1 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:47.510575 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c8d8a-fae0-487b-9a27-6e56949955a1 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:47.569927 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5de30d-9e31-4374-89b1-96f57b693d73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:47.569927 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5de30d-9e31-4374-89b1-96f57b693d73 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:47.569927 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5de30d-9e31-4374-89b1-96f57b693d73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:47.569927 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5de30d-9e31-4374-89b1-96f57b693d73 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:47.570333 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5de30d-9e31-4374-89b1-96f57b693d73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:47.572151 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5de30d-9e31-4374-89b1-96f57b693d73 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:47.674416 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1289/2619] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:12:47 2022] POST /identity/v3/users => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:12:47.676636 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770868db-c622-45e2-b9d2-0d3ddb7097e3 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:47.687734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770868db-c622-45e2-b9d2-0d3ddb7097e3 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:47.692542 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28021ea-2fd3-41bd-af88-4469eeeae87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:47.693127 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28021ea-2fd3-41bd-af88-4469eeeae87d admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:47.693425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28021ea-2fd3-41bd-af88-4469eeeae87d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:47.693708 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28021ea-2fd3-41bd-af88-4469eeeae87d admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:47.694366 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28021ea-2fd3-41bd-af88-4469eeeae87d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:47.695987 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28021ea-2fd3-41bd-af88-4469eeeae87d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:47.709897 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1331/2620] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:12:47.711236 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5de30d-9e31-4374-89b1-96f57b693d73 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:47.723440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5de30d-9e31-4374-89b1-96f57b693d73 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:47.728180 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc53d2f-1d5e-4a5e-9600-20b794cc6044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:47.728906 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc53d2f-1d5e-4a5e-9600-20b794cc6044 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:47.729256 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc53d2f-1d5e-4a5e-9600-20b794cc6044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:47.729599 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc53d2f-1d5e-4a5e-9600-20b794cc6044 admin admin] PATH_INFO: `/v3/projects/21915075588343abaf061999ff9e7936/users/10d8223b0e3a47c89e5735cb54aba773/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:47.750328 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc53d2f-1d5e-4a5e-9600-20b794cc6044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21915075588343abaf061999ff9e7936, user_id=10d8223b0e3a47c89e5735cb54aba773, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:47.753228 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc53d2f-1d5e-4a5e-9600-20b794cc6044 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:47.762751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28021ea-2fd3-41bd-af88-4469eeeae87d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:47.765023 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c28021ea-2fd3-41bd-af88-4469eeeae87d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:47.778244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28021ea-2fd3-41bd-af88-4469eeeae87d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:47.784244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3c3aea-bb0e-4809-b9c6-baed9a1cfd6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:47.784244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c3aea-bb0e-4809-b9c6-baed9a1cfd6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:47.784244 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c3aea-bb0e-4809-b9c6-baed9a1cfd6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:47.784639 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3c3aea-bb0e-4809-b9c6-baed9a1cfd6b admin admin] PATH_INFO: `/v3/users/37c1c7620dab4f3eb968388f3a758890` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:47.785775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c3aea-bb0e-4809-b9c6-baed9a1cfd6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=37c1c7620dab4f3eb968388f3a758890)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:47.787667 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3c3aea-bb0e-4809-b9c6-baed9a1cfd6b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:47.833646 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1290/2621] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:12:47 2022] PUT /identity/v3/projects/21915075588343abaf061999ff9e7936/users/10d8223b0e3a47c89e5735cb54aba773/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:47.840712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc53d2f-1d5e-4a5e-9600-20b794cc6044 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:47.901334 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc53d2f-1d5e-4a5e-9600-20b794cc6044 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:47.906607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc37577-0b53-4a3e-9fa6-982fa124b6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:47.907220 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc37577-0b53-4a3e-9fa6-982fa124b6ff admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:47.907503 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc37577-0b53-4a3e-9fa6-982fa124b6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:47.907785 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc37577-0b53-4a3e-9fa6-982fa124b6ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:47.908430 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc37577-0b53-4a3e-9fa6-982fa124b6ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:47.910087 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc37577-0b53-4a3e-9fa6-982fa124b6ff admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:47.912318 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:47.920450 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1291/2622] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:47 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:12:47.924478 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc37577-0b53-4a3e-9fa6-982fa124b6ff admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:47.933775 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc37577-0b53-4a3e-9fa6-982fa124b6ff admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:47.938397 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5d029-46aa-4fa9-b7ae-921c7facba55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:47.939023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5d029-46aa-4fa9-b7ae-921c7facba55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:47.942751 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5d029-46aa-4fa9-b7ae-921c7facba55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:47.942751 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5d029-46aa-4fa9-b7ae-921c7facba55 admin admin] PATH_INFO: `/v3/projects/21915075588343abaf061999ff9e7936/users/10d8223b0e3a47c89e5735cb54aba773/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:47.942751 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5d029-46aa-4fa9-b7ae-921c7facba55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21915075588343abaf061999ff9e7936, user_id=10d8223b0e3a47c89e5735cb54aba773, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:47.944113 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5d029-46aa-4fa9-b7ae-921c7facba55 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:47.955294 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1292/2623] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:12:47 2022] PUT /identity/v3/projects/21915075588343abaf061999ff9e7936/users/10d8223b0e3a47c89e5735cb54aba773/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:12:47.965845 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45949112-4943-4c72-a4ac-dd971ed8c928 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:47.966205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45949112-4943-4c72-a4ac-dd971ed8c928 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:47.966679 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45949112-4943-4c72-a4ac-dd971ed8c928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:47.994705 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-45949112-4943-4c72-a4ac-dd971ed8c928 None None] MFA Rules not processed for user `10d8223b0e3a47c89e5735cb54aba773`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:47.995911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-45949112-4943-4c72-a4ac-dd971ed8c928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:48.009398 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cd3c3aea-bb0e-4809-b9c6-baed9a1cfd6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37c1c7620dab4f3eb968388f3a758890'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:48.064958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1293/2624] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:47 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:48.077259 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45949112-4943-4c72-a4ac-dd971ed8c928 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:48.080006 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-45949112-4943-4c72-a4ac-dd971ed8c928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:48.084133 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cd3c3aea-bb0e-4809-b9c6-baed9a1cfd6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37c1c7620dab4f3eb968388f3a758890'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:48.090339 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:48.098271 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cd3c3aea-bb0e-4809-b9c6-baed9a1cfd6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37c1c7620dab4f3eb968388f3a758890'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:48.099389 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cd3c3aea-bb0e-4809-b9c6-baed9a1cfd6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37c1c7620dab4f3eb968388f3a758890'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:48.106978 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-cd3c3aea-bb0e-4809-b9c6-baed9a1cfd6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37c1c7620dab4f3eb968388f3a758890'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:48.112880 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1332/2625] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:12:47 2022] DELETE /identity/v3/users/37c1c7620dab4f3eb968388f3a758890 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:48.117218 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270c556-6d2e-41e5-95c2-d93bf3ae55ca None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:48.117511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270c556-6d2e-41e5-95c2-d93bf3ae55ca None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:48.117810 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e270c556-6d2e-41e5-95c2-d93bf3ae55ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:48.136598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-e270c556-6d2e-41e5-95c2-d93bf3ae55ca None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:48.137183 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45949112-4943-4c72-a4ac-dd971ed8c928 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:48.137806 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e270c556-6d2e-41e5-95c2-d93bf3ae55ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:48.189767 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ebdf9-cf46-4a04-b767-d51299b19c7d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:48.190310 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ebdf9-cf46-4a04-b767-d51299b19c7d service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:48.190618 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ebdf9-cf46-4a04-b767-d51299b19c7d service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:48.190897 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ebdf9-cf46-4a04-b767-d51299b19c7d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:48.192673 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-362ebdf9-cf46-4a04-b767-d51299b19c7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:48.199533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1333/2626] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:12:48.210862 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270c556-6d2e-41e5-95c2-d93bf3ae55ca None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:48.212192 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e270c556-6d2e-41e5-95c2-d93bf3ae55ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:48.234959 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:48.259520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ebdf9-cf46-4a04-b767-d51299b19c7d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:48.261443 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362ebdf9-cf46-4a04-b767-d51299b19c7d service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:48.276703 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e270c556-6d2e-41e5-95c2-d93bf3ae55ca None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:48.277804 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1294/2627] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:12:48.281207 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72d11f-7165-4051-b5ae-5f226354ccc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:48.281911 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72d11f-7165-4051-b5ae-5f226354ccc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:48.285337 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72d11f-7165-4051-b5ae-5f226354ccc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:48.285337 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad72d11f-7165-4051-b5ae-5f226354ccc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:48.293563 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72d11f-7165-4051-b5ae-5f226354ccc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:48.295302 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad72d11f-7165-4051-b5ae-5f226354ccc8 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:48.307803 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1334/2628] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:12:48.430313 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ebdf9-cf46-4a04-b767-d51299b19c7d service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:48.431719 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-362ebdf9-cf46-4a04-b767-d51299b19c7d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:48.442392 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ebdf9-cf46-4a04-b767-d51299b19c7d service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:48.445963 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c86b8-5ea9-455e-80b3-afcbac633c37 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:48.446562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c86b8-5ea9-455e-80b3-afcbac633c37 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:48.446840 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c86b8-5ea9-455e-80b3-afcbac633c37 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:48.447114 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c86b8-5ea9-455e-80b3-afcbac633c37 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:48.448876 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-fb6c86b8-5ea9-455e-80b3-afcbac633c37 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:48.513160 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c86b8-5ea9-455e-80b3-afcbac633c37 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:48.515193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c86b8-5ea9-455e-80b3-afcbac633c37 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:48.525664 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1295/2629] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:12:48.712110 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72d11f-7165-4051-b5ae-5f226354ccc8 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:48.713604 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ad72d11f-7165-4051-b5ae-5f226354ccc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:48.728590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad72d11f-7165-4051-b5ae-5f226354ccc8 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:48.733353 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258dadd-7447-4080-b3f7-b2e1420e32ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:48.734025 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258dadd-7447-4080-b3f7-b2e1420e32ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:48.734302 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258dadd-7447-4080-b3f7-b2e1420e32ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:48.734570 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c258dadd-7447-4080-b3f7-b2e1420e32ae admin admin] PATH_INFO: `/v3/projects/eb47df9414d147e8b7fbb3a88e00614b` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:48.735686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258dadd-7447-4080-b3f7-b2e1420e32ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb47df9414d147e8b7fbb3a88e00614b)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:48.737629 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c258dadd-7447-4080-b3f7-b2e1420e32ae admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:48.841776 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c258dadd-7447-4080-b3f7-b2e1420e32ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb47df9414d147e8b7fbb3a88e00614b', 'request_id': 'req-c258dadd-7447-4080-b3f7-b2e1420e32ae'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:48.949542 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c258dadd-7447-4080-b3f7-b2e1420e32ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb47df9414d147e8b7fbb3a88e00614b', 'request_id': 'req-c258dadd-7447-4080-b3f7-b2e1420e32ae'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:48.956269 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c258dadd-7447-4080-b3f7-b2e1420e32ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb47df9414d147e8b7fbb3a88e00614b', 'request_id': 'req-c258dadd-7447-4080-b3f7-b2e1420e32ae'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:48.967979 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c258dadd-7447-4080-b3f7-b2e1420e32ae admin admin] The token cache is being invalidate because project eb47df9414d147e8b7fbb3a88e00614b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:12:48.968257 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c258dadd-7447-4080-b3f7-b2e1420e32ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:48.968893 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-c258dadd-7447-4080-b3f7-b2e1420e32ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:48.970418 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1335/2630] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:12:48 2022] DELETE /identity/v3/projects/eb47df9414d147e8b7fbb3a88e00614b => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:48.974453 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c86b8-5ea9-455e-80b3-afcbac633c37 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:48.985789 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c86b8-5ea9-455e-80b3-afcbac633c37 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:49.042211 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9aba37-39ce-4619-96a9-83c202e450bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:49.042844 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9aba37-39ce-4619-96a9-83c202e450bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:49.043128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9aba37-39ce-4619-96a9-83c202e450bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:49.043415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9aba37-39ce-4619-96a9-83c202e450bc admin admin] PATH_INFO: `/v3/users/b973f848a2e14bd5b3900caf435aa658` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:49.044519 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9aba37-39ce-4619-96a9-83c202e450bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=b973f848a2e14bd5b3900caf435aa658)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:49.046517 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9aba37-39ce-4619-96a9-83c202e450bc admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:49.086871 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258dadd-7447-4080-b3f7-b2e1420e32ae admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:49.088385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-c258dadd-7447-4080-b3f7-b2e1420e32ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:49.097437 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:49.101120 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c258dadd-7447-4080-b3f7-b2e1420e32ae admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:49.105657 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bc963-b082-47f7-9a7a-bcf03b1af049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:49.106316 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bc963-b082-47f7-9a7a-bcf03b1af049 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:49.106592 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bc963-b082-47f7-9a7a-bcf03b1af049 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:49.106860 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9bc963-b082-47f7-9a7a-bcf03b1af049 admin admin] PATH_INFO: `/v3/users/f58d3339b9e5413c82d0c7afb3cf68f9` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:49.107990 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9bc963-b082-47f7-9a7a-bcf03b1af049 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f58d3339b9e5413c82d0c7afb3cf68f9)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:49.109910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9bc963-b082-47f7-9a7a-bcf03b1af049 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:49.266164 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9d9aba37-39ce-4619-96a9-83c202e450bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b973f848a2e14bd5b3900caf435aa658'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:49.324361 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2d9bc963-b082-47f7-9a7a-bcf03b1af049 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f58d3339b9e5413c82d0c7afb3cf68f9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:49.338300 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9d9aba37-39ce-4619-96a9-83c202e450bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b973f848a2e14bd5b3900caf435aa658'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:49.351648 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9d9aba37-39ce-4619-96a9-83c202e450bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b973f848a2e14bd5b3900caf435aa658'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:49.352313 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9d9aba37-39ce-4619-96a9-83c202e450bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b973f848a2e14bd5b3900caf435aa658'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:49.356931 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:49.360360 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9d9aba37-39ce-4619-96a9-83c202e450bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b973f848a2e14bd5b3900caf435aa658'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:49.371142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1296/2631] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:12:48 2022] DELETE /identity/v3/users/b973f848a2e14bd5b3900caf435aa658 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:49.418159 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2d9bc963-b082-47f7-9a7a-bcf03b1af049 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f58d3339b9e5413c82d0c7afb3cf68f9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:49.433062 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2d9bc963-b082-47f7-9a7a-bcf03b1af049 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f58d3339b9e5413c82d0c7afb3cf68f9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:49.434538 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2d9bc963-b082-47f7-9a7a-bcf03b1af049 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f58d3339b9e5413c82d0c7afb3cf68f9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:49.442692 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-2d9bc963-b082-47f7-9a7a-bcf03b1af049 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f58d3339b9e5413c82d0c7afb3cf68f9'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:49.449548 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1336/2632] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:12:49 2022] DELETE /identity/v3/users/f58d3339b9e5413c82d0c7afb3cf68f9 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:12:49.455042 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e34de-a7b2-4891-88e9-b831d36db2e6 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:49.457941 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e34de-a7b2-4891-88e9-b831d36db2e6 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:49.457941 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e34de-a7b2-4891-88e9-b831d36db2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:49.598016 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-711e34de-a7b2-4891-88e9-b831d36db2e6 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:49.599239 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-711e34de-a7b2-4891-88e9-b831d36db2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:49.669872 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1297/2633] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:49.670712 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bc963-b082-47f7-9a7a-bcf03b1af049 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:49.672744 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2d9bc963-b082-47f7-9a7a-bcf03b1af049 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:49.732411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9bc963-b082-47f7-9a7a-bcf03b1af049 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:49.736660 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98654d-a988-4872-9192-91b580572858 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:49.737260 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98654d-a988-4872-9192-91b580572858 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:49.737544 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98654d-a988-4872-9192-91b580572858 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:49.737852 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa98654d-a988-4872-9192-91b580572858 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:49.747365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98654d-a988-4872-9192-91b580572858 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:49.748834 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa98654d-a988-4872-9192-91b580572858 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:49.758696 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1337/2634] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:12:49.780768 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e34de-a7b2-4891-88e9-b831d36db2e6 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:49.782386 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-711e34de-a7b2-4891-88e9-b831d36db2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:49.805580 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e34de-a7b2-4891-88e9-b831d36db2e6 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:49.810384 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20782c-faa8-4a85-9316-00880d6e8343 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:49.810889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20782c-faa8-4a85-9316-00880d6e8343 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:49.811158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20782c-faa8-4a85-9316-00880d6e8343 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:49.811809 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d20782c-faa8-4a85-9316-00880d6e8343 admin admin] PATH_INFO: `/v3/projects/091495ac7f8d4edabff92063074b0cfe` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:49.812626 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20782c-faa8-4a85-9316-00880d6e8343 admin admin] RBAC: Authorizing `identity:delete_project(project_id=091495ac7f8d4edabff92063074b0cfe)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:49.814618 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d20782c-faa8-4a85-9316-00880d6e8343 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:49.994198 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1d20782c-faa8-4a85-9316-00880d6e8343 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '091495ac7f8d4edabff92063074b0cfe', 'request_id': 'req-1d20782c-faa8-4a85-9316-00880d6e8343'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:50.000905 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1d20782c-faa8-4a85-9316-00880d6e8343 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '091495ac7f8d4edabff92063074b0cfe', 'request_id': 'req-1d20782c-faa8-4a85-9316-00880d6e8343'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:50.008278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1d20782c-faa8-4a85-9316-00880d6e8343 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '091495ac7f8d4edabff92063074b0cfe', 'request_id': 'req-1d20782c-faa8-4a85-9316-00880d6e8343'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:50.093633 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1d20782c-faa8-4a85-9316-00880d6e8343 admin admin] The token cache is being invalidate because project 091495ac7f8d4edabff92063074b0cfe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:12:50.094229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1d20782c-faa8-4a85-9316-00880d6e8343 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:50.096381 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1d20782c-faa8-4a85-9316-00880d6e8343 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:50.099350 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1298/2635] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:12:49 2022] DELETE /identity/v3/projects/091495ac7f8d4edabff92063074b0cfe => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:12:50.104794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98654d-a988-4872-9192-91b580572858 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:50.123943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa98654d-a988-4872-9192-91b580572858 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:50.193445 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d1fca-8161-4f0d-a9da-3d155dc298b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:50.194101 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d1fca-8161-4f0d-a9da-3d155dc298b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:50.194380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d1fca-8161-4f0d-a9da-3d155dc298b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:50.194651 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d1fca-8161-4f0d-a9da-3d155dc298b5 admin admin] PATH_INFO: `/v3/users/75e643ad8b35435ab6d27fb996bf198a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:50.195771 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d1fca-8161-4f0d-a9da-3d155dc298b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75e643ad8b35435ab6d27fb996bf198a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:50.197733 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d1fca-8161-4f0d-a9da-3d155dc298b5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:50.220035 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:50.316080 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20782c-faa8-4a85-9316-00880d6e8343 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:50.316080 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1d20782c-faa8-4a85-9316-00880d6e8343 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:50.330292 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d20782c-faa8-4a85-9316-00880d6e8343 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:50.336246 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21e644-8aec-477b-98b7-c06a855e9b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:50.339477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21e644-8aec-477b-98b7-c06a855e9b9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:50.339477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21e644-8aec-477b-98b7-c06a855e9b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:50.339477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e21e644-8aec-477b-98b7-c06a855e9b9c admin admin] PATH_INFO: `/v3/projects/fff651eaf36249b6aabd55327a6bdd09` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:50.339477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21e644-8aec-477b-98b7-c06a855e9b9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fff651eaf36249b6aabd55327a6bdd09)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:50.341186 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e21e644-8aec-477b-98b7-c06a855e9b9c admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:50.459324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-502d1fca-8161-4f0d-a9da-3d155dc298b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75e643ad8b35435ab6d27fb996bf198a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:50.462883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4e21e644-8aec-477b-98b7-c06a855e9b9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fff651eaf36249b6aabd55327a6bdd09', 'request_id': 'req-4e21e644-8aec-477b-98b7-c06a855e9b9c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:50.468628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4e21e644-8aec-477b-98b7-c06a855e9b9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fff651eaf36249b6aabd55327a6bdd09', 'request_id': 'req-4e21e644-8aec-477b-98b7-c06a855e9b9c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:50.475649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4e21e644-8aec-477b-98b7-c06a855e9b9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fff651eaf36249b6aabd55327a6bdd09', 'request_id': 'req-4e21e644-8aec-477b-98b7-c06a855e9b9c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:50.592921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-502d1fca-8161-4f0d-a9da-3d155dc298b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75e643ad8b35435ab6d27fb996bf198a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:50.606486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-502d1fca-8161-4f0d-a9da-3d155dc298b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75e643ad8b35435ab6d27fb996bf198a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:50.607167 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-502d1fca-8161-4f0d-a9da-3d155dc298b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75e643ad8b35435ab6d27fb996bf198a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:50.618297 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-502d1fca-8161-4f0d-a9da-3d155dc298b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75e643ad8b35435ab6d27fb996bf198a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:50.624146 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1338/2636] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:12:50 2022] DELETE /identity/v3/users/75e643ad8b35435ab6d27fb996bf198a => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:50.703809 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:50.707930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4e21e644-8aec-477b-98b7-c06a855e9b9c admin admin] The token cache is being invalidate because project fff651eaf36249b6aabd55327a6bdd09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:12:50.708283 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4e21e644-8aec-477b-98b7-c06a855e9b9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:50.708950 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4e21e644-8aec-477b-98b7-c06a855e9b9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:50.710735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1299/2637] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:12:50 2022] DELETE /identity/v3/projects/fff651eaf36249b6aabd55327a6bdd09 => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:12:50.714656 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d1fca-8161-4f0d-a9da-3d155dc298b5 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:50.716096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-502d1fca-8161-4f0d-a9da-3d155dc298b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:50.780220 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d1fca-8161-4f0d-a9da-3d155dc298b5 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:50.785637 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138d824-2efa-459e-bfec-ff8c9dd5abd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:50.786309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138d824-2efa-459e-bfec-ff8c9dd5abd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:50.786590 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138d824-2efa-459e-bfec-ff8c9dd5abd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:50.786867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138d824-2efa-459e-bfec-ff8c9dd5abd1 admin admin] PATH_INFO: `/v3/users/10d8223b0e3a47c89e5735cb54aba773` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:50.788023 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138d824-2efa-459e-bfec-ff8c9dd5abd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10d8223b0e3a47c89e5735cb54aba773)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:50.789968 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138d824-2efa-459e-bfec-ff8c9dd5abd1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:51.012129 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a138d824-2efa-459e-bfec-ff8c9dd5abd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10d8223b0e3a47c89e5735cb54aba773'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:51.062495 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21e644-8aec-477b-98b7-c06a855e9b9c admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:51.063964 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4e21e644-8aec-477b-98b7-c06a855e9b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:51.079184 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a138d824-2efa-459e-bfec-ff8c9dd5abd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10d8223b0e3a47c89e5735cb54aba773'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:51.093353 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a138d824-2efa-459e-bfec-ff8c9dd5abd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10d8223b0e3a47c89e5735cb54aba773'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:51.094597 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a138d824-2efa-459e-bfec-ff8c9dd5abd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10d8223b0e3a47c89e5735cb54aba773'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:51.102206 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a138d824-2efa-459e-bfec-ff8c9dd5abd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10d8223b0e3a47c89e5735cb54aba773'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:51.108225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1339/2638] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:12:50 2022] DELETE /identity/v3/users/10d8223b0e3a47c89e5735cb54aba773 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:12:51.144392 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e21e644-8aec-477b-98b7-c06a855e9b9c admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:51.218763 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31214b4d-3f3d-4463-90aa-2d532537765d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:51.219500 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31214b4d-3f3d-4463-90aa-2d532537765d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:51.219766 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31214b4d-3f3d-4463-90aa-2d532537765d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:51.220040 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31214b4d-3f3d-4463-90aa-2d532537765d admin admin] PATH_INFO: `/v3/projects/c8ed9fb0819c40b78ef49edcdefc4c9e` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:51.221295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31214b4d-3f3d-4463-90aa-2d532537765d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8ed9fb0819c40b78ef49edcdefc4c9e)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:51.223135 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31214b4d-3f3d-4463-90aa-2d532537765d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:51.320537 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-31214b4d-3f3d-4463-90aa-2d532537765d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8ed9fb0819c40b78ef49edcdefc4c9e', 'request_id': 'req-31214b4d-3f3d-4463-90aa-2d532537765d'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:51.327269 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-31214b4d-3f3d-4463-90aa-2d532537765d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8ed9fb0819c40b78ef49edcdefc4c9e', 'request_id': 'req-31214b4d-3f3d-4463-90aa-2d532537765d'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:51.336029 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-31214b4d-3f3d-4463-90aa-2d532537765d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8ed9fb0819c40b78ef49edcdefc4c9e', 'request_id': 'req-31214b4d-3f3d-4463-90aa-2d532537765d'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:51.418169 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-31214b4d-3f3d-4463-90aa-2d532537765d admin admin] The token cache is being invalidate because project c8ed9fb0819c40b78ef49edcdefc4c9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:12:51.418455 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-31214b4d-3f3d-4463-90aa-2d532537765d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:51.419086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-31214b4d-3f3d-4463-90aa-2d532537765d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:51.420767 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1300/2639] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:12:51 2022] DELETE /identity/v3/projects/c8ed9fb0819c40b78ef49edcdefc4c9e => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:12:51.427086 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ca8ce-11ad-42f4-ad2e-8b864abfc64d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:51.427424 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ca8ce-11ad-42f4-ad2e-8b864abfc64d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:51.427706 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7ca8ce-11ad-42f4-ad2e-8b864abfc64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:51.449792 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2b7ca8ce-11ad-42f4-ad2e-8b864abfc64d None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:51.451085 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2b7ca8ce-11ad-42f4-ad2e-8b864abfc64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:51.465739 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:51.517249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1340/2640] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:51.526876 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f53df-f2fb-4382-913a-478461dcf6e5 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:51.527169 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f53df-f2fb-4382-913a-478461dcf6e5 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:51.527445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0f53df-f2fb-4382-913a-478461dcf6e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:51.547617 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-cd0f53df-f2fb-4382-913a-478461dcf6e5 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:51.548706 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-cd0f53df-f2fb-4382-913a-478461dcf6e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:51.555430 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ca8ce-11ad-42f4-ad2e-8b864abfc64d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:51.557031 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2b7ca8ce-11ad-42f4-ad2e-8b864abfc64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:51.564686 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1301/2641] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:51.574144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7ca8ce-11ad-42f4-ad2e-8b864abfc64d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:51.582377 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707067f8-a727-4b6c-9257-72b381ebadce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:51.582654 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f53df-f2fb-4382-913a-478461dcf6e5 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:51.583034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707067f8-a727-4b6c-9257-72b381ebadce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:51.583315 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707067f8-a727-4b6c-9257-72b381ebadce admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:51.583591 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707067f8-a727-4b6c-9257-72b381ebadce admin admin] PATH_INFO: `/v3/projects/21915075588343abaf061999ff9e7936` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:51.584754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707067f8-a727-4b6c-9257-72b381ebadce admin admin] RBAC: Authorizing `identity:delete_project(project_id=21915075588343abaf061999ff9e7936)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:51.587196 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707067f8-a727-4b6c-9257-72b381ebadce admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:51.597790 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0f53df-f2fb-4382-913a-478461dcf6e5 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:51.601928 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18117d7-3c45-4d83-8500-1f8665935340 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:51.602598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18117d7-3c45-4d83-8500-1f8665935340 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:51.602903 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18117d7-3c45-4d83-8500-1f8665935340 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:51.603156 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18117d7-3c45-4d83-8500-1f8665935340 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:51.603875 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18117d7-3c45-4d83-8500-1f8665935340 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:12:51.604186 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18117d7-3c45-4d83-8500-1f8665935340 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:51.606086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18117d7-3c45-4d83-8500-1f8665935340 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:51.622716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1302/2642] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:12:51.628000 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18117d7-3c45-4d83-8500-1f8665935340 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:51.638929 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18117d7-3c45-4d83-8500-1f8665935340 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:51.646375 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058afeeb-c795-46d0-baca-6bac7d383f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:51.647159 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058afeeb-c795-46d0-baca-6bac7d383f41 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:51.647502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058afeeb-c795-46d0-baca-6bac7d383f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:51.647838 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058afeeb-c795-46d0-baca-6bac7d383f41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:51.648553 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058afeeb-c795-46d0-baca-6bac7d383f41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:51.650751 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058afeeb-c795-46d0-baca-6bac7d383f41 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:51.667930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:51.723398 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-707067f8-a727-4b6c-9257-72b381ebadce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21915075588343abaf061999ff9e7936', 'request_id': 'req-707067f8-a727-4b6c-9257-72b381ebadce'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:51.775248 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1303/2643] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:12:51 2022] POST /identity/v3/projects => generated 401 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:12:51.779494 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058afeeb-c795-46d0-baca-6bac7d383f41 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:51.796093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-707067f8-a727-4b6c-9257-72b381ebadce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21915075588343abaf061999ff9e7936', 'request_id': 'req-707067f8-a727-4b6c-9257-72b381ebadce'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:51.809467 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-707067f8-a727-4b6c-9257-72b381ebadce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21915075588343abaf061999ff9e7936', 'request_id': 'req-707067f8-a727-4b6c-9257-72b381ebadce'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:51.816659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-707067f8-a727-4b6c-9257-72b381ebadce admin admin] The token cache is being invalidate because project 21915075588343abaf061999ff9e7936 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:12:51.817025 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-707067f8-a727-4b6c-9257-72b381ebadce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:51.817785 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-707067f8-a727-4b6c-9257-72b381ebadce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:51.819575 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1341/2644] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:12:51 2022] DELETE /identity/v3/projects/21915075588343abaf061999ff9e7936 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:12:51.825119 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c6ee5-89a5-4ec7-8a04-c69caa10d4c0 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:51.825477 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c6ee5-89a5-4ec7-8a04-c69caa10d4c0 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:51.825984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084c6ee5-89a5-4ec7-8a04-c69caa10d4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:51.849260 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-084c6ee5-89a5-4ec7-8a04-c69caa10d4c0 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:51.850483 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-084c6ee5-89a5-4ec7-8a04-c69caa10d4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:51.870451 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058afeeb-c795-46d0-baca-6bac7d383f41 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:51.900201 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f969806-7a45-46ef-973e-b712a7f2b008 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:51.900201 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f969806-7a45-46ef-973e-b712a7f2b008 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:51.900201 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f969806-7a45-46ef-973e-b712a7f2b008 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:51.900201 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f969806-7a45-46ef-973e-b712a7f2b008 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:51.901158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f969806-7a45-46ef-973e-b712a7f2b008 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:51.901158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f969806-7a45-46ef-973e-b712a7f2b008 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:51.927222 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1342/2645] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:12:51.934977 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a4ab0-4240-4ced-af18-4bc24cfb6583 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:51.935450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a4ab0-4240-4ced-af18-4bc24cfb6583 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:51.935821 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048a4ab0-4240-4ced-af18-4bc24cfb6583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:51.956818 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-048a4ab0-4240-4ced-af18-4bc24cfb6583 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:51.958036 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-048a4ab0-4240-4ced-af18-4bc24cfb6583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:51.966097 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1343/2646] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:12:51.970584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a4ab0-4240-4ced-af18-4bc24cfb6583 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:51.979262 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048a4ab0-4240-4ced-af18-4bc24cfb6583 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:51.983791 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3aa6ea-2fba-47e6-a676-2dd94403b4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:51.984337 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3aa6ea-2fba-47e6-a676-2dd94403b4b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:51.984725 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3aa6ea-2fba-47e6-a676-2dd94403b4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:51.985445 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3aa6ea-2fba-47e6-a676-2dd94403b4b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:51.986160 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3aa6ea-2fba-47e6-a676-2dd94403b4b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:12:51.986468 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3aa6ea-2fba-47e6-a676-2dd94403b4b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:51.988088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3aa6ea-2fba-47e6-a676-2dd94403b4b1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:52.000174 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1344/2647] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:12:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:12:52.004313 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3aa6ea-2fba-47e6-a676-2dd94403b4b1 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:52.008969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1304/2648] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:12:51 2022] POST /identity/v3/users => generated 301 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:12:52.009091 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f969806-7a45-46ef-973e-b712a7f2b008 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:52.010696 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-0f969806-7a45-46ef-973e-b712a7f2b008 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:52.014409 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3aa6ea-2fba-47e6-a676-2dd94403b4b1 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:52.019006 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b5be5-26df-4818-bcbc-9d832963909b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:52.019582 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b5be5-26df-4818-bcbc-9d832963909b admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:52.019859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b5be5-26df-4818-bcbc-9d832963909b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:52.020130 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287b5be5-26df-4818-bcbc-9d832963909b admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:52.020742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b5be5-26df-4818-bcbc-9d832963909b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:52.022668 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f969806-7a45-46ef-973e-b712a7f2b008 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:52.028770 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287b5be5-26df-4818-bcbc-9d832963909b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:52.028905 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4e2de-980e-4ba5-87c1-9d1939c82bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:52.028905 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4e2de-980e-4ba5-87c1-9d1939c82bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:52.028905 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4e2de-980e-4ba5-87c1-9d1939c82bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:52.028905 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a4e2de-980e-4ba5-87c1-9d1939c82bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:52.029266 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4e2de-980e-4ba5-87c1-9d1939c82bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:52.030500 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a4e2de-980e-4ba5-87c1-9d1939c82bd3 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:52.040924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1305/2649] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:12:52.044897 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4e2de-980e-4ba5-87c1-9d1939c82bd3 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:52.056806 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a4e2de-980e-4ba5-87c1-9d1939c82bd3 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:52.061391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ab622-c68c-400b-b493-b79b3099ef24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:52.062015 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ab622-c68c-400b-b493-b79b3099ef24 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:52.062311 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ab622-c68c-400b-b493-b79b3099ef24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:52.062655 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0ab622-c68c-400b-b493-b79b3099ef24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:52.063300 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ab622-c68c-400b-b493-b79b3099ef24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:52.065016 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0ab622-c68c-400b-b493-b79b3099ef24 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:52.076479 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1306/2650] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:12:52.080626 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ab622-c68c-400b-b493-b79b3099ef24 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:52.090215 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0ab622-c68c-400b-b493-b79b3099ef24 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:52.091370 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:52.095481 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6375b6c-abcd-4f6d-a971-2779ac5a91ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:52.096097 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6375b6c-abcd-4f6d-a971-2779ac5a91ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:52.096373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6375b6c-abcd-4f6d-a971-2779ac5a91ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:52.101436 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6375b6c-abcd-4f6d-a971-2779ac5a91ab admin admin] PATH_INFO: `/v3/projects/2ebb11d21a0b4a1f91f2453554b3b1d2/users/503aa2a491a04f8485acd8139a8e8567/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:52.101579 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1345/2651] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:12:52 2022] POST /identity/v3/projects => generated 375 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:12:52.104003 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b5be5-26df-4818-bcbc-9d832963909b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:52.114079 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6375b6c-abcd-4f6d-a971-2779ac5a91ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ebb11d21a0b4a1f91f2453554b3b1d2, user_id=503aa2a491a04f8485acd8139a8e8567, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:52.116742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6375b6c-abcd-4f6d-a971-2779ac5a91ab admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:52.163932 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287b5be5-26df-4818-bcbc-9d832963909b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:52.168626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8f6e0-1157-402e-8622-e7681c0b3fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:52.169219 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8f6e0-1157-402e-8622-e7681c0b3fbf admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:52.169497 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8f6e0-1157-402e-8622-e7681c0b3fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:52.169803 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8f6e0-1157-402e-8622-e7681c0b3fbf admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:52.170430 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8f6e0-1157-402e-8622-e7681c0b3fbf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:52.172975 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8f6e0-1157-402e-8622-e7681c0b3fbf admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:52.212957 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1307/2652] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:12:52 2022] PUT /identity/v3/projects/2ebb11d21a0b4a1f91f2453554b3b1d2/users/503aa2a491a04f8485acd8139a8e8567/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:12:52.224704 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e9844-f225-474c-93fa-8b6610e9e997 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:52.224985 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e9844-f225-474c-93fa-8b6610e9e997 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:52.225258 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e9844-f225-474c-93fa-8b6610e9e997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:52.252163 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-cc9e9844-f225-474c-93fa-8b6610e9e997 None None] MFA Rules not processed for user `503aa2a491a04f8485acd8139a8e8567`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:52.253372 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-cc9e9844-f225-474c-93fa-8b6610e9e997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:52.265095 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1346/2653] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:12:52 2022] POST /identity/v3/users => generated 288 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:12:52.269623 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8f6e0-1157-402e-8622-e7681c0b3fbf admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:52.279041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8f6e0-1157-402e-8622-e7681c0b3fbf admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:52.320383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1308/2654] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:52 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:12:52.324915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e9844-f225-474c-93fa-8b6610e9e997 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:52.336559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0c475-24f9-4239-91b7-c1189e98111c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:52.337167 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0c475-24f9-4239-91b7-c1189e98111c admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:52.337454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0c475-24f9-4239-91b7-c1189e98111c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:52.337754 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c0c475-24f9-4239-91b7-c1189e98111c admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:52.338403 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0c475-24f9-4239-91b7-c1189e98111c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:52.340003 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c0c475-24f9-4239-91b7-c1189e98111c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:52.351194 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1347/2655] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:12:52.355211 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0c475-24f9-4239-91b7-c1189e98111c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:52.356387 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:52.365777 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c0c475-24f9-4239-91b7-c1189e98111c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:52.370638 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087d6dc-4614-4569-80e4-b9552288c624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:52.371220 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087d6dc-4614-4569-80e4-b9552288c624 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:52.371496 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087d6dc-4614-4569-80e4-b9552288c624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:52.371765 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087d6dc-4614-4569-80e4-b9552288c624 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:52.372386 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087d6dc-4614-4569-80e4-b9552288c624 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:52.374025 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087d6dc-4614-4569-80e4-b9552288c624 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:52.383728 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1348/2656] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:12:52.387690 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087d6dc-4614-4569-80e4-b9552288c624 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:52.387838 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e9844-f225-474c-93fa-8b6610e9e997 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:52.393475 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a513b-04b8-4e48-855b-374313c8a503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:52.394229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a513b-04b8-4e48-855b-374313c8a503 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:52.394615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a513b-04b8-4e48-855b-374313c8a503 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:52.394892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a513b-04b8-4e48-855b-374313c8a503 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:52.395533 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a513b-04b8-4e48-855b-374313c8a503 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:52.397438 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087d6dc-4614-4569-80e4-b9552288c624 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:52.397560 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a513b-04b8-4e48-855b-374313c8a503 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:52.401988 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec18f33-933f-4d4a-93b2-d5288bcff5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:52.402610 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec18f33-933f-4d4a-93b2-d5288bcff5b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:52.402888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec18f33-933f-4d4a-93b2-d5288bcff5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:52.403157 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec18f33-933f-4d4a-93b2-d5288bcff5b0 admin admin] PATH_INFO: `/v3/projects/3485b28b3baa462d83a878c130009066/users/fab4f1a9afbe402a9de1d9ce90cca0d4/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:52.418322 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec18f33-933f-4d4a-93b2-d5288bcff5b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3485b28b3baa462d83a878c130009066, user_id=fab4f1a9afbe402a9de1d9ce90cca0d4, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:52.421076 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec18f33-933f-4d4a-93b2-d5288bcff5b0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:52.482996 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1309/2657] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:12:52 2022] POST /identity/v3/projects => generated 399 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:12:52.487454 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a513b-04b8-4e48-855b-374313c8a503 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:52.512028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1349/2658] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:12:52 2022] PUT /identity/v3/projects/3485b28b3baa462d83a878c130009066/users/fab4f1a9afbe402a9de1d9ce90cca0d4/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:12:52.525926 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19b175-c101-4ecf-bb0a-d8ab4a186a3c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:52.526290 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19b175-c101-4ecf-bb0a-d8ab4a186a3c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:52.526463 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c19b175-c101-4ecf-bb0a-d8ab4a186a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:52.557196 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2c19b175-c101-4ecf-bb0a-d8ab4a186a3c None None] MFA Rules not processed for user `fab4f1a9afbe402a9de1d9ce90cca0d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:52.558503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2c19b175-c101-4ecf-bb0a-d8ab4a186a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:52.566527 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a513b-04b8-4e48-855b-374313c8a503 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:52.601324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:52.623824 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76008a19-e039-4bdb-9c33-2fcf5db28a9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:52.624355 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76008a19-e039-4bdb-9c33-2fcf5db28a9b admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:52.624633 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76008a19-e039-4bdb-9c33-2fcf5db28a9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:52.624735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1350/2659] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:12:52.625897 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76008a19-e039-4bdb-9c33-2fcf5db28a9b admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:52.626554 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76008a19-e039-4bdb-9c33-2fcf5db28a9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:52.628497 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76008a19-e039-4bdb-9c33-2fcf5db28a9b admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:52.636439 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19b175-c101-4ecf-bb0a-d8ab4a186a3c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:52.637995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2c19b175-c101-4ecf-bb0a-d8ab4a186a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:52.693075 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c19b175-c101-4ecf-bb0a-d8ab4a186a3c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:52.696666 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d089e9-e41f-4b40-ac1e-0049697870ce service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:52.697262 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d089e9-e41f-4b40-ac1e-0049697870ce service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:52.697537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d089e9-e41f-4b40-ac1e-0049697870ce service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:52.697837 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d089e9-e41f-4b40-ac1e-0049697870ce service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:52.707718 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d089e9-e41f-4b40-ac1e-0049697870ce service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:52.708374 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1310/2660] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:12:52 2022] POST /identity/v3/users => generated 306 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:12:52.709275 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d089e9-e41f-4b40-ac1e-0049697870ce service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:52.712506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76008a19-e039-4bdb-9c33-2fcf5db28a9b admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:52.718521 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1351/2661] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:12:52.722013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76008a19-e039-4bdb-9c33-2fcf5db28a9b admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:52.726991 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2553c6b-c8b9-4dc2-8666-b381c15439cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:52.727561 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2553c6b-c8b9-4dc2-8666-b381c15439cb admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:52.727846 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2553c6b-c8b9-4dc2-8666-b381c15439cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:52.728115 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2553c6b-c8b9-4dc2-8666-b381c15439cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:52.728749 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2553c6b-c8b9-4dc2-8666-b381c15439cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:52.730694 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2553c6b-c8b9-4dc2-8666-b381c15439cb admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:52.741594 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1311/2662] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:12:52.749536 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d089e9-e41f-4b40-ac1e-0049697870ce service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:52.761041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d089e9-e41f-4b40-ac1e-0049697870ce service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:52.766915 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0268d-6f28-4933-a403-9469e19b58de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:52.767564 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0268d-6f28-4933-a403-9469e19b58de admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:52.767840 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0268d-6f28-4933-a403-9469e19b58de admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:52.768114 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d0268d-6f28-4933-a403-9469e19b58de admin admin] PATH_INFO: `/v3/projects/7ad3c71e533c4ac7b5efe5bf7e6e4e3e/users/539bf63dd7e04911b3a36ca26b3ec9df/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:52.784095 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0268d-6f28-4933-a403-9469e19b58de admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad3c71e533c4ac7b5efe5bf7e6e4e3e, user_id=539bf63dd7e04911b3a36ca26b3ec9df, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:52.786850 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d0268d-6f28-4933-a403-9469e19b58de admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:52.850512 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1352/2663] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:12:52 2022] PUT /identity/v3/projects/7ad3c71e533c4ac7b5efe5bf7e6e4e3e/users/539bf63dd7e04911b3a36ca26b3ec9df/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:52.854570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2553c6b-c8b9-4dc2-8666-b381c15439cb admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:52.864283 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2553c6b-c8b9-4dc2-8666-b381c15439cb admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:52.903211 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:52.922656 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f0297-b7bb-4b56-9e59-d41761074aaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:52.923445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f0297-b7bb-4b56-9e59-d41761074aaa admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:52.923831 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f0297-b7bb-4b56-9e59-d41761074aaa admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:52.923977 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f0297-b7bb-4b56-9e59-d41761074aaa admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:52.924650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f0297-b7bb-4b56-9e59-d41761074aaa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:52.926346 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552f0297-b7bb-4b56-9e59-d41761074aaa admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:52.936519 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1312/2664] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:12:52.941471 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0268d-6f28-4933-a403-9469e19b58de admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:52.951890 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d0268d-6f28-4933-a403-9469e19b58de admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:52.957316 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e66b88-b331-46d5-aaa1-98e97bd37751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:52.958005 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e66b88-b331-46d5-aaa1-98e97bd37751 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:52.958280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e66b88-b331-46d5-aaa1-98e97bd37751 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:52.958548 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e66b88-b331-46d5-aaa1-98e97bd37751 admin admin] PATH_INFO: `/v3/projects/7ad3c71e533c4ac7b5efe5bf7e6e4e3e/users/539bf63dd7e04911b3a36ca26b3ec9df/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:52.960710 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e66b88-b331-46d5-aaa1-98e97bd37751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad3c71e533c4ac7b5efe5bf7e6e4e3e, user_id=539bf63dd7e04911b3a36ca26b3ec9df, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:52.963416 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e66b88-b331-46d5-aaa1-98e97bd37751 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:52.974800 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1353/2665] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:12:52 2022] PUT /identity/v3/projects/7ad3c71e533c4ac7b5efe5bf7e6e4e3e/users/539bf63dd7e04911b3a36ca26b3ec9df/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:52.985704 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d442d0c-143a-4721-b36b-6d3a86ff7961 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:52.986063 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d442d0c-143a-4721-b36b-6d3a86ff7961 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:52.987598 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d442d0c-143a-4721-b36b-6d3a86ff7961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:53.016594 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-5d442d0c-143a-4721-b36b-6d3a86ff7961 None None] MFA Rules not processed for user `539bf63dd7e04911b3a36ca26b3ec9df`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:53.016804 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5d442d0c-143a-4721-b36b-6d3a86ff7961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:53.086278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1313/2666] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:52 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:53.114634 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e66b88-b331-46d5-aaa1-98e97bd37751 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:53.116428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-33e66b88-b331-46d5-aaa1-98e97bd37751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:53.178603 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e66b88-b331-46d5-aaa1-98e97bd37751 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:53.182218 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081efa3-9e84-4e2f-a738-cbb144c2a2ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:53.182869 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081efa3-9e84-4e2f-a738-cbb144c2a2ed service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:53.183143 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081efa3-9e84-4e2f-a738-cbb144c2a2ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:53.183412 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1081efa3-9e84-4e2f-a738-cbb144c2a2ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:53.192872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081efa3-9e84-4e2f-a738-cbb144c2a2ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:53.194474 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1081efa3-9e84-4e2f-a738-cbb144c2a2ed service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:53.203862 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1354/2667] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:53 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:12:53.424473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d442d0c-143a-4721-b36b-6d3a86ff7961 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:53.434566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d442d0c-143a-4721-b36b-6d3a86ff7961 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:53.438175 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050878f-25d2-4e95-b1be-2d67c6b0213b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:53.438780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050878f-25d2-4e95-b1be-2d67c6b0213b service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:53.439080 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050878f-25d2-4e95-b1be-2d67c6b0213b service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:53.439330 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050878f-25d2-4e95-b1be-2d67c6b0213b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:53.497323 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050878f-25d2-4e95-b1be-2d67c6b0213b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:53.498793 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050878f-25d2-4e95-b1be-2d67c6b0213b service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:53.507600 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1314/2668] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:53 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:12:56.852424 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081efa3-9e84-4e2f-a738-cbb144c2a2ed service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:56.910546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:56.925418 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1081efa3-9e84-4e2f-a738-cbb144c2a2ed service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:56.930087 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598ebe0-f678-4ea1-98db-cfce769c1f74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:56.930715 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598ebe0-f678-4ea1-98db-cfce769c1f74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:56.930991 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598ebe0-f678-4ea1-98db-cfce769c1f74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:56.931260 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b598ebe0-f678-4ea1-98db-cfce769c1f74 admin admin] PATH_INFO: `/v3/users/fab4f1a9afbe402a9de1d9ce90cca0d4` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:56.932377 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598ebe0-f678-4ea1-98db-cfce769c1f74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fab4f1a9afbe402a9de1d9ce90cca0d4)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:56.934302 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b598ebe0-f678-4ea1-98db-cfce769c1f74 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:57.108979 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b598ebe0-f678-4ea1-98db-cfce769c1f74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fab4f1a9afbe402a9de1d9ce90cca0d4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:57.287421 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b598ebe0-f678-4ea1-98db-cfce769c1f74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fab4f1a9afbe402a9de1d9ce90cca0d4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:57.300320 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b598ebe0-f678-4ea1-98db-cfce769c1f74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fab4f1a9afbe402a9de1d9ce90cca0d4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:57.300951 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b598ebe0-f678-4ea1-98db-cfce769c1f74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fab4f1a9afbe402a9de1d9ce90cca0d4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:57.308119 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b598ebe0-f678-4ea1-98db-cfce769c1f74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fab4f1a9afbe402a9de1d9ce90cca0d4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:57.314532 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1355/2669] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:12:56 2022] DELETE /identity/v3/users/fab4f1a9afbe402a9de1d9ce90cca0d4 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:57.319850 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4969b-cdd9-452b-9378-fecd79395ce5 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:57.320339 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4969b-cdd9-452b-9378-fecd79395ce5 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:57.320460 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a4969b-cdd9-452b-9378-fecd79395ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:57.341593 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-63a4969b-cdd9-452b-9378-fecd79395ce5 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:57.343722 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-63a4969b-cdd9-452b-9378-fecd79395ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:57.396779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:57.405545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1315/2670] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:57.415222 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598ebe0-f678-4ea1-98db-cfce769c1f74 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:57.416622 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b598ebe0-f678-4ea1-98db-cfce769c1f74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:57.479274 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b598ebe0-f678-4ea1-98db-cfce769c1f74 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:57.483092 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceb7263-c0b5-4a17-82f9-54c854a6b0b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:57.483728 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb7263-c0b5-4a17-82f9-54c854a6b0b3 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:57.487351 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb7263-c0b5-4a17-82f9-54c854a6b0b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:57.487351 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceb7263-c0b5-4a17-82f9-54c854a6b0b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:57.493449 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb7263-c0b5-4a17-82f9-54c854a6b0b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:57.494904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceb7263-c0b5-4a17-82f9-54c854a6b0b3 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:57.504223 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1356/2671] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:12:57.954793 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4969b-cdd9-452b-9378-fecd79395ce5 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:57.956797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-63a4969b-cdd9-452b-9378-fecd79395ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:57.969021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a4969b-cdd9-452b-9378-fecd79395ce5 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:57.973580 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef915ca-75c9-4414-9197-b37c97cd0f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:57.974251 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef915ca-75c9-4414-9197-b37c97cd0f87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:57.974577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef915ca-75c9-4414-9197-b37c97cd0f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:57.974798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef915ca-75c9-4414-9197-b37c97cd0f87 admin admin] PATH_INFO: `/v3/projects/3485b28b3baa462d83a878c130009066` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:57.975904 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef915ca-75c9-4414-9197-b37c97cd0f87 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3485b28b3baa462d83a878c130009066)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:57.977824 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef915ca-75c9-4414-9197-b37c97cd0f87 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:58.093817 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9ef915ca-75c9-4414-9197-b37c97cd0f87 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3485b28b3baa462d83a878c130009066', 'request_id': 'req-9ef915ca-75c9-4414-9197-b37c97cd0f87'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:58.100104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9ef915ca-75c9-4414-9197-b37c97cd0f87 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3485b28b3baa462d83a878c130009066', 'request_id': 'req-9ef915ca-75c9-4414-9197-b37c97cd0f87'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:58.106449 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9ef915ca-75c9-4414-9197-b37c97cd0f87 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3485b28b3baa462d83a878c130009066', 'request_id': 'req-9ef915ca-75c9-4414-9197-b37c97cd0f87'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:58.181441 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9ef915ca-75c9-4414-9197-b37c97cd0f87 admin admin] The token cache is being invalidate because project 3485b28b3baa462d83a878c130009066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:12:58.181952 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9ef915ca-75c9-4414-9197-b37c97cd0f87 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:58.182487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-9ef915ca-75c9-4414-9197-b37c97cd0f87 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:58.184242 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1316/2672] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:12:57 2022] DELETE /identity/v3/projects/3485b28b3baa462d83a878c130009066 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:58.189012 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739fe95-a8eb-4a82-8696-e7a6724e4dff None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:58.189485 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739fe95-a8eb-4a82-8696-e7a6724e4dff None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:58.189604 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739fe95-a8eb-4a82-8696-e7a6724e4dff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:58.209537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3739fe95-a8eb-4a82-8696-e7a6724e4dff None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:58.210937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3739fe95-a8eb-4a82-8696-e7a6724e4dff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:58.269533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1357/2673] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:12:58.277450 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5590db-be3a-495b-85d3-9acd6b9f9e57 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:58.277762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5590db-be3a-495b-85d3-9acd6b9f9e57 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:58.278034 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5590db-be3a-495b-85d3-9acd6b9f9e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:58.298547 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-af5590db-be3a-495b-85d3-9acd6b9f9e57 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:58.299587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-af5590db-be3a-495b-85d3-9acd6b9f9e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:58.307661 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1317/2674] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:58.311998 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739fe95-a8eb-4a82-8696-e7a6724e4dff None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:58.321950 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739fe95-a8eb-4a82-8696-e7a6724e4dff None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:58.334913 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0014c42-b8cd-433c-86bb-54cbe18b1600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:58.334913 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0014c42-b8cd-433c-86bb-54cbe18b1600 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:58.334913 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0014c42-b8cd-433c-86bb-54cbe18b1600 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:58.334913 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0014c42-b8cd-433c-86bb-54cbe18b1600 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:58.335775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0014c42-b8cd-433c-86bb-54cbe18b1600 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:12:58.335775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0014c42-b8cd-433c-86bb-54cbe18b1600 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:58.335775 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0014c42-b8cd-433c-86bb-54cbe18b1600 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:58.338766 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:58.344217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1358/2675] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:12:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:12:58.349356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5590db-be3a-495b-85d3-9acd6b9f9e57 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:58.359526 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5590db-be3a-495b-85d3-9acd6b9f9e57 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:58.364354 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e41b5-c9b0-442d-bd7b-4f04ba487174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:58.364980 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e41b5-c9b0-442d-bd7b-4f04ba487174 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:58.365258 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e41b5-c9b0-442d-bd7b-4f04ba487174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:58.365526 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01e41b5-c9b0-442d-bd7b-4f04ba487174 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:58.366205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e41b5-c9b0-442d-bd7b-4f04ba487174 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:58.368082 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01e41b5-c9b0-442d-bd7b-4f04ba487174 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:58.456696 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0014c42-b8cd-433c-86bb-54cbe18b1600 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:58.458616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b0014c42-b8cd-433c-86bb-54cbe18b1600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:58.469919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1318/2676] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:12:58 2022] POST /identity/v3/projects => generated 375 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:12:58.473420 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e41b5-c9b0-442d-bd7b-4f04ba487174 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:58.475995 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0014c42-b8cd-433c-86bb-54cbe18b1600 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:58.535615 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66697b9a-1339-423b-b411-cbba8dfabe49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:58.536258 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66697b9a-1339-423b-b411-cbba8dfabe49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:58.536536 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66697b9a-1339-423b-b411-cbba8dfabe49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:58.536834 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66697b9a-1339-423b-b411-cbba8dfabe49 admin admin] PATH_INFO: `/v3/users/503aa2a491a04f8485acd8139a8e8567` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:58.538010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66697b9a-1339-423b-b411-cbba8dfabe49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=503aa2a491a04f8485acd8139a8e8567)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:58.539937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66697b9a-1339-423b-b411-cbba8dfabe49 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:58.540374 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01e41b5-c9b0-442d-bd7b-4f04ba487174 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:58.545041 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2098e5-bd8b-401a-bce8-9722b6a2584f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:58.545647 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2098e5-bd8b-401a-bce8-9722b6a2584f admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:58.545954 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2098e5-bd8b-401a-bce8-9722b6a2584f admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:58.546256 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2098e5-bd8b-401a-bce8-9722b6a2584f admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:58.546906 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2098e5-bd8b-401a-bce8-9722b6a2584f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:58.548880 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2098e5-bd8b-401a-bce8-9722b6a2584f admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:58.646015 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1319/2677] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:12:58 2022] POST /identity/v3/users => generated 288 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:12:58.650116 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2098e5-bd8b-401a-bce8-9722b6a2584f admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:58.659742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2098e5-bd8b-401a-bce8-9722b6a2584f admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:58.664543 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6c5aa-bdcd-44f3-8f6b-f5e31739aaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:58.665154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6c5aa-bdcd-44f3-8f6b-f5e31739aaa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:58.665433 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6c5aa-bdcd-44f3-8f6b-f5e31739aaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:58.665742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a6c5aa-bdcd-44f3-8f6b-f5e31739aaa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:58.666374 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6c5aa-bdcd-44f3-8f6b-f5e31739aaa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:58.670091 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a6c5aa-bdcd-44f3-8f6b-f5e31739aaa5 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:58.680002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1320/2678] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:12:58.683986 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6c5aa-bdcd-44f3-8f6b-f5e31739aaa5 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:58.693854 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a6c5aa-bdcd-44f3-8f6b-f5e31739aaa5 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:58.698272 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f5f5d-727c-4612-a756-fc49a122784c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:58.698831 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f5f5d-727c-4612-a756-fc49a122784c admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:58.700546 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f5f5d-727c-4612-a756-fc49a122784c admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:58.700546 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f5f5d-727c-4612-a756-fc49a122784c admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:58.700546 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f5f5d-727c-4612-a756-fc49a122784c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:58.701448 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f5f5d-727c-4612-a756-fc49a122784c admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:58.712478 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1321/2679] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:58 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:12:58.716086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f5f5d-727c-4612-a756-fc49a122784c admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:58.725473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f5f5d-727c-4612-a756-fc49a122784c admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:58.730369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747fb27a-23f9-40a3-8533-42cd3dd2c432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:58.730969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fb27a-23f9-40a3-8533-42cd3dd2c432 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:58.731247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fb27a-23f9-40a3-8533-42cd3dd2c432 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:58.731519 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747fb27a-23f9-40a3-8533-42cd3dd2c432 admin admin] PATH_INFO: `/v3/projects/8dd3a8ba3b56461d879323fbca40e7c4/users/09a244c575b7424f8565d8a1d1bd9c33/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:58.746992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747fb27a-23f9-40a3-8533-42cd3dd2c432 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dd3a8ba3b56461d879323fbca40e7c4, user_id=09a244c575b7424f8565d8a1d1bd9c33, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:58.749975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747fb27a-23f9-40a3-8533-42cd3dd2c432 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:58.788306 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-66697b9a-1339-423b-b411-cbba8dfabe49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '503aa2a491a04f8485acd8139a8e8567'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:58.837264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:58.842763 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1322/2680] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:12:58 2022] PUT /identity/v3/projects/8dd3a8ba3b56461d879323fbca40e7c4/users/09a244c575b7424f8565d8a1d1bd9c33/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:12:58.853957 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157efc7-1e9d-4ebb-b5b4-67ab5ff9b19f None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:58.854237 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157efc7-1e9d-4ebb-b5b4-67ab5ff9b19f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:58.854509 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7157efc7-1e9d-4ebb-b5b4-67ab5ff9b19f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:58.867807 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-66697b9a-1339-423b-b411-cbba8dfabe49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '503aa2a491a04f8485acd8139a8e8567'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:58.882234 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-7157efc7-1e9d-4ebb-b5b4-67ab5ff9b19f None None] MFA Rules not processed for user `09a244c575b7424f8565d8a1d1bd9c33`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:58.882825 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-66697b9a-1339-423b-b411-cbba8dfabe49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '503aa2a491a04f8485acd8139a8e8567'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:58.883433 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7157efc7-1e9d-4ebb-b5b4-67ab5ff9b19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:58.883834 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-66697b9a-1339-423b-b411-cbba8dfabe49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '503aa2a491a04f8485acd8139a8e8567'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:58.897441 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-66697b9a-1339-423b-b411-cbba8dfabe49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '503aa2a491a04f8485acd8139a8e8567'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:58.903593 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1359/2681] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:12:58 2022] DELETE /identity/v3/users/503aa2a491a04f8485acd8139a8e8567 => generated 0 bytes in 448 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:12:58.907867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31384a-8dac-4ace-85b2-05b0be6da710 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:58.908166 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31384a-8dac-4ace-85b2-05b0be6da710 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:58.908426 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31384a-8dac-4ace-85b2-05b0be6da710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:58.927465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-ec31384a-8dac-4ace-85b2-05b0be6da710 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:58.928885 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ec31384a-8dac-4ace-85b2-05b0be6da710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:58.950868 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1323/2682] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:12:58.955127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157efc7-1e9d-4ebb-b5b4-67ab5ff9b19f None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:58.957515 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7157efc7-1e9d-4ebb-b5b4-67ab5ff9b19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:58.992634 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1360/2683] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:12:58.993935 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31384a-8dac-4ace-85b2-05b0be6da710 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:58.995145 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ec31384a-8dac-4ace-85b2-05b0be6da710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:59.009276 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31384a-8dac-4ace-85b2-05b0be6da710 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:59.014009 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25890343-9af0-4d30-836b-a4a9413a0adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:59.014634 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25890343-9af0-4d30-836b-a4a9413a0adf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:59.015035 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25890343-9af0-4d30-836b-a4a9413a0adf admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:59.015314 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25890343-9af0-4d30-836b-a4a9413a0adf admin admin] PATH_INFO: `/v3/users/c8fb0fa4156342f482a04db9ac1e405a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:59.016435 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25890343-9af0-4d30-836b-a4a9413a0adf admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8fb0fa4156342f482a04db9ac1e405a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:59.018410 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25890343-9af0-4d30-836b-a4a9413a0adf admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:59.030168 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7157efc7-1e9d-4ebb-b5b4-67ab5ff9b19f None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:59.031422 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:59.035097 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1723dfb-4bcf-4d4d-81c5-0ddd6e0fd665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:59.037564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1723dfb-4bcf-4d4d-81c5-0ddd6e0fd665 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:59.037564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1723dfb-4bcf-4d4d-81c5-0ddd6e0fd665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:59.037564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1723dfb-4bcf-4d4d-81c5-0ddd6e0fd665 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:59.037564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1723dfb-4bcf-4d4d-81c5-0ddd6e0fd665 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:59.038812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1723dfb-4bcf-4d4d-81c5-0ddd6e0fd665 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:59.200332 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1324/2684] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:12:58 2022] POST /identity/v3/projects => generated 377 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:12:59.202137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1723dfb-4bcf-4d4d-81c5-0ddd6e0fd665 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:59.204204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b1723dfb-4bcf-4d4d-81c5-0ddd6e0fd665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:59.236059 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-25890343-9af0-4d30-836b-a4a9413a0adf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8fb0fa4156342f482a04db9ac1e405a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:59.261487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1723dfb-4bcf-4d4d-81c5-0ddd6e0fd665 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:59.265138 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136020b9-d88b-40c8-b3cf-169a5e48575e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:59.265763 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136020b9-d88b-40c8-b3cf-169a5e48575e service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:59.266044 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136020b9-d88b-40c8-b3cf-169a5e48575e service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:59.266319 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136020b9-d88b-40c8-b3cf-169a5e48575e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:59.292524 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:59.318926 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-25890343-9af0-4d30-836b-a4a9413a0adf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8fb0fa4156342f482a04db9ac1e405a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:59.325529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136020b9-d88b-40c8-b3cf-169a5e48575e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:59.326985 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136020b9-d88b-40c8-b3cf-169a5e48575e service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:59.331547 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-25890343-9af0-4d30-836b-a4a9413a0adf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8fb0fa4156342f482a04db9ac1e405a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:59.332350 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-25890343-9af0-4d30-836b-a4a9413a0adf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8fb0fa4156342f482a04db9ac1e405a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:59.336781 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1325/2685] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:12:59.337549 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136020b9-d88b-40c8-b3cf-169a5e48575e service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:59.340155 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-25890343-9af0-4d30-836b-a4a9413a0adf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8fb0fa4156342f482a04db9ac1e405a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:12:59.347404 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136020b9-d88b-40c8-b3cf-169a5e48575e service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:59.351227 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1361/2686] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:12:58 2022] DELETE /identity/v3/users/c8fb0fa4156342f482a04db9ac1e405a => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:59.352735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017e548-837c-469c-bf36-cb1ac6960471 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:59.353088 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017e548-837c-469c-bf36-cb1ac6960471 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:59.353430 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017e548-837c-469c-bf36-cb1ac6960471 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:59.373413 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-d017e548-837c-469c-bf36-cb1ac6960471 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:59.374781 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d017e548-837c-469c-bf36-cb1ac6960471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:59.411222 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5339d-c683-44eb-ae81-420bc1da7691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:59.411956 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5339d-c683-44eb-ae81-420bc1da7691 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:59.412303 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5339d-c683-44eb-ae81-420bc1da7691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:59.412649 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5339d-c683-44eb-ae81-420bc1da7691 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:59.413351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5339d-c683-44eb-ae81-420bc1da7691 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:59.415365 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5339d-c683-44eb-ae81-420bc1da7691 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:59.443760 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1362/2687] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:12:59.453036 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017e548-837c-469c-bf36-cb1ac6960471 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:59.454372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d017e548-837c-469c-bf36-cb1ac6960471 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:59.502236 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1326/2688] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:12:59 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:12:59.505982 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5339d-c683-44eb-ae81-420bc1da7691 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:59.507673 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-ceb5339d-c683-44eb-ae81-420bc1da7691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:59.512047 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017e548-837c-469c-bf36-cb1ac6960471 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:59.515693 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fda572-cca3-4fe4-91f1-4dd9ee7ad9e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:59.516299 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fda572-cca3-4fe4-91f1-4dd9ee7ad9e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:59.516577 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fda572-cca3-4fe4-91f1-4dd9ee7ad9e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:59.516852 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fda572-cca3-4fe4-91f1-4dd9ee7ad9e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:59.519018 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5339d-c683-44eb-ae81-420bc1da7691 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:59.523557 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce8590-ea7b-41d3-b98f-2486c43b1593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:59.524117 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce8590-ea7b-41d3-b98f-2486c43b1593 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:59.524401 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce8590-ea7b-41d3-b98f-2486c43b1593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:59.524662 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ce8590-ea7b-41d3-b98f-2486c43b1593 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:59.525290 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce8590-ea7b-41d3-b98f-2486c43b1593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:59.526351 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fda572-cca3-4fe4-91f1-4dd9ee7ad9e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:59.526896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ce8590-ea7b-41d3-b98f-2486c43b1593 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:59.527817 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fda572-cca3-4fe4-91f1-4dd9ee7ad9e9 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:59.538962 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1327/2689] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:12:59.541715 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1363/2690] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:12:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:12:59.544447 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce8590-ea7b-41d3-b98f-2486c43b1593 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:59.555070 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ce8590-ea7b-41d3-b98f-2486c43b1593 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:59.559898 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cbb96e-f9bf-45bd-ab09-4cc8e137b23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:59.560613 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbb96e-f9bf-45bd-ab09-4cc8e137b23d admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:59.560898 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbb96e-f9bf-45bd-ab09-4cc8e137b23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:59.561167 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cbb96e-f9bf-45bd-ab09-4cc8e137b23d admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:59.561896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cbb96e-f9bf-45bd-ab09-4cc8e137b23d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:59.563497 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cbb96e-f9bf-45bd-ab09-4cc8e137b23d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:59.574483 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1328/2691] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:12:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:12:59.578537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fda572-cca3-4fe4-91f1-4dd9ee7ad9e9 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:59.588350 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fda572-cca3-4fe4-91f1-4dd9ee7ad9e9 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:59.601642 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c316e41-681a-4021-a56e-5ac119760ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:59.602951 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c316e41-681a-4021-a56e-5ac119760ad8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:59.602951 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c316e41-681a-4021-a56e-5ac119760ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:59.603188 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c316e41-681a-4021-a56e-5ac119760ad8 admin admin] PATH_INFO: `/v3/projects/3710dfa92f6d4738a1b2f7ff19399160/users/7d5ea34a61d24515bed26a6a6cc4df2d/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:59.622554 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c316e41-681a-4021-a56e-5ac119760ad8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3710dfa92f6d4738a1b2f7ff19399160, user_id=7d5ea34a61d24515bed26a6a6cc4df2d, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:59.625810 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c316e41-681a-4021-a56e-5ac119760ad8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:59.708593 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1364/2692] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:12:59 2022] PUT /identity/v3/projects/3710dfa92f6d4738a1b2f7ff19399160/users/7d5ea34a61d24515bed26a6a6cc4df2d/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:12:59.719275 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8768c1-cc81-483c-a610-96b23be9f99e None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:59.719564 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8768c1-cc81-483c-a610-96b23be9f99e None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:59.719873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8768c1-cc81-483c-a610-96b23be9f99e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:59.748279 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-bc8768c1-cc81-483c-a610-96b23be9f99e None None] MFA Rules not processed for user `7d5ea34a61d24515bed26a6a6cc4df2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:12:59.749489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-bc8768c1-cc81-483c-a610-96b23be9f99e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:59.794041 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c316e41-681a-4021-a56e-5ac119760ad8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:59.796299 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6c316e41-681a-4021-a56e-5ac119760ad8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:12:59.812767 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:59.836343 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1329/2693] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:12:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:12:59.840538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8768c1-cc81-483c-a610-96b23be9f99e None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:12:59.864583 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:12:59.889979 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c316e41-681a-4021-a56e-5ac119760ad8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:59.895929 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea27510-a338-432c-84a1-c77931a0ebfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:59.896622 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea27510-a338-432c-84a1-c77931a0ebfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:59.896887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea27510-a338-432c-84a1-c77931a0ebfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:59.897160 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea27510-a338-432c-84a1-c77931a0ebfa admin admin] PATH_INFO: `/v3/projects/2ebb11d21a0b4a1f91f2453554b3b1d2` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:59.903696 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea27510-a338-432c-84a1-c77931a0ebfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ebb11d21a0b4a1f91f2453554b3b1d2)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:59.903696 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea27510-a338-432c-84a1-c77931a0ebfa admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:12:59.920421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8768c1-cc81-483c-a610-96b23be9f99e None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:12:59.926625 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1487f9-2b8e-4917-8511-881bd39d7524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:12:59.927400 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1487f9-2b8e-4917-8511-881bd39d7524 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:12:59.927763 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1487f9-2b8e-4917-8511-881bd39d7524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:12:59.928115 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1487f9-2b8e-4917-8511-881bd39d7524 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:12:59.928829 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1487f9-2b8e-4917-8511-881bd39d7524 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:12:59.930871 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1487f9-2b8e-4917-8511-881bd39d7524 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:00.024273 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1330/2694] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:12:59 2022] POST /identity/v3/projects => generated 375 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:13:00.028409 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1487f9-2b8e-4917-8511-881bd39d7524 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:00.038950 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bea27510-a338-432c-84a1-c77931a0ebfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ebb11d21a0b4a1f91f2453554b3b1d2', 'request_id': 'req-bea27510-a338-432c-84a1-c77931a0ebfa'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:00.092660 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1487f9-2b8e-4917-8511-881bd39d7524 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:00.097848 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4847f9-0099-4975-9621-db3ab479a60e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:00.098436 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4847f9-0099-4975-9621-db3ab479a60e admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:00.098716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4847f9-0099-4975-9621-db3ab479a60e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:00.098988 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4847f9-0099-4975-9621-db3ab479a60e admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:00.099612 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4847f9-0099-4975-9621-db3ab479a60e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:00.101515 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4847f9-0099-4975-9621-db3ab479a60e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:00.116090 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bea27510-a338-432c-84a1-c77931a0ebfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ebb11d21a0b4a1f91f2453554b3b1d2', 'request_id': 'req-bea27510-a338-432c-84a1-c77931a0ebfa'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:00.122078 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bea27510-a338-432c-84a1-c77931a0ebfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ebb11d21a0b4a1f91f2453554b3b1d2', 'request_id': 'req-bea27510-a338-432c-84a1-c77931a0ebfa'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:00.133772 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bea27510-a338-432c-84a1-c77931a0ebfa admin admin] The token cache is being invalidate because project 2ebb11d21a0b4a1f91f2453554b3b1d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:13:00.134060 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bea27510-a338-432c-84a1-c77931a0ebfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:00.134703 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bea27510-a338-432c-84a1-c77931a0ebfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:00.136197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1365/2695] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:12:59 2022] DELETE /identity/v3/projects/2ebb11d21a0b4a1f91f2453554b3b1d2 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:00.139159 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea27510-a338-432c-84a1-c77931a0ebfa admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:00.139159 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bea27510-a338-432c-84a1-c77931a0ebfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:00.182886 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1331/2696] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:13:00 2022] POST /identity/v3/users => generated 294 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:13:00.183786 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4847f9-0099-4975-9621-db3ab479a60e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:00.185383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8f4847f9-0099-4975-9621-db3ab479a60e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:00.197867 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4847f9-0099-4975-9621-db3ab479a60e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:00.202699 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8a66f-7e43-465a-a324-b50a13925764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:00.202932 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea27510-a338-432c-84a1-c77931a0ebfa admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:00.203315 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8a66f-7e43-465a-a324-b50a13925764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:00.203600 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8a66f-7e43-465a-a324-b50a13925764 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:00.203920 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8a66f-7e43-465a-a324-b50a13925764 admin admin] PATH_INFO: `/v3/users/539bf63dd7e04911b3a36ca26b3ec9df` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:00.205028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8a66f-7e43-465a-a324-b50a13925764 admin admin] RBAC: Authorizing `identity:delete_user(user_id=539bf63dd7e04911b3a36ca26b3ec9df)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:00.208087 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ef117-613e-431b-94b6-ef43a77a2192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:00.208482 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a8a66f-7e43-465a-a324-b50a13925764 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:00.208708 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ef117-613e-431b-94b6-ef43a77a2192 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:00.208985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ef117-613e-431b-94b6-ef43a77a2192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:00.209265 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ef117-613e-431b-94b6-ef43a77a2192 admin admin] PATH_INFO: `/v3/projects/a3faee39ab8e443eafe63069d4dcd5b2` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:00.210439 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ef117-613e-431b-94b6-ef43a77a2192 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3faee39ab8e443eafe63069d4dcd5b2)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:00.212595 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ef117-613e-431b-94b6-ef43a77a2192 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:00.436028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a02ef117-613e-431b-94b6-ef43a77a2192 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3faee39ab8e443eafe63069d4dcd5b2', 'request_id': 'req-a02ef117-613e-431b-94b6-ef43a77a2192'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:00.436596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b7a8a66f-7e43-465a-a324-b50a13925764 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '539bf63dd7e04911b3a36ca26b3ec9df'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:00.524768 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a02ef117-613e-431b-94b6-ef43a77a2192 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3faee39ab8e443eafe63069d4dcd5b2', 'request_id': 'req-a02ef117-613e-431b-94b6-ef43a77a2192'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:00.530809 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a02ef117-613e-431b-94b6-ef43a77a2192 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3faee39ab8e443eafe63069d4dcd5b2', 'request_id': 'req-a02ef117-613e-431b-94b6-ef43a77a2192'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:00.542843 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a02ef117-613e-431b-94b6-ef43a77a2192 admin admin] The token cache is being invalidate because project a3faee39ab8e443eafe63069d4dcd5b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:13:00.543133 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a02ef117-613e-431b-94b6-ef43a77a2192 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:00.543771 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-a02ef117-613e-431b-94b6-ef43a77a2192 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:00.545249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1366/2697] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:13:00 2022] DELETE /identity/v3/projects/a3faee39ab8e443eafe63069d4dcd5b2 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:00.546042 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ef117-613e-431b-94b6-ef43a77a2192 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:00.547341 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a02ef117-613e-431b-94b6-ef43a77a2192 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:00.587611 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b7a8a66f-7e43-465a-a324-b50a13925764 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '539bf63dd7e04911b3a36ca26b3ec9df'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:00.600539 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:00.601758 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b7a8a66f-7e43-465a-a324-b50a13925764 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '539bf63dd7e04911b3a36ca26b3ec9df'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:00.602541 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b7a8a66f-7e43-465a-a324-b50a13925764 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '539bf63dd7e04911b3a36ca26b3ec9df'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:00.609863 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b7a8a66f-7e43-465a-a324-b50a13925764 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '539bf63dd7e04911b3a36ca26b3ec9df'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:00.612503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ef117-613e-431b-94b6-ef43a77a2192 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:00.615849 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1332/2698] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:13:00 2022] DELETE /identity/v3/users/539bf63dd7e04911b3a36ca26b3ec9df => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:00.616693 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8a66f-7e43-465a-a324-b50a13925764 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:00.618047 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b7a8a66f-7e43-465a-a324-b50a13925764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:00.619766 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315fb8d-7b21-4ad7-b3e2-f001750aaa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:00.620338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315fb8d-7b21-4ad7-b3e2-f001750aaa24 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:00.620684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315fb8d-7b21-4ad7-b3e2-f001750aaa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:00.621069 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6315fb8d-7b21-4ad7-b3e2-f001750aaa24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:00.621803 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315fb8d-7b21-4ad7-b3e2-f001750aaa24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:00.623465 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6315fb8d-7b21-4ad7-b3e2-f001750aaa24 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:00.628808 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:00.634078 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1367/2699] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:00.645392 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315fb8d-7b21-4ad7-b3e2-f001750aaa24 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:00.647208 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6315fb8d-7b21-4ad7-b3e2-f001750aaa24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:00.661124 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6315fb8d-7b21-4ad7-b3e2-f001750aaa24 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:00.692499 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a8a66f-7e43-465a-a324-b50a13925764 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:00.697130 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83217c63-0ec9-4cff-b6d2-a9ce565a875a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:00.700538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83217c63-0ec9-4cff-b6d2-a9ce565a875a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:00.700538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83217c63-0ec9-4cff-b6d2-a9ce565a875a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:00.700538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83217c63-0ec9-4cff-b6d2-a9ce565a875a admin admin] PATH_INFO: `/v3/users/30ecf37981314bbda7fd5b1c19e6a824` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:00.700538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83217c63-0ec9-4cff-b6d2-a9ce565a875a admin admin] RBAC: Authorizing `identity:delete_user(user_id=30ecf37981314bbda7fd5b1c19e6a824)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:00.701407 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83217c63-0ec9-4cff-b6d2-a9ce565a875a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:00.723031 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84eddc-b160-4e68-8dad-1dfb83ecbdb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:00.723736 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84eddc-b160-4e68-8dad-1dfb83ecbdb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:00.723976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84eddc-b160-4e68-8dad-1dfb83ecbdb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:00.724398 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e84eddc-b160-4e68-8dad-1dfb83ecbdb3 admin admin] PATH_INFO: `/v3/projects/c01f4fcb9d364b5aa3981b24fa80844d/users/0224238eb7ff43f6b2d5a3e7b13914e8/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:00.739387 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84eddc-b160-4e68-8dad-1dfb83ecbdb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c01f4fcb9d364b5aa3981b24fa80844d, user_id=0224238eb7ff43f6b2d5a3e7b13914e8, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:00.742074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e84eddc-b160-4e68-8dad-1dfb83ecbdb3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:00.820544 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1368/2700] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:00 2022] PUT /identity/v3/projects/c01f4fcb9d364b5aa3981b24fa80844d/users/0224238eb7ff43f6b2d5a3e7b13914e8/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:00.824500 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84eddc-b160-4e68-8dad-1dfb83ecbdb3 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:00.889988 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e84eddc-b160-4e68-8dad-1dfb83ecbdb3 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:00.897867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44001e5-44ec-4fb4-ae30-aad2c0e3b87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:00.897867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44001e5-44ec-4fb4-ae30-aad2c0e3b87b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:00.897867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44001e5-44ec-4fb4-ae30-aad2c0e3b87b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:00.897867 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44001e5-44ec-4fb4-ae30-aad2c0e3b87b admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:00.898284 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44001e5-44ec-4fb4-ae30-aad2c0e3b87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:00.898981 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44001e5-44ec-4fb4-ae30-aad2c0e3b87b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:00.909961 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1369/2701] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:00.914724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44001e5-44ec-4fb4-ae30-aad2c0e3b87b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:00.928110 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44001e5-44ec-4fb4-ae30-aad2c0e3b87b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:00.928388 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-83217c63-0ec9-4cff-b6d2-a9ce565a875a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30ecf37981314bbda7fd5b1c19e6a824'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:00.933761 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39162962-2d8d-4e67-bae8-f9b69fe86869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:00.934419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39162962-2d8d-4e67-bae8-f9b69fe86869 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:00.934700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39162962-2d8d-4e67-bae8-f9b69fe86869 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:00.935117 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39162962-2d8d-4e67-bae8-f9b69fe86869 admin admin] PATH_INFO: `/v3/projects/c01f4fcb9d364b5aa3981b24fa80844d/users/0224238eb7ff43f6b2d5a3e7b13914e8/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:00.937101 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39162962-2d8d-4e67-bae8-f9b69fe86869 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c01f4fcb9d364b5aa3981b24fa80844d, user_id=0224238eb7ff43f6b2d5a3e7b13914e8, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:00.939751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39162962-2d8d-4e67-bae8-f9b69fe86869 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:00.950404 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1370/2702] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:00 2022] PUT /identity/v3/projects/c01f4fcb9d364b5aa3981b24fa80844d/users/0224238eb7ff43f6b2d5a3e7b13914e8/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:00.961030 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97453383-094a-4a50-a9f7-f279afbb26d5 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:00.961320 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97453383-094a-4a50-a9f7-f279afbb26d5 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:00.961614 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97453383-094a-4a50-a9f7-f279afbb26d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:00.991038 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-97453383-094a-4a50-a9f7-f279afbb26d5 None None] MFA Rules not processed for user `0224238eb7ff43f6b2d5a3e7b13914e8`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:00.992145 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-97453383-094a-4a50-a9f7-f279afbb26d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:01.013814 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-83217c63-0ec9-4cff-b6d2-a9ce565a875a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30ecf37981314bbda7fd5b1c19e6a824'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:01.029676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-83217c63-0ec9-4cff-b6d2-a9ce565a875a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30ecf37981314bbda7fd5b1c19e6a824'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:01.030477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-83217c63-0ec9-4cff-b6d2-a9ce565a875a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30ecf37981314bbda7fd5b1c19e6a824'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:01.039548 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-83217c63-0ec9-4cff-b6d2-a9ce565a875a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30ecf37981314bbda7fd5b1c19e6a824'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:01.046521 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1333/2703] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:13:00 2022] DELETE /identity/v3/users/30ecf37981314bbda7fd5b1c19e6a824 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:01.047490 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83217c63-0ec9-4cff-b6d2-a9ce565a875a admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:01.048811 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-83217c63-0ec9-4cff-b6d2-a9ce565a875a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:01.081824 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1371/2704] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:13:01.095938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97453383-094a-4a50-a9f7-f279afbb26d5 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:01.098697 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-97453383-094a-4a50-a9f7-f279afbb26d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:01.120483 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83217c63-0ec9-4cff-b6d2-a9ce565a875a admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:01.125587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d02222-8459-4edc-9469-370fb2430763 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:01.127283 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d02222-8459-4edc-9469-370fb2430763 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:01.127589 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d02222-8459-4edc-9469-370fb2430763 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:01.127889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d02222-8459-4edc-9469-370fb2430763 admin admin] PATH_INFO: `/v3/projects/7ad3c71e533c4ac7b5efe5bf7e6e4e3e` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:01.129055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d02222-8459-4edc-9469-370fb2430763 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad3c71e533c4ac7b5efe5bf7e6e4e3e)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:01.131105 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d02222-8459-4edc-9469-370fb2430763 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:01.152926 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:01.165647 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97453383-094a-4a50-a9f7-f279afbb26d5 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:01.215156 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3178c7e4-7adc-4c95-934e-c00b895b691d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:01.215683 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178c7e4-7adc-4c95-934e-c00b895b691d service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:01.215959 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178c7e4-7adc-4c95-934e-c00b895b691d service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:01.216227 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3178c7e4-7adc-4c95-934e-c00b895b691d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:01.218010 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3178c7e4-7adc-4c95-934e-c00b895b691d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:01.226186 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:01.245425 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-86d02222-8459-4edc-9469-370fb2430763 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad3c71e533c4ac7b5efe5bf7e6e4e3e', 'request_id': 'req-86d02222-8459-4edc-9469-370fb2430763'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:01.252743 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-86d02222-8459-4edc-9469-370fb2430763 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad3c71e533c4ac7b5efe5bf7e6e4e3e', 'request_id': 'req-86d02222-8459-4edc-9469-370fb2430763'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:01.260304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-86d02222-8459-4edc-9469-370fb2430763 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad3c71e533c4ac7b5efe5bf7e6e4e3e', 'request_id': 'req-86d02222-8459-4edc-9469-370fb2430763'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:01.283350 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178c7e4-7adc-4c95-934e-c00b895b691d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:01.286252 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3178c7e4-7adc-4c95-934e-c00b895b691d service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:01.296218 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1372/2705] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:13:01.365533 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-86d02222-8459-4edc-9469-370fb2430763 admin admin] The token cache is being invalidate because project 7ad3c71e533c4ac7b5efe5bf7e6e4e3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:13:01.365533 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-86d02222-8459-4edc-9469-370fb2430763 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:01.366493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-86d02222-8459-4edc-9469-370fb2430763 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:01.368187 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1334/2706] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:13:01 2022] DELETE /identity/v3/projects/7ad3c71e533c4ac7b5efe5bf7e6e4e3e => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:01.373042 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dad17-c626-40e1-89cf-687071b05335 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:01.373338 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dad17-c626-40e1-89cf-687071b05335 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:01.373625 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2dad17-c626-40e1-89cf-687071b05335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:01.395231 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4d2dad17-c626-40e1-89cf-687071b05335 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:01.398094 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4d2dad17-c626-40e1-89cf-687071b05335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:01.463692 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1373/2707] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:01.471710 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45b05f-aaa1-4a3f-aa39-18cb6a3fc7e4 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:01.472113 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45b05f-aaa1-4a3f-aa39-18cb6a3fc7e4 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:01.472310 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb45b05f-aaa1-4a3f-aa39-18cb6a3fc7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:01.492593 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-cb45b05f-aaa1-4a3f-aa39-18cb6a3fc7e4 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:01.493857 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-cb45b05f-aaa1-4a3f-aa39-18cb6a3fc7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:01.498178 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dad17-c626-40e1-89cf-687071b05335 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:01.499593 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4d2dad17-c626-40e1-89cf-687071b05335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:01.505546 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1335/2708] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:01.508051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45b05f-aaa1-4a3f-aa39-18cb6a3fc7e4 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:01.516241 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2dad17-c626-40e1-89cf-687071b05335 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:01.518472 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb45b05f-aaa1-4a3f-aa39-18cb6a3fc7e4 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:01.521294 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126aaf76-e2f2-4d99-9cbc-bb4a78f64fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:01.521967 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126aaf76-e2f2-4d99-9cbc-bb4a78f64fa3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:01.522472 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126aaf76-e2f2-4d99-9cbc-bb4a78f64fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:01.522653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126aaf76-e2f2-4d99-9cbc-bb4a78f64fa3 admin admin] PATH_INFO: `/v3/projects/9d747347a6f341549b474ca0634e157b` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:01.524160 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126aaf76-e2f2-4d99-9cbc-bb4a78f64fa3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d747347a6f341549b474ca0634e157b)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:01.524627 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1039cf6-82f1-4715-9388-10d97e03670e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:01.525222 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1039cf6-82f1-4715-9388-10d97e03670e admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:01.525501 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1039cf6-82f1-4715-9388-10d97e03670e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:01.525804 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1039cf6-82f1-4715-9388-10d97e03670e admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:01.534396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126aaf76-e2f2-4d99-9cbc-bb4a78f64fa3 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:01.534953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1039cf6-82f1-4715-9388-10d97e03670e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:13:01.534953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1039cf6-82f1-4715-9388-10d97e03670e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:01.534953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1039cf6-82f1-4715-9388-10d97e03670e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:01.543522 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1336/2709] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:13:01.547806 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1039cf6-82f1-4715-9388-10d97e03670e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:01.557985 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1039cf6-82f1-4715-9388-10d97e03670e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:01.562667 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d609c8-5cc0-4243-ab67-9ad69ba88510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:01.563288 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d609c8-5cc0-4243-ab67-9ad69ba88510 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:01.563544 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d609c8-5cc0-4243-ab67-9ad69ba88510 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:01.563810 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d609c8-5cc0-4243-ab67-9ad69ba88510 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:01.564420 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d609c8-5cc0-4243-ab67-9ad69ba88510 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:01.566403 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d609c8-5cc0-4243-ab67-9ad69ba88510 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:01.683411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:01.688893 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1337/2710] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:13:01 2022] POST /identity/v3/projects => generated 389 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:13:01.693250 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d609c8-5cc0-4243-ab67-9ad69ba88510 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:01.701480 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-126aaf76-e2f2-4d99-9cbc-bb4a78f64fa3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d747347a6f341549b474ca0634e157b', 'request_id': 'req-126aaf76-e2f2-4d99-9cbc-bb4a78f64fa3'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:01.756753 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d609c8-5cc0-4243-ab67-9ad69ba88510 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:01.796059 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-126aaf76-e2f2-4d99-9cbc-bb4a78f64fa3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d747347a6f341549b474ca0634e157b', 'request_id': 'req-126aaf76-e2f2-4d99-9cbc-bb4a78f64fa3'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:01.802955 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-126aaf76-e2f2-4d99-9cbc-bb4a78f64fa3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d747347a6f341549b474ca0634e157b', 'request_id': 'req-126aaf76-e2f2-4d99-9cbc-bb4a78f64fa3'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:01.813052 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a527ae-ff59-4296-9af2-cc4c336efe3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:01.813664 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a527ae-ff59-4296-9af2-cc4c336efe3e admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:01.813976 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a527ae-ff59-4296-9af2-cc4c336efe3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:01.814111 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-126aaf76-e2f2-4d99-9cbc-bb4a78f64fa3 admin admin] The token cache is being invalidate because project 9d747347a6f341549b474ca0634e157b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:13:01.814253 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a527ae-ff59-4296-9af2-cc4c336efe3e admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:01.814401 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-126aaf76-e2f2-4d99-9cbc-bb4a78f64fa3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:01.814904 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a527ae-ff59-4296-9af2-cc4c336efe3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:01.815539 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-126aaf76-e2f2-4d99-9cbc-bb4a78f64fa3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:01.817027 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1374/2711] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:13:01 2022] DELETE /identity/v3/projects/9d747347a6f341549b474ca0634e157b => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:01.817316 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a527ae-ff59-4296-9af2-cc4c336efe3e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:01.823023 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45166c3-2271-4edc-8201-a2bc8027d242 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:01.823416 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45166c3-2271-4edc-8201-a2bc8027d242 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:01.823791 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45166c3-2271-4edc-8201-a2bc8027d242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:01.845610 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f45166c3-2271-4edc-8201-a2bc8027d242 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:01.846882 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f45166c3-2271-4edc-8201-a2bc8027d242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:01.854680 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1375/2712] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:01.862200 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13638ad7-d9ce-491a-b0b9-ef7b42ff17ab None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:01.862480 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13638ad7-d9ce-491a-b0b9-ef7b42ff17ab None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:01.862751 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13638ad7-d9ce-491a-b0b9-ef7b42ff17ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:01.882096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-13638ad7-d9ce-491a-b0b9-ef7b42ff17ab None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:01.883490 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-13638ad7-d9ce-491a-b0b9-ef7b42ff17ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:01.891767 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1376/2713] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:13:01.896484 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13638ad7-d9ce-491a-b0b9-ef7b42ff17ab None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:01.905872 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13638ad7-d9ce-491a-b0b9-ef7b42ff17ab None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:01.910544 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb4739-d877-4619-b5e2-14cc51689990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:01.911122 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb4739-d877-4619-b5e2-14cc51689990 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:01.911426 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb4739-d877-4619-b5e2-14cc51689990 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:01.911698 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb4739-d877-4619-b5e2-14cc51689990 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:01.912333 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb4739-d877-4619-b5e2-14cc51689990 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:13:01.912635 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb4739-d877-4619-b5e2-14cc51689990 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:01.914280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb4739-d877-4619-b5e2-14cc51689990 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:01.929770 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1338/2714] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:13:01 2022] POST /identity/v3/users => generated 295 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:13:01.930072 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1377/2715] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:13:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:13:01.931027 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a527ae-ff59-4296-9af2-cc4c336efe3e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:01.932454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb4739-d877-4619-b5e2-14cc51689990 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:01.934908 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-84a527ae-ff59-4296-9af2-cc4c336efe3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:01.947485 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb4739-d877-4619-b5e2-14cc51689990 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:01.952418 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8fce2-0ae9-4666-9160-da7af12e02b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:01.953049 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8fce2-0ae9-4666-9160-da7af12e02b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:01.953380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8fce2-0ae9-4666-9160-da7af12e02b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:01.953739 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8fce2-0ae9-4666-9160-da7af12e02b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:01.954375 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8fce2-0ae9-4666-9160-da7af12e02b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:01.956273 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8fce2-0ae9-4666-9160-da7af12e02b8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:01.965663 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a527ae-ff59-4296-9af2-cc4c336efe3e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:01.970876 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee3459-58b2-4f8a-813b-847d25d48b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:01.971621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee3459-58b2-4f8a-813b-847d25d48b11 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:01.971908 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee3459-58b2-4f8a-813b-847d25d48b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:01.972248 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee3459-58b2-4f8a-813b-847d25d48b11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:01.972823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee3459-58b2-4f8a-813b-847d25d48b11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:01.974446 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee3459-58b2-4f8a-813b-847d25d48b11 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:01.980247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:01.985212 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1339/2716] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:01.989745 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee3459-58b2-4f8a-813b-847d25d48b11 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:01.999669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee3459-58b2-4f8a-813b-847d25d48b11 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:02.005090 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678657f8-6d56-4186-844b-c305af443d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:02.005894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678657f8-6d56-4186-844b-c305af443d37 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:02.006177 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678657f8-6d56-4186-844b-c305af443d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:02.006453 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678657f8-6d56-4186-844b-c305af443d37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:02.007135 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678657f8-6d56-4186-844b-c305af443d37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:02.008692 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678657f8-6d56-4186-844b-c305af443d37 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:02.019230 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1340/2717] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:13:02.023410 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678657f8-6d56-4186-844b-c305af443d37 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:02.035525 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678657f8-6d56-4186-844b-c305af443d37 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:02.046310 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f6cab8-95e3-42be-aa2d-3852ca8aef4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:02.046490 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1378/2718] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:13:01 2022] POST /identity/v3/projects => generated 369 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:13:02.046599 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6cab8-95e3-42be-aa2d-3852ca8aef4e admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:02.046599 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6cab8-95e3-42be-aa2d-3852ca8aef4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:02.046599 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f6cab8-95e3-42be-aa2d-3852ca8aef4e admin admin] PATH_INFO: `/v3/projects/df90592f687044e29d006da1d28b388b/users/ce5875a8a8174fd6bbcde3129024733d/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:02.048447 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8fce2-0ae9-4666-9160-da7af12e02b8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:02.053259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:02.064044 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6cab8-95e3-42be-aa2d-3852ca8aef4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=df90592f687044e29d006da1d28b388b, user_id=ce5875a8a8174fd6bbcde3129024733d, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:02.067669 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f6cab8-95e3-42be-aa2d-3852ca8aef4e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:02.112960 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8fce2-0ae9-4666-9160-da7af12e02b8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:02.117628 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb96ca-b641-457e-a593-a49f554a116b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:02.118319 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb96ca-b641-457e-a593-a49f554a116b admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:02.118600 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb96ca-b641-457e-a593-a49f554a116b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:02.118878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fb96ca-b641-457e-a593-a49f554a116b admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:02.119503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb96ca-b641-457e-a593-a49f554a116b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:02.121418 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fb96ca-b641-457e-a593-a49f554a116b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:02.142204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1341/2719] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:02 2022] PUT /identity/v3/projects/df90592f687044e29d006da1d28b388b/users/ce5875a8a8174fd6bbcde3129024733d/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:02.152329 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6b35f-4388-4d84-993b-e613f990a644 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:02.152641 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6b35f-4388-4d84-993b-e613f990a644 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:02.152923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d6b35f-4388-4d84-993b-e613f990a644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:02.180317 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-f4d6b35f-4388-4d84-993b-e613f990a644 None None] MFA Rules not processed for user `ce5875a8a8174fd6bbcde3129024733d`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:02.181550 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f4d6b35f-4388-4d84-993b-e613f990a644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:02.244995 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1342/2720] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:02 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:13:02.249463 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6b35f-4388-4d84-993b-e613f990a644 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:02.261959 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1379/2721] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:13:02 2022] POST /identity/v3/users => generated 285 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:13:02.263554 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb96ca-b641-457e-a593-a49f554a116b admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:02.273060 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fb96ca-b641-457e-a593-a49f554a116b admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:02.314474 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d6b35f-4388-4d84-993b-e613f990a644 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:02.319102 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8716a-4c28-4902-9fb5-854bcb647212 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:02.319705 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8716a-4c28-4902-9fb5-854bcb647212 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:02.319981 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8716a-4c28-4902-9fb5-854bcb647212 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:02.320252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae8716a-4c28-4902-9fb5-854bcb647212 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:02.320875 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8716a-4c28-4902-9fb5-854bcb647212 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:02.322835 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae8716a-4c28-4902-9fb5-854bcb647212 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:02.329904 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bacbb-203d-4800-8016-dbf0c2d01620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:02.330525 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bacbb-203d-4800-8016-dbf0c2d01620 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:02.330822 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bacbb-203d-4800-8016-dbf0c2d01620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:02.331094 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365bacbb-203d-4800-8016-dbf0c2d01620 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:02.331736 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365bacbb-203d-4800-8016-dbf0c2d01620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:02.333343 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365bacbb-203d-4800-8016-dbf0c2d01620 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:02.343620 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1380/2722] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:13:02.348361 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bacbb-203d-4800-8016-dbf0c2d01620 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:02.357759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365bacbb-203d-4800-8016-dbf0c2d01620 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:02.363030 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891abaa-9f51-4c4b-a4c7-853cdee74cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:02.363601 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891abaa-9f51-4c4b-a4c7-853cdee74cb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:02.363877 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891abaa-9f51-4c4b-a4c7-853cdee74cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:02.364147 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891abaa-9f51-4c4b-a4c7-853cdee74cb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:02.364771 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891abaa-9f51-4c4b-a4c7-853cdee74cb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:02.366377 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891abaa-9f51-4c4b-a4c7-853cdee74cb7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:02.377676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1381/2723] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:13:02.381619 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891abaa-9f51-4c4b-a4c7-853cdee74cb7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:02.390784 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891abaa-9f51-4c4b-a4c7-853cdee74cb7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:02.395455 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301d1e36-bd1a-46dc-9b94-1805cc623ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:02.396086 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d1e36-bd1a-46dc-9b94-1805cc623ef0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:02.396373 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d1e36-bd1a-46dc-9b94-1805cc623ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:02.396641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301d1e36-bd1a-46dc-9b94-1805cc623ef0 admin admin] PATH_INFO: `/v3/projects/f2438c3e70364732ba846688bdb25552/users/e671fc5ff394437e85b1cc70eab7fe21/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:02.409816 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1343/2724] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:13:02 2022] POST /identity/v3/projects => generated 389 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:13:02.413791 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8716a-4c28-4902-9fb5-854bcb647212 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:02.414641 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d1e36-bd1a-46dc-9b94-1805cc623ef0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2438c3e70364732ba846688bdb25552, user_id=e671fc5ff394437e85b1cc70eab7fe21, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:02.417283 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301d1e36-bd1a-46dc-9b94-1805cc623ef0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:02.475615 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae8716a-4c28-4902-9fb5-854bcb647212 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:02.480488 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb66711-7f84-46fe-a8e3-a2e7ee30a30e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:02.481082 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb66711-7f84-46fe-a8e3-a2e7ee30a30e admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:02.481356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb66711-7f84-46fe-a8e3-a2e7ee30a30e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:02.481623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb66711-7f84-46fe-a8e3-a2e7ee30a30e admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:02.482278 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb66711-7f84-46fe-a8e3-a2e7ee30a30e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:02.484226 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb66711-7f84-46fe-a8e3-a2e7ee30a30e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:02.507959 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1382/2725] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:02 2022] PUT /identity/v3/projects/f2438c3e70364732ba846688bdb25552/users/e671fc5ff394437e85b1cc70eab7fe21/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:02.519658 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf747ec3-e24d-4761-bed0-429dfa3131e2 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:02.519875 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf747ec3-e24d-4761-bed0-429dfa3131e2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:02.520013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:02.520208 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf747ec3-e24d-4761-bed0-429dfa3131e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:02.547138 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-cf747ec3-e24d-4761-bed0-429dfa3131e2 None None] MFA Rules not processed for user `e671fc5ff394437e85b1cc70eab7fe21`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:02.548329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cf747ec3-e24d-4761-bed0-429dfa3131e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:02.576599 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1344/2726] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:13:02 2022] POST /identity/v3/users => generated 301 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:13:02.581346 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb66711-7f84-46fe-a8e3-a2e7ee30a30e admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:02.590637 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:02.591548 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb66711-7f84-46fe-a8e3-a2e7ee30a30e admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:02.614808 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1383/2727] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:13:02.619251 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf747ec3-e24d-4761-bed0-429dfa3131e2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:02.649301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c5dc9-a9a3-4ddf-a830-8745c0869d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:02.650125 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c5dc9-a9a3-4ddf-a830-8745c0869d1c admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:02.650483 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c5dc9-a9a3-4ddf-a830-8745c0869d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:02.650833 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6c5dc9-a9a3-4ddf-a830-8745c0869d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:02.651544 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c5dc9-a9a3-4ddf-a830-8745c0869d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:02.653214 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6c5dc9-a9a3-4ddf-a830-8745c0869d1c admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:02.663510 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1345/2728] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:13:02.667720 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c5dc9-a9a3-4ddf-a830-8745c0869d1c admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:02.677605 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6c5dc9-a9a3-4ddf-a830-8745c0869d1c admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:02.681274 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf747ec3-e24d-4761-bed0-429dfa3131e2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:02.682816 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa04fb-c961-49d8-a283-cf87b1b08c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:02.683481 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa04fb-c961-49d8-a283-cf87b1b08c81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:02.683784 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa04fb-c961-49d8-a283-cf87b1b08c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:02.684032 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fa04fb-c961-49d8-a283-cf87b1b08c81 admin admin] PATH_INFO: `/v3/projects/2b3cd967662e426b97bb01a15ef15319/users/31b8c49f81704c9795ab3541f71ac316/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:02.686280 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a8bc9-f4a2-4f4f-ac02-0d9f59b11f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:02.686888 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a8bc9-f4a2-4f4f-ac02-0d9f59b11f5f admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:02.687172 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a8bc9-f4a2-4f4f-ac02-0d9f59b11f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:02.687446 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a8bc9-f4a2-4f4f-ac02-0d9f59b11f5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:02.688098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a8bc9-f4a2-4f4f-ac02-0d9f59b11f5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:02.690094 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a8bc9-f4a2-4f4f-ac02-0d9f59b11f5f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:02.698757 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa04fb-c961-49d8-a283-cf87b1b08c81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b3cd967662e426b97bb01a15ef15319, user_id=31b8c49f81704c9795ab3541f71ac316, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:02.701576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fa04fb-c961-49d8-a283-cf87b1b08c81 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:02.777262 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1346/2729] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:02 2022] PUT /identity/v3/projects/2b3cd967662e426b97bb01a15ef15319/users/31b8c49f81704c9795ab3541f71ac316/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:02.781593 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1384/2730] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:13:02 2022] POST /identity/v3/projects => generated 367 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:13:02.781754 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa04fb-c961-49d8-a283-cf87b1b08c81 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:02.782499 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a8bc9-f4a2-4f4f-ac02-0d9f59b11f5f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:02.845764 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fa04fb-c961-49d8-a283-cf87b1b08c81 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:02.848030 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a8bc9-f4a2-4f4f-ac02-0d9f59b11f5f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:02.851161 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7974ce-e0e0-4704-ba64-d955dbbd5465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:02.851766 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7974ce-e0e0-4704-ba64-d955dbbd5465 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:02.852048 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7974ce-e0e0-4704-ba64-d955dbbd5465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:02.852320 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7974ce-e0e0-4704-ba64-d955dbbd5465 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:02.852877 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce642c8-30b6-48dd-b27d-142bfaaf2533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:02.853028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7974ce-e0e0-4704-ba64-d955dbbd5465 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:02.853476 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce642c8-30b6-48dd-b27d-142bfaaf2533 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:02.853787 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce642c8-30b6-48dd-b27d-142bfaaf2533 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:02.854062 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce642c8-30b6-48dd-b27d-142bfaaf2533 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:02.854547 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7974ce-e0e0-4704-ba64-d955dbbd5465 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:02.854692 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce642c8-30b6-48dd-b27d-142bfaaf2533 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:02.856593 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce642c8-30b6-48dd-b27d-142bfaaf2533 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:02.865728 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1347/2731] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:02.868785 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7974ce-e0e0-4704-ba64-d955dbbd5465 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:02.878539 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7974ce-e0e0-4704-ba64-d955dbbd5465 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:02.883332 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b779e-0953-4973-8f4b-0c45513ab851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:02.884000 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b779e-0953-4973-8f4b-0c45513ab851 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:02.884298 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b779e-0953-4973-8f4b-0c45513ab851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:02.884572 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b779e-0953-4973-8f4b-0c45513ab851 admin admin] PATH_INFO: `/v3/projects/2b3cd967662e426b97bb01a15ef15319/users/31b8c49f81704c9795ab3541f71ac316/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:02.886741 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b779e-0953-4973-8f4b-0c45513ab851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b3cd967662e426b97bb01a15ef15319, user_id=31b8c49f81704c9795ab3541f71ac316, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:02.889370 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b779e-0953-4973-8f4b-0c45513ab851 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:02.900258 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1348/2732] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:02 2022] PUT /identity/v3/projects/2b3cd967662e426b97bb01a15ef15319/users/31b8c49f81704c9795ab3541f71ac316/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:02.954406 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1385/2733] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:13:02 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:13:02.964924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b779e-0953-4973-8f4b-0c45513ab851 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:02.968098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d22248-d070-421b-b762-d288f42e4ace None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:02.968486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d22248-d070-421b-b762-d288f42e4ace None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:02.968854 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d22248-d070-421b-b762-d288f42e4ace None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:02.993591 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:02.998686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-f0d22248-d070-421b-b762-d288f42e4ace None None] MFA Rules not processed for user `31b8c49f81704c9795ab3541f71ac316`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:02.999896 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f0d22248-d070-421b-b762-d288f42e4ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:03.031709 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b779e-0953-4973-8f4b-0c45513ab851 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:03.037775 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd5c95-f16e-4f3f-8ada-a1bf971704f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:03.038465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd5c95-f16e-4f3f-8ada-a1bf971704f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:03.038746 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd5c95-f16e-4f3f-8ada-a1bf971704f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:03.039021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30dd5c95-f16e-4f3f-8ada-a1bf971704f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:03.039667 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd5c95-f16e-4f3f-8ada-a1bf971704f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:03.041288 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30dd5c95-f16e-4f3f-8ada-a1bf971704f7 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:03.055338 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1349/2734] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:02 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:03.056180 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd5c95-f16e-4f3f-8ada-a1bf971704f7 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:03.062907 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:03.068492 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30dd5c95-f16e-4f3f-8ada-a1bf971704f7 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:03.073597 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9038c3-99de-412b-9d14-8d7e439df524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:03.075394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9038c3-99de-412b-9d14-8d7e439df524 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:03.075394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9038c3-99de-412b-9d14-8d7e439df524 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:03.075394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9038c3-99de-412b-9d14-8d7e439df524 admin admin] PATH_INFO: `/v3/projects/9da4eb8ae1ec41e886583224ad2bca4a/users/6a03db1751044528bef24c8a44aa6e07/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:03.088676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1386/2735] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:02 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:13:03.091621 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9038c3-99de-412b-9d14-8d7e439df524 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da4eb8ae1ec41e886583224ad2bca4a, user_id=6a03db1751044528bef24c8a44aa6e07, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:03.094459 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9038c3-99de-412b-9d14-8d7e439df524 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:03.101331 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d22248-d070-421b-b762-d288f42e4ace None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:03.103900 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f0d22248-d070-421b-b762-d288f42e4ace None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:03.159311 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d22248-d070-421b-b762-d288f42e4ace None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:03.162997 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004394b-9d54-44cf-af0d-7bb4600ba42e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:03.163609 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004394b-9d54-44cf-af0d-7bb4600ba42e service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:03.163891 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004394b-9d54-44cf-af0d-7bb4600ba42e service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:03.164265 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004394b-9d54-44cf-af0d-7bb4600ba42e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:03.173369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004394b-9d54-44cf-af0d-7bb4600ba42e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:03.174822 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004394b-9d54-44cf-af0d-7bb4600ba42e service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:03.184563 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1387/2736] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:03 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:13:03.188341 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1350/2737] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:03 2022] PUT /identity/v3/projects/9da4eb8ae1ec41e886583224ad2bca4a/users/6a03db1751044528bef24c8a44aa6e07/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:03.192561 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004394b-9d54-44cf-af0d-7bb4600ba42e service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:03.204583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004394b-9d54-44cf-af0d-7bb4600ba42e service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:03.285500 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a023271-23c0-43ed-8143-bee6e9e1330c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:03.286166 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a023271-23c0-43ed-8143-bee6e9e1330c admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:03.286450 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a023271-23c0-43ed-8143-bee6e9e1330c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:03.286859 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a023271-23c0-43ed-8143-bee6e9e1330c admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:03.287618 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a023271-23c0-43ed-8143-bee6e9e1330c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:03.289337 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a023271-23c0-43ed-8143-bee6e9e1330c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:03.309919 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1388/2738] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:03 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:03.310951 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9038c3-99de-412b-9d14-8d7e439df524 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:03.326130 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9038c3-99de-412b-9d14-8d7e439df524 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:03.332887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41daa9-8b59-4e4d-9176-06a8c2b7d698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:03.333248 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41daa9-8b59-4e4d-9176-06a8c2b7d698 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:03.333529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41daa9-8b59-4e4d-9176-06a8c2b7d698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:03.333840 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41daa9-8b59-4e4d-9176-06a8c2b7d698 admin admin] PATH_INFO: `/v3/projects/9da4eb8ae1ec41e886583224ad2bca4a/users/6a03db1751044528bef24c8a44aa6e07/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:03.335759 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41daa9-8b59-4e4d-9176-06a8c2b7d698 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9da4eb8ae1ec41e886583224ad2bca4a, user_id=6a03db1751044528bef24c8a44aa6e07, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:03.338799 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41daa9-8b59-4e4d-9176-06a8c2b7d698 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:03.341646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a023271-23c0-43ed-8143-bee6e9e1330c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:03.350282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1351/2739] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:03 2022] PUT /identity/v3/projects/9da4eb8ae1ec41e886583224ad2bca4a/users/6a03db1751044528bef24c8a44aa6e07/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:03.353248 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a023271-23c0-43ed-8143-bee6e9e1330c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:03.359663 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41daa9-8b59-4e4d-9176-06a8c2b7d698 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:03.362087 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1f41daa9-8b59-4e4d-9176-06a8c2b7d698 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:03.413044 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b02214-c2f7-4421-9bd7-4b6cb3962621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:03.413671 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b02214-c2f7-4421-9bd7-4b6cb3962621 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:03.413973 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b02214-c2f7-4421-9bd7-4b6cb3962621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:03.414339 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b02214-c2f7-4421-9bd7-4b6cb3962621 admin admin] PATH_INFO: `/v3/users/ce5875a8a8174fd6bbcde3129024733d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:03.415374 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b02214-c2f7-4421-9bd7-4b6cb3962621 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce5875a8a8174fd6bbcde3129024733d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:03.417279 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b02214-c2f7-4421-9bd7-4b6cb3962621 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:03.419388 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41daa9-8b59-4e4d-9176-06a8c2b7d698 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:03.423441 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d224c3-40ac-45b7-b749-0f8ce1d5b900 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:03.424036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d224c3-40ac-45b7-b749-0f8ce1d5b900 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:03.424310 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d224c3-40ac-45b7-b749-0f8ce1d5b900 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:03.425098 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d224c3-40ac-45b7-b749-0f8ce1d5b900 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:03.426886 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-53d224c3-40ac-45b7-b749-0f8ce1d5b900 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:03.442329 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:03.484484 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d224c3-40ac-45b7-b749-0f8ce1d5b900 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:03.485926 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d224c3-40ac-45b7-b749-0f8ce1d5b900 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:03.495152 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1352/2740] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:13:03.496482 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc42dd7-687b-44c5-897b-4044dcefdf67 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:03.496764 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc42dd7-687b-44c5-897b-4044dcefdf67 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:03.497036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc42dd7-687b-44c5-897b-4044dcefdf67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:03.526027 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-7cc42dd7-687b-44c5-897b-4044dcefdf67 None None] MFA Rules not processed for user `6a03db1751044528bef24c8a44aa6e07`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:03.528054 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-7cc42dd7-687b-44c5-897b-4044dcefdf67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:03.556240 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:03.599566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1353/2741] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:03 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:03.610323 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc42dd7-687b-44c5-897b-4044dcefdf67 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:03.619968 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc42dd7-687b-44c5-897b-4044dcefdf67 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:03.623528 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e3e40-f30b-49c7-96f3-57840861623b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:03.624106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e3e40-f30b-49c7-96f3-57840861623b service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:03.624382 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e3e40-f30b-49c7-96f3-57840861623b service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:03.624650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e3e40-f30b-49c7-96f3-57840861623b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:03.633962 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e3e40-f30b-49c7-96f3-57840861623b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:03.635439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e3e40-f30b-49c7-96f3-57840861623b service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:03.644923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1354/2742] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:03 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:13:03.653613 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b7b02214-c2f7-4421-9bd7-4b6cb3962621 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce5875a8a8174fd6bbcde3129024733d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:03.742562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b7b02214-c2f7-4421-9bd7-4b6cb3962621 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce5875a8a8174fd6bbcde3129024733d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:03.756077 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b7b02214-c2f7-4421-9bd7-4b6cb3962621 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce5875a8a8174fd6bbcde3129024733d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:03.756706 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b7b02214-c2f7-4421-9bd7-4b6cb3962621 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce5875a8a8174fd6bbcde3129024733d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:03.763809 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b7b02214-c2f7-4421-9bd7-4b6cb3962621 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce5875a8a8174fd6bbcde3129024733d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:03.770725 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1389/2743] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:13:03 2022] DELETE /identity/v3/users/ce5875a8a8174fd6bbcde3129024733d => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:03.777389 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679c066-4090-40db-ab1a-58af313d2998 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:03.778017 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679c066-4090-40db-ab1a-58af313d2998 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:03.778017 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a679c066-4090-40db-ab1a-58af313d2998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:03.800796 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-a679c066-4090-40db-ab1a-58af313d2998 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:03.802069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a679c066-4090-40db-ab1a-58af313d2998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:03.860267 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1355/2744] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:13:03.870706 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b02214-c2f7-4421-9bd7-4b6cb3962621 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:03.874428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b7b02214-c2f7-4421-9bd7-4b6cb3962621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:03.937801 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b02214-c2f7-4421-9bd7-4b6cb3962621 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:03.941533 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c2506-8f75-42dc-8ad5-57a556bf0019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:03.942186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c2506-8f75-42dc-8ad5-57a556bf0019 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:03.942463 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c2506-8f75-42dc-8ad5-57a556bf0019 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:03.942736 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c2506-8f75-42dc-8ad5-57a556bf0019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:03.951557 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c2506-8f75-42dc-8ad5-57a556bf0019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:03.953025 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c2506-8f75-42dc-8ad5-57a556bf0019 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:03.962774 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1390/2745] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:13:04.375727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679c066-4090-40db-ab1a-58af313d2998 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:04.378395 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a679c066-4090-40db-ab1a-58af313d2998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:04.392115 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a679c066-4090-40db-ab1a-58af313d2998 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:04.397965 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f290b6e-30cc-47c6-a207-86b5b02d52e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:04.398650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f290b6e-30cc-47c6-a207-86b5b02d52e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:04.398870 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f290b6e-30cc-47c6-a207-86b5b02d52e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:04.399206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f290b6e-30cc-47c6-a207-86b5b02d52e8 admin admin] PATH_INFO: `/v3/projects/df90592f687044e29d006da1d28b388b` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:04.400396 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f290b6e-30cc-47c6-a207-86b5b02d52e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df90592f687044e29d006da1d28b388b)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:04.402443 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f290b6e-30cc-47c6-a207-86b5b02d52e8 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:04.553183 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2f290b6e-30cc-47c6-a207-86b5b02d52e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df90592f687044e29d006da1d28b388b', 'request_id': 'req-2f290b6e-30cc-47c6-a207-86b5b02d52e8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:04.559025 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2f290b6e-30cc-47c6-a207-86b5b02d52e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df90592f687044e29d006da1d28b388b', 'request_id': 'req-2f290b6e-30cc-47c6-a207-86b5b02d52e8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:04.565500 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2f290b6e-30cc-47c6-a207-86b5b02d52e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df90592f687044e29d006da1d28b388b', 'request_id': 'req-2f290b6e-30cc-47c6-a207-86b5b02d52e8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:04.642696 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2f290b6e-30cc-47c6-a207-86b5b02d52e8 admin admin] The token cache is being invalidate because project df90592f687044e29d006da1d28b388b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:13:04.643017 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2f290b6e-30cc-47c6-a207-86b5b02d52e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:04.643777 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2f290b6e-30cc-47c6-a207-86b5b02d52e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:04.645812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1356/2746] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:13:04 2022] DELETE /identity/v3/projects/df90592f687044e29d006da1d28b388b => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:04.657729 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c2506-8f75-42dc-8ad5-57a556bf0019 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:04.668564 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c2506-8f75-42dc-8ad5-57a556bf0019 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:04.724756 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada4638-d7a1-4cb6-8b71-31546f484853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:04.725385 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada4638-d7a1-4cb6-8b71-31546f484853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:04.725668 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada4638-d7a1-4cb6-8b71-31546f484853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:04.725983 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ada4638-d7a1-4cb6-8b71-31546f484853 admin admin] PATH_INFO: `/v3/users/31b8c49f81704c9795ab3541f71ac316` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:04.727098 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada4638-d7a1-4cb6-8b71-31546f484853 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31b8c49f81704c9795ab3541f71ac316)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:04.729020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ada4638-d7a1-4cb6-8b71-31546f484853 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:04.952454 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:04.955212 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7ada4638-d7a1-4cb6-8b71-31546f484853 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31b8c49f81704c9795ab3541f71ac316'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:05.016619 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f290b6e-30cc-47c6-a207-86b5b02d52e8 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:05.018053 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2f290b6e-30cc-47c6-a207-86b5b02d52e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:05.051769 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7ada4638-d7a1-4cb6-8b71-31546f484853 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31b8c49f81704c9795ab3541f71ac316'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:05.055450 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:05.065107 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7ada4638-d7a1-4cb6-8b71-31546f484853 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31b8c49f81704c9795ab3541f71ac316'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:05.066387 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7ada4638-d7a1-4cb6-8b71-31546f484853 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31b8c49f81704c9795ab3541f71ac316'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:05.076935 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-7ada4638-d7a1-4cb6-8b71-31546f484853 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31b8c49f81704c9795ab3541f71ac316'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:05.082195 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f290b6e-30cc-47c6-a207-86b5b02d52e8 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:05.087840 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1391/2747] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:13:04 2022] DELETE /identity/v3/users/31b8c49f81704c9795ab3541f71ac316 => generated 0 bytes in 428 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:05.091275 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1a032d-a3f0-4d1d-8770-7193429402b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:05.091275 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a032d-a3f0-4d1d-8770-7193429402b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:05.091275 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a032d-a3f0-4d1d-8770-7193429402b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:05.091275 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1a032d-a3f0-4d1d-8770-7193429402b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:05.091805 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1e1a032d-a3f0-4d1d-8770-7193429402b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:05.155934 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a032d-a3f0-4d1d-8770-7193429402b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:05.157385 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1a032d-a3f0-4d1d-8770-7193429402b9 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:05.167682 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1357/2748] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:13:05.505513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada4638-d7a1-4cb6-8b71-31546f484853 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:05.507896 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7ada4638-d7a1-4cb6-8b71-31546f484853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:05.589013 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ada4638-d7a1-4cb6-8b71-31546f484853 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:05.593700 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849c2721-3311-465a-976e-b8db0be0ea3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:05.594360 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c2721-3311-465a-976e-b8db0be0ea3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:05.594637 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c2721-3311-465a-976e-b8db0be0ea3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:05.594931 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849c2721-3311-465a-976e-b8db0be0ea3a admin admin] PATH_INFO: `/v3/projects/2b3cd967662e426b97bb01a15ef15319` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:05.596023 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c2721-3311-465a-976e-b8db0be0ea3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b3cd967662e426b97bb01a15ef15319)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:05.597962 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849c2721-3311-465a-976e-b8db0be0ea3a admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:05.710687 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-849c2721-3311-465a-976e-b8db0be0ea3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b3cd967662e426b97bb01a15ef15319', 'request_id': 'req-849c2721-3311-465a-976e-b8db0be0ea3a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:05.822659 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-849c2721-3311-465a-976e-b8db0be0ea3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b3cd967662e426b97bb01a15ef15319', 'request_id': 'req-849c2721-3311-465a-976e-b8db0be0ea3a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:05.828733 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-849c2721-3311-465a-976e-b8db0be0ea3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b3cd967662e426b97bb01a15ef15319', 'request_id': 'req-849c2721-3311-465a-976e-b8db0be0ea3a'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:05.840933 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-849c2721-3311-465a-976e-b8db0be0ea3a admin admin] The token cache is being invalidate because project 2b3cd967662e426b97bb01a15ef15319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:13:05.841219 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-849c2721-3311-465a-976e-b8db0be0ea3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:05.841903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-849c2721-3311-465a-976e-b8db0be0ea3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:05.843394 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1392/2749] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:13:05 2022] DELETE /identity/v3/projects/2b3cd967662e426b97bb01a15ef15319 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:05.849530 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ec987-b598-4ff1-955e-d15d15d4f790 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:05.850033 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ec987-b598-4ff1-955e-d15d15d4f790 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:05.850136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ec987-b598-4ff1-955e-d15d15d4f790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:05.883359 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-f97ec987-b598-4ff1-955e-d15d15d4f790 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:05.884612 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f97ec987-b598-4ff1-955e-d15d15d4f790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:05.959301 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1358/2750] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:05.967085 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca70198-71e5-4738-94b7-7cf22c0cad1d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:05.967381 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca70198-71e5-4738-94b7-7cf22c0cad1d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:05.968223 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca70198-71e5-4738-94b7-7cf22c0cad1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:05.988211 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-7ca70198-71e5-4738-94b7-7cf22c0cad1d None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:05.989421 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7ca70198-71e5-4738-94b7-7cf22c0cad1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:05.997563 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1393/2751] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:06.001880 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ec987-b598-4ff1-955e-d15d15d4f790 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:06.011628 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ec987-b598-4ff1-955e-d15d15d4f790 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:06.016197 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32461ea3-46cd-4e55-87a6-3f99b02b7ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:06.016804 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32461ea3-46cd-4e55-87a6-3f99b02b7ac9 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:06.017081 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32461ea3-46cd-4e55-87a6-3f99b02b7ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:06.017390 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32461ea3-46cd-4e55-87a6-3f99b02b7ac9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:06.018049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32461ea3-46cd-4e55-87a6-3f99b02b7ac9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:13:06.018855 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32461ea3-46cd-4e55-87a6-3f99b02b7ac9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:06.020415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32461ea3-46cd-4e55-87a6-3f99b02b7ac9 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:06.032312 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1359/2752] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:13:06.037015 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca70198-71e5-4738-94b7-7cf22c0cad1d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:06.047138 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca70198-71e5-4738-94b7-7cf22c0cad1d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:06.052079 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259af47-ba12-4878-8d95-c1985604b4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:06.052704 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259af47-ba12-4878-8d95-c1985604b4cc admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:06.052949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259af47-ba12-4878-8d95-c1985604b4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:06.053218 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1259af47-ba12-4878-8d95-c1985604b4cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:06.053960 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259af47-ba12-4878-8d95-c1985604b4cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:06.055928 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1259af47-ba12-4878-8d95-c1985604b4cc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:06.177757 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1394/2753] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:13:06 2022] POST /identity/v3/projects => generated 405 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:13:06.181538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32461ea3-46cd-4e55-87a6-3f99b02b7ac9 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:06.191936 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32461ea3-46cd-4e55-87a6-3f99b02b7ac9 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:06.248227 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857f94c-c226-4a81-b61f-7d42c483eda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:06.248830 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857f94c-c226-4a81-b61f-7d42c483eda9 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:06.249109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857f94c-c226-4a81-b61f-7d42c483eda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:06.249379 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5857f94c-c226-4a81-b61f-7d42c483eda9 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:06.250043 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5857f94c-c226-4a81-b61f-7d42c483eda9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:06.251989 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5857f94c-c226-4a81-b61f-7d42c483eda9 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:06.329440 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:06.336604 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1360/2754] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:13:06 2022] POST /identity/v3/users => generated 303 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:13:06.346283 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259af47-ba12-4878-8d95-c1985604b4cc admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:06.356824 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1259af47-ba12-4878-8d95-c1985604b4cc admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:06.361573 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358164ac-b4d9-45ef-8ba9-b59c70b55092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:06.362260 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358164ac-b4d9-45ef-8ba9-b59c70b55092 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:06.362544 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358164ac-b4d9-45ef-8ba9-b59c70b55092 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:06.362815 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358164ac-b4d9-45ef-8ba9-b59c70b55092 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:06.363455 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358164ac-b4d9-45ef-8ba9-b59c70b55092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:06.365046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358164ac-b4d9-45ef-8ba9-b59c70b55092 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:06.374927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1395/2755] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:06.379703 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857f94c-c226-4a81-b61f-7d42c483eda9 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:06.389582 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5857f94c-c226-4a81-b61f-7d42c483eda9 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:06.394875 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978561f-43f6-47cd-9363-ac95872e7e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:06.395470 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978561f-43f6-47cd-9363-ac95872e7e86 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:06.395776 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978561f-43f6-47cd-9363-ac95872e7e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:06.396051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978561f-43f6-47cd-9363-ac95872e7e86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:06.396688 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978561f-43f6-47cd-9363-ac95872e7e86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:06.398356 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978561f-43f6-47cd-9363-ac95872e7e86 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:06.408795 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1361/2756] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:06.415382 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358164ac-b4d9-45ef-8ba9-b59c70b55092 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:06.425709 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358164ac-b4d9-45ef-8ba9-b59c70b55092 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:06.430348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980620a1-ec87-453a-abcb-c3538440c3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:06.430972 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980620a1-ec87-453a-abcb-c3538440c3fc admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:06.431250 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980620a1-ec87-453a-abcb-c3538440c3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:06.431597 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980620a1-ec87-453a-abcb-c3538440c3fc admin admin] PATH_INFO: `/v3/projects/9f24bc8192b7444591d9043854977ddd/users/ac238f3be2544e74b765aabf281a405f/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:06.443589 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:06.447695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980620a1-ec87-453a-abcb-c3538440c3fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f24bc8192b7444591d9043854977ddd, user_id=ac238f3be2544e74b765aabf281a405f, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:06.450357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980620a1-ec87-453a-abcb-c3538440c3fc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:06.532480 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1396/2757] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:06 2022] PUT /identity/v3/projects/9f24bc8192b7444591d9043854977ddd/users/ac238f3be2544e74b765aabf281a405f/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:06.544299 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc120a6-1df8-4f10-aaf2-52bbb664f906 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:06.544587 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc120a6-1df8-4f10-aaf2-52bbb664f906 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:06.544946 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc120a6-1df8-4f10-aaf2-52bbb664f906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:06.577394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-2dc120a6-1df8-4f10-aaf2-52bbb664f906 None None] MFA Rules not processed for user `ac238f3be2544e74b765aabf281a405f`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:06.578964 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2dc120a6-1df8-4f10-aaf2-52bbb664f906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:06.650771 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1362/2758] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:06 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:06.655446 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980620a1-ec87-453a-abcb-c3538440c3fc admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:06.717115 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980620a1-ec87-453a-abcb-c3538440c3fc admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:06.722426 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8437c6-5faa-4d00-9ca1-3e920791f425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:06.723030 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8437c6-5faa-4d00-9ca1-3e920791f425 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:06.723335 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8437c6-5faa-4d00-9ca1-3e920791f425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:06.723660 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8437c6-5faa-4d00-9ca1-3e920791f425 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:06.724462 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8437c6-5faa-4d00-9ca1-3e920791f425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:06.726126 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8437c6-5faa-4d00-9ca1-3e920791f425 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:06.737831 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc120a6-1df8-4f10-aaf2-52bbb664f906 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:06.739259 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2dc120a6-1df8-4f10-aaf2-52bbb664f906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:06.753201 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc120a6-1df8-4f10-aaf2-52bbb664f906 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:06.757774 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de884d01-1aec-476b-9c4e-250aef6da37d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:06.758399 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de884d01-1aec-476b-9c4e-250aef6da37d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:06.758675 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de884d01-1aec-476b-9c4e-250aef6da37d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:06.758945 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de884d01-1aec-476b-9c4e-250aef6da37d admin admin] PATH_INFO: `/v3/users/e671fc5ff394437e85b1cc70eab7fe21` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:06.760048 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de884d01-1aec-476b-9c4e-250aef6da37d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e671fc5ff394437e85b1cc70eab7fe21)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:06.761995 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de884d01-1aec-476b-9c4e-250aef6da37d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:06.825380 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1397/2759] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:13:06 2022] POST /identity/v3/projects => generated 409 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:13:06.829746 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8437c6-5faa-4d00-9ca1-3e920791f425 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:06.891285 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8437c6-5faa-4d00-9ca1-3e920791f425 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:06.896678 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce0cf4-45ee-44d9-814c-dcb7b5857797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:06.897290 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce0cf4-45ee-44d9-814c-dcb7b5857797 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:06.897570 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce0cf4-45ee-44d9-814c-dcb7b5857797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:06.897878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ce0cf4-45ee-44d9-814c-dcb7b5857797 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:06.898514 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce0cf4-45ee-44d9-814c-dcb7b5857797 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:06.900437 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ce0cf4-45ee-44d9-814c-dcb7b5857797 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:06.939322 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-de884d01-1aec-476b-9c4e-250aef6da37d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e671fc5ff394437e85b1cc70eab7fe21'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:07.011479 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1398/2760] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:13:06 2022] POST /identity/v3/users => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:13:07.014151 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-de884d01-1aec-476b-9c4e-250aef6da37d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e671fc5ff394437e85b1cc70eab7fe21'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:07.015254 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce0cf4-45ee-44d9-814c-dcb7b5857797 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:07.026618 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ce0cf4-45ee-44d9-814c-dcb7b5857797 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:07.030489 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-de884d01-1aec-476b-9c4e-250aef6da37d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e671fc5ff394437e85b1cc70eab7fe21'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:07.031458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-de884d01-1aec-476b-9c4e-250aef6da37d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e671fc5ff394437e85b1cc70eab7fe21'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:07.031983 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0862c41-fecc-4c84-953f-bff0d4c780c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:07.032596 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0862c41-fecc-4c84-953f-bff0d4c780c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:07.032879 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0862c41-fecc-4c84-953f-bff0d4c780c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:07.033274 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0862c41-fecc-4c84-953f-bff0d4c780c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:07.033957 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0862c41-fecc-4c84-953f-bff0d4c780c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:07.035765 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0862c41-fecc-4c84-953f-bff0d4c780c1 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:07.041101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-de884d01-1aec-476b-9c4e-250aef6da37d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e671fc5ff394437e85b1cc70eab7fe21'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:07.050004 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1363/2761] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:13:06 2022] DELETE /identity/v3/users/e671fc5ff394437e85b1cc70eab7fe21 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:07.054017 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1399/2762] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:07.056305 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20425e8-f000-4e7c-9852-61610ec89dd1 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:07.056906 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20425e8-f000-4e7c-9852-61610ec89dd1 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:07.057394 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20425e8-f000-4e7c-9852-61610ec89dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:07.058017 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0862c41-fecc-4c84-953f-bff0d4c780c1 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:07.059801 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-f0862c41-fecc-4c84-953f-bff0d4c780c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:07.073556 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0862c41-fecc-4c84-953f-bff0d4c780c1 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:07.082408 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-a20425e8-f000-4e7c-9852-61610ec89dd1 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:07.084398 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a20425e8-f000-4e7c-9852-61610ec89dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:07.129343 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:07.133486 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:07.141970 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95cb59-09cf-408d-bd78-124f79037e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:07.141970 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95cb59-09cf-408d-bd78-124f79037e16 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:07.141970 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95cb59-09cf-408d-bd78-124f79037e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:07.141970 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f95cb59-09cf-408d-bd78-124f79037e16 admin admin] PATH_INFO: `/v3/projects/1f8c9415a3324729a1eb8b4cb3343f80/users/e3bdfe940cde4e339cd53d5e60c10e4c/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:07.151907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1364/2763] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:13:07.163626 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20425e8-f000-4e7c-9852-61610ec89dd1 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:07.166186 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a20425e8-f000-4e7c-9852-61610ec89dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:07.228109 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20425e8-f000-4e7c-9852-61610ec89dd1 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:07.232121 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96029c7a-102a-40c5-b844-fcd7f2d44512 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:07.232882 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96029c7a-102a-40c5-b844-fcd7f2d44512 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:07.233168 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96029c7a-102a-40c5-b844-fcd7f2d44512 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:07.233447 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96029c7a-102a-40c5-b844-fcd7f2d44512 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:07.244861 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96029c7a-102a-40c5-b844-fcd7f2d44512 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:07.246454 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96029c7a-102a-40c5-b844-fcd7f2d44512 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:07.258247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1365/2764] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:13:07.285080 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95cb59-09cf-408d-bd78-124f79037e16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f8c9415a3324729a1eb8b4cb3343f80, user_id=e3bdfe940cde4e339cd53d5e60c10e4c, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:07.285520 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f95cb59-09cf-408d-bd78-124f79037e16 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:07.366138 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1400/2765] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:07 2022] PUT /identity/v3/projects/1f8c9415a3324729a1eb8b4cb3343f80/users/e3bdfe940cde4e339cd53d5e60c10e4c/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:07.370133 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96029c7a-102a-40c5-b844-fcd7f2d44512 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:07.380339 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96029c7a-102a-40c5-b844-fcd7f2d44512 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:07.435607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eaac94-669f-4b04-bad4-c4313c230258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:07.436205 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaac94-669f-4b04-bad4-c4313c230258 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:07.436486 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaac94-669f-4b04-bad4-c4313c230258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:07.436761 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eaac94-669f-4b04-bad4-c4313c230258 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:07.437393 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eaac94-669f-4b04-bad4-c4313c230258 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:07.439094 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eaac94-669f-4b04-bad4-c4313c230258 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:07.449383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1366/2766] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:07.453526 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95cb59-09cf-408d-bd78-124f79037e16 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:07.464142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f95cb59-09cf-408d-bd78-124f79037e16 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:07.468884 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ee1bf-01a8-4e06-88b4-1d68266c5670 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:07.469534 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ee1bf-01a8-4e06-88b4-1d68266c5670 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:07.469843 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ee1bf-01a8-4e06-88b4-1d68266c5670 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:07.470115 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650ee1bf-01a8-4e06-88b4-1d68266c5670 admin admin] PATH_INFO: `/v3/projects/1f8c9415a3324729a1eb8b4cb3343f80/users/e3bdfe940cde4e339cd53d5e60c10e4c/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:07.472044 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ee1bf-01a8-4e06-88b4-1d68266c5670 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f8c9415a3324729a1eb8b4cb3343f80, user_id=e3bdfe940cde4e339cd53d5e60c10e4c, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:07.474693 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650ee1bf-01a8-4e06-88b4-1d68266c5670 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:07.485560 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1401/2767] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:07 2022] PUT /identity/v3/projects/1f8c9415a3324729a1eb8b4cb3343f80/users/e3bdfe940cde4e339cd53d5e60c10e4c/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:07.497667 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6742021-ba72-4f84-9a6e-af84908aea80 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:07.498030 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6742021-ba72-4f84-9a6e-af84908aea80 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:07.498307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6742021-ba72-4f84-9a6e-af84908aea80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:07.528745 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-a6742021-ba72-4f84-9a6e-af84908aea80 None None] MFA Rules not processed for user `e3bdfe940cde4e339cd53d5e60c10e4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:07.530480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a6742021-ba72-4f84-9a6e-af84908aea80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:07.604988 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1367/2768] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:07 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:07.616887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ee1bf-01a8-4e06-88b4-1d68266c5670 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:07.618596 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-650ee1bf-01a8-4e06-88b4-1d68266c5670 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:07.678336 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650ee1bf-01a8-4e06-88b4-1d68266c5670 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:07.681976 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f45c86-d76c-42da-aba4-e8a7f31fe2f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:07.682686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f45c86-d76c-42da-aba4-e8a7f31fe2f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:07.682963 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f45c86-d76c-42da-aba4-e8a7f31fe2f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:07.683238 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f45c86-d76c-42da-aba4-e8a7f31fe2f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:07.695428 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f45c86-d76c-42da-aba4-e8a7f31fe2f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:07.695601 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6742021-ba72-4f84-9a6e-af84908aea80 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:07.696878 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f45c86-d76c-42da-aba4-e8a7f31fe2f6 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:07.697466 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a6742021-ba72-4f84-9a6e-af84908aea80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:07.708117 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1402/2769] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:07 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:13:07.722102 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=100 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:07.790857 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6742021-ba72-4f84-9a6e-af84908aea80 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:07.795654 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e4f4c-7a47-4cea-ac9b-1e5b801f5d5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:07.796282 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e4f4c-7a47-4cea-ac9b-1e5b801f5d5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:07.796557 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e4f4c-7a47-4cea-ac9b-1e5b801f5d5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:07.796826 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73e4f4c-7a47-4cea-ac9b-1e5b801f5d5a admin admin] PATH_INFO: `/v3/projects/f2438c3e70364732ba846688bdb25552` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:07.798384 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e4f4c-7a47-4cea-ac9b-1e5b801f5d5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2438c3e70364732ba846688bdb25552)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:07.801053 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73e4f4c-7a47-4cea-ac9b-1e5b801f5d5a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:07.941351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d73e4f4c-7a47-4cea-ac9b-1e5b801f5d5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2438c3e70364732ba846688bdb25552', 'request_id': 'req-d73e4f4c-7a47-4cea-ac9b-1e5b801f5d5a'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:07.947226 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d73e4f4c-7a47-4cea-ac9b-1e5b801f5d5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2438c3e70364732ba846688bdb25552', 'request_id': 'req-d73e4f4c-7a47-4cea-ac9b-1e5b801f5d5a'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:07.953685 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d73e4f4c-7a47-4cea-ac9b-1e5b801f5d5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2438c3e70364732ba846688bdb25552', 'request_id': 'req-d73e4f4c-7a47-4cea-ac9b-1e5b801f5d5a'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:08.059723 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d73e4f4c-7a47-4cea-ac9b-1e5b801f5d5a admin admin] The token cache is being invalidate because project f2438c3e70364732ba846688bdb25552 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:13:08.060244 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d73e4f4c-7a47-4cea-ac9b-1e5b801f5d5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:08.061012 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d73e4f4c-7a47-4cea-ac9b-1e5b801f5d5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:08.062614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1368/2770] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:13:07 2022] DELETE /identity/v3/projects/f2438c3e70364732ba846688bdb25552 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:08.066645 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f45c86-d76c-42da-aba4-e8a7f31fe2f6 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:08.076955 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f45c86-d76c-42da-aba4-e8a7f31fe2f6 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:08.125327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e4f4c-7a47-4cea-ac9b-1e5b801f5d5a admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:08.127325 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d73e4f4c-7a47-4cea-ac9b-1e5b801f5d5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:08.144871 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e00c1-6c72-4c1c-aca3-e70d1bd0a3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:08.145516 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e00c1-6c72-4c1c-aca3-e70d1bd0a3fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:08.145825 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e00c1-6c72-4c1c-aca3-e70d1bd0a3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:08.146105 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e00c1-6c72-4c1c-aca3-e70d1bd0a3fc admin admin] PATH_INFO: `/v3/users/6a03db1751044528bef24c8a44aa6e07` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:08.147288 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e00c1-6c72-4c1c-aca3-e70d1bd0a3fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a03db1751044528bef24c8a44aa6e07)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:08.149808 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e00c1-6c72-4c1c-aca3-e70d1bd0a3fc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:08.197791 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73e4f4c-7a47-4cea-ac9b-1e5b801f5d5a admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:08.201538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b48bb2-243e-4225-af99-1704135f1af0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:08.202199 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b48bb2-243e-4225-af99-1704135f1af0 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:08.202530 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b48bb2-243e-4225-af99-1704135f1af0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:08.202809 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b48bb2-243e-4225-af99-1704135f1af0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:08.204570 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b9b48bb2-243e-4225-af99-1704135f1af0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:08.267444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b48bb2-243e-4225-af99-1704135f1af0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:08.269046 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b48bb2-243e-4225-af99-1704135f1af0 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:08.275086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:08.284562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1369/2771] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:08 2022] GET /identity/v3/auth/tokens => generated 3282 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:13:08.387525 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bc5e00c1-6c72-4c1c-aca3-e70d1bd0a3fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a03db1751044528bef24c8a44aa6e07'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:08.456954 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bc5e00c1-6c72-4c1c-aca3-e70d1bd0a3fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a03db1751044528bef24c8a44aa6e07'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:08.469269 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:08.472295 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bc5e00c1-6c72-4c1c-aca3-e70d1bd0a3fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a03db1751044528bef24c8a44aa6e07'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:08.473165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bc5e00c1-6c72-4c1c-aca3-e70d1bd0a3fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a03db1751044528bef24c8a44aa6e07'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:08.480529 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-bc5e00c1-6c72-4c1c-aca3-e70d1bd0a3fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a03db1751044528bef24c8a44aa6e07'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:08.488806 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1403/2772] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:13:08 2022] DELETE /identity/v3/users/6a03db1751044528bef24c8a44aa6e07 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:08.896945 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b48bb2-243e-4225-af99-1704135f1af0 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:08.898458 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b9b48bb2-243e-4225-af99-1704135f1af0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:08.914055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b48bb2-243e-4225-af99-1704135f1af0 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:08.981816 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d02549-3174-4bcc-a7b4-613a43478a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:08.987930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d02549-3174-4bcc-a7b4-613a43478a3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:08.987930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d02549-3174-4bcc-a7b4-613a43478a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:08.987930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d02549-3174-4bcc-a7b4-613a43478a3e admin admin] PATH_INFO: `/v3/projects/9da4eb8ae1ec41e886583224ad2bca4a` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:08.987930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d02549-3174-4bcc-a7b4-613a43478a3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9da4eb8ae1ec41e886583224ad2bca4a)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:08.987930 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d02549-3174-4bcc-a7b4-613a43478a3e admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:09.130558 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-09d02549-3174-4bcc-a7b4-613a43478a3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9da4eb8ae1ec41e886583224ad2bca4a', 'request_id': 'req-09d02549-3174-4bcc-a7b4-613a43478a3e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:09.137441 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-09d02549-3174-4bcc-a7b4-613a43478a3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9da4eb8ae1ec41e886583224ad2bca4a', 'request_id': 'req-09d02549-3174-4bcc-a7b4-613a43478a3e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:09.144677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-09d02549-3174-4bcc-a7b4-613a43478a3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9da4eb8ae1ec41e886583224ad2bca4a', 'request_id': 'req-09d02549-3174-4bcc-a7b4-613a43478a3e'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:09.271536 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-09d02549-3174-4bcc-a7b4-613a43478a3e admin admin] The token cache is being invalidate because project 9da4eb8ae1ec41e886583224ad2bca4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:13:09.271853 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-09d02549-3174-4bcc-a7b4-613a43478a3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:09.272463 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-09d02549-3174-4bcc-a7b4-613a43478a3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:09.273995 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1370/2773] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:13:08 2022] DELETE /identity/v3/projects/9da4eb8ae1ec41e886583224ad2bca4a => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:09.279123 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9ef03-dded-4b8b-b326-848d512d6f8d None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:09.279611 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9ef03-dded-4b8b-b326-848d512d6f8d None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:09.279739 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d9ef03-dded-4b8b-b326-848d512d6f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:09.299678 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-43d9ef03-dded-4b8b-b326-848d512d6f8d None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:09.300892 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-43d9ef03-dded-4b8b-b326-848d512d6f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:09.359407 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1404/2774] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:09.367511 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572b8c6-d08b-44af-8825-26a89d470725 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:09.367742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572b8c6-d08b-44af-8825-26a89d470725 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:09.368049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b572b8c6-d08b-44af-8825-26a89d470725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:09.389913 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-b572b8c6-d08b-44af-8825-26a89d470725 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:09.391130 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b572b8c6-d08b-44af-8825-26a89d470725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:09.399802 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1371/2775] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:09.404120 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9ef03-dded-4b8b-b326-848d512d6f8d None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:09.413674 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d9ef03-dded-4b8b-b326-848d512d6f8d None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:09.418550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5a97e-5d37-4cb1-b939-9a5b2e80282c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:09.419197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5a97e-5d37-4cb1-b939-9a5b2e80282c admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:09.419485 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5a97e-5d37-4cb1-b939-9a5b2e80282c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:09.419756 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d5a97e-5d37-4cb1-b939-9a5b2e80282c admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:09.420436 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5a97e-5d37-4cb1-b939-9a5b2e80282c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:13:09.420741 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5a97e-5d37-4cb1-b939-9a5b2e80282c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:09.422452 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d5a97e-5d37-4cb1-b939-9a5b2e80282c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:09.434468 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1405/2776] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:13:09.438804 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572b8c6-d08b-44af-8825-26a89d470725 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:09.448579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b572b8c6-d08b-44af-8825-26a89d470725 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:09.453184 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8da592-a19e-4159-9984-f2f1ba1ec82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:09.453807 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8da592-a19e-4159-9984-f2f1ba1ec82a admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:09.454092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8da592-a19e-4159-9984-f2f1ba1ec82a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:09.454366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8da592-a19e-4159-9984-f2f1ba1ec82a admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:09.454990 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8da592-a19e-4159-9984-f2f1ba1ec82a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:09.458750 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8da592-a19e-4159-9984-f2f1ba1ec82a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:09.572613 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1372/2777] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:13:09 2022] POST /identity/v3/projects => generated 379 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:13:09.576788 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5a97e-5d37-4cb1-b939-9a5b2e80282c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:09.587588 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d5a97e-5d37-4cb1-b939-9a5b2e80282c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:09.644870 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a1a26-8c18-48a4-85c0-b5b905517375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:09.645398 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a1a26-8c18-48a4-85c0-b5b905517375 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:09.645725 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a1a26-8c18-48a4-85c0-b5b905517375 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:09.646003 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a1a26-8c18-48a4-85c0-b5b905517375 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:09.646622 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a1a26-8c18-48a4-85c0-b5b905517375 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:09.648508 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a1a26-8c18-48a4-85c0-b5b905517375 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:09.719584 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1406/2778] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:13:09 2022] POST /identity/v3/users => generated 290 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:13:09.723666 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8da592-a19e-4159-9984-f2f1ba1ec82a admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:09.734327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8da592-a19e-4159-9984-f2f1ba1ec82a admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:09.739427 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abebd9f-0421-4ff4-be53-53bf094ce294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:09.740021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abebd9f-0421-4ff4-be53-53bf094ce294 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:09.740294 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abebd9f-0421-4ff4-be53-53bf094ce294 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:09.740562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abebd9f-0421-4ff4-be53-53bf094ce294 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:09.741194 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abebd9f-0421-4ff4-be53-53bf094ce294 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:09.742794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abebd9f-0421-4ff4-be53-53bf094ce294 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:09.754186 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1373/2779] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:09.758375 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a1a26-8c18-48a4-85c0-b5b905517375 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:09.768479 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a1a26-8c18-48a4-85c0-b5b905517375 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:09.773042 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4a11e-7a5f-4d5c-915b-9ca86ddda992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:09.773632 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4a11e-7a5f-4d5c-915b-9ca86ddda992 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:09.773936 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4a11e-7a5f-4d5c-915b-9ca86ddda992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:09.774208 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f4a11e-7a5f-4d5c-915b-9ca86ddda992 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:09.774891 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4a11e-7a5f-4d5c-915b-9ca86ddda992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:09.776470 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f4a11e-7a5f-4d5c-915b-9ca86ddda992 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:09.786706 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1407/2780] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:09.790993 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abebd9f-0421-4ff4-be53-53bf094ce294 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:09.802107 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abebd9f-0421-4ff4-be53-53bf094ce294 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:09.806959 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9843a-ef4c-415d-ba35-3fd5d36df0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:09.807915 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9843a-ef4c-415d-ba35-3fd5d36df0a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:09.808194 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9843a-ef4c-415d-ba35-3fd5d36df0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:09.808468 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9843a-ef4c-415d-ba35-3fd5d36df0a1 admin admin] PATH_INFO: `/v3/projects/f91a668629a7466ca0498b72aaa56b94/users/91d62375d2b9428a94272536e7abbfec/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:09.824261 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9843a-ef4c-415d-ba35-3fd5d36df0a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f91a668629a7466ca0498b72aaa56b94, user_id=91d62375d2b9428a94272536e7abbfec, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:09.827013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9843a-ef4c-415d-ba35-3fd5d36df0a1 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:09.861853 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4a11e-7a5f-4d5c-915b-9ca86ddda992 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:09.864185 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a4f4a11e-7a5f-4d5c-915b-9ca86ddda992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:09.876674 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f4a11e-7a5f-4d5c-915b-9ca86ddda992 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:09.881986 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95be6cc-9c89-409d-8b44-5f3e93998163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:09.882646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95be6cc-9c89-409d-8b44-5f3e93998163 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:09.882924 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95be6cc-9c89-409d-8b44-5f3e93998163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:09.883197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95be6cc-9c89-409d-8b44-5f3e93998163 admin admin] PATH_INFO: `/v3/users/09a244c575b7424f8565d8a1d1bd9c33` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:09.884321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95be6cc-9c89-409d-8b44-5f3e93998163 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09a244c575b7424f8565d8a1d1bd9c33)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:09.886260 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95be6cc-9c89-409d-8b44-5f3e93998163 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:09.908775 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1374/2781] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:09 2022] PUT /identity/v3/projects/f91a668629a7466ca0498b72aaa56b94/users/91d62375d2b9428a94272536e7abbfec/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:09.920328 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385a635-b734-40fa-9973-23f24d89e28f None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:09.920612 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385a635-b734-40fa-9973-23f24d89e28f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:09.920887 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4385a635-b734-40fa-9973-23f24d89e28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:09.949096 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-4385a635-b734-40fa-9973-23f24d89e28f None None] MFA Rules not processed for user `91d62375d2b9428a94272536e7abbfec`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:09.950341 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4385a635-b734-40fa-9973-23f24d89e28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:09.963867 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:10.014519 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1375/2782] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:09 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:13:10.019691 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385a635-b734-40fa-9973-23f24d89e28f None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:10.076109 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:10.079896 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b95be6cc-9c89-409d-8b44-5f3e93998163 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09a244c575b7424f8565d8a1d1bd9c33'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:10.085683 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4385a635-b734-40fa-9973-23f24d89e28f None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:10.091651 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678a197-141a-4868-97cd-1011d61ecdad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:10.092072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678a197-141a-4868-97cd-1011d61ecdad admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:10.092421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678a197-141a-4868-97cd-1011d61ecdad admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:10.092702 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e678a197-141a-4868-97cd-1011d61ecdad admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:10.093406 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678a197-141a-4868-97cd-1011d61ecdad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:10.095439 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e678a197-141a-4868-97cd-1011d61ecdad admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:10.143028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b95be6cc-9c89-409d-8b44-5f3e93998163 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09a244c575b7424f8565d8a1d1bd9c33'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:10.156360 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b95be6cc-9c89-409d-8b44-5f3e93998163 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09a244c575b7424f8565d8a1d1bd9c33'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:10.157070 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b95be6cc-9c89-409d-8b44-5f3e93998163 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09a244c575b7424f8565d8a1d1bd9c33'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:10.164014 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b95be6cc-9c89-409d-8b44-5f3e93998163 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09a244c575b7424f8565d8a1d1bd9c33'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:10.170950 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1408/2783] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:13:09 2022] DELETE /identity/v3/users/09a244c575b7424f8565d8a1d1bd9c33 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:10.174557 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1376/2784] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:13:10 2022] POST /identity/v3/projects => generated 377 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:13:10.175722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4b983-c43f-4315-9d16-e7b4dfecdb02 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:10.176008 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4b983-c43f-4315-9d16-e7b4dfecdb02 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:10.176283 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4b983-c43f-4315-9d16-e7b4dfecdb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:10.178777 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678a197-141a-4868-97cd-1011d61ecdad admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:10.180373 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-e678a197-141a-4868-97cd-1011d61ecdad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:10.195834 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-44e4b983-c43f-4315-9d16-e7b4dfecdb02 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:10.197011 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-44e4b983-c43f-4315-9d16-e7b4dfecdb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:10.246779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e678a197-141a-4868-97cd-1011d61ecdad admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:10.251562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96052ed3-458b-40df-af18-d756d088370d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:10.252169 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96052ed3-458b-40df-af18-d756d088370d admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:10.252459 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96052ed3-458b-40df-af18-d756d088370d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:10.252731 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96052ed3-458b-40df-af18-d756d088370d admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:10.253983 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96052ed3-458b-40df-af18-d756d088370d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:10.255922 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96052ed3-458b-40df-af18-d756d088370d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:10.259417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1409/2785] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:13:10.269309 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4b983-c43f-4315-9d16-e7b4dfecdb02 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:10.270725 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-44e4b983-c43f-4315-9d16-e7b4dfecdb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:10.327336 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4b983-c43f-4315-9d16-e7b4dfecdb02 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:10.331095 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a972e-82ab-402d-be17-b1a25819afe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:10.331848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a972e-82ab-402d-be17-b1a25819afe1 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:10.332128 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a972e-82ab-402d-be17-b1a25819afe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:10.332399 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8a972e-82ab-402d-be17-b1a25819afe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:10.341695 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a972e-82ab-402d-be17-b1a25819afe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:10.343291 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8a972e-82ab-402d-be17-b1a25819afe1 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:10.343782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1377/2786] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:13:10 2022] POST /identity/v3/users => generated 289 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:13:10.347357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96052ed3-458b-40df-af18-d756d088370d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:10.353256 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1410/2787] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:13:10.360420 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96052ed3-458b-40df-af18-d756d088370d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:10.366607 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df20df-9665-4074-bcb3-16c86c87b2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:10.367210 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df20df-9665-4074-bcb3-16c86c87b2b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:10.367493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df20df-9665-4074-bcb3-16c86c87b2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:10.367787 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df20df-9665-4074-bcb3-16c86c87b2b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:10.368426 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df20df-9665-4074-bcb3-16c86c87b2b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:10.370084 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df20df-9665-4074-bcb3-16c86c87b2b5 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:10.380988 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1378/2788] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:13:10.384975 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a972e-82ab-402d-be17-b1a25819afe1 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:10.395970 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8a972e-82ab-402d-be17-b1a25819afe1 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:10.401230 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b539513-dc8d-410b-a443-7f5bfc8127c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:10.402051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b539513-dc8d-410b-a443-7f5bfc8127c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:10.402339 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b539513-dc8d-410b-a443-7f5bfc8127c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:10.402608 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b539513-dc8d-410b-a443-7f5bfc8127c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:10.403363 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b539513-dc8d-410b-a443-7f5bfc8127c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:10.405266 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b539513-dc8d-410b-a443-7f5bfc8127c9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:10.415906 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1411/2789] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:10.420269 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df20df-9665-4074-bcb3-16c86c87b2b5 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:10.431738 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df20df-9665-4074-bcb3-16c86c87b2b5 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:10.436411 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26667799-093d-4aa3-ba27-62d566a01aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:10.437069 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26667799-093d-4aa3-ba27-62d566a01aa8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:10.437366 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26667799-093d-4aa3-ba27-62d566a01aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:10.437636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26667799-093d-4aa3-ba27-62d566a01aa8 admin admin] PATH_INFO: `/v3/projects/4419c735e9ca4b8b98910a43e07ffaec/users/de17a22b701f4b8da7adba67980046da/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:10.453359 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26667799-093d-4aa3-ba27-62d566a01aa8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4419c735e9ca4b8b98910a43e07ffaec, user_id=de17a22b701f4b8da7adba67980046da, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:10.456249 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26667799-093d-4aa3-ba27-62d566a01aa8 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:10.459302 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:10.538954 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1379/2790] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:10 2022] PUT /identity/v3/projects/4419c735e9ca4b8b98910a43e07ffaec/users/de17a22b701f4b8da7adba67980046da/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:10.549006 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfee189-73da-4e2c-bc74-9c53bf861f84 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:10.549292 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfee189-73da-4e2c-bc74-9c53bf861f84 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:10.549562 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfee189-73da-4e2c-bc74-9c53bf861f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:10.578342 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-8dfee189-73da-4e2c-bc74-9c53bf861f84 None None] MFA Rules not processed for user `de17a22b701f4b8da7adba67980046da`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:10.579540 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8dfee189-73da-4e2c-bc74-9c53bf861f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:10.626831 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:10.647520 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1412/2791] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:10.651906 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26667799-093d-4aa3-ba27-62d566a01aa8 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:10.718834 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26667799-093d-4aa3-ba27-62d566a01aa8 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:10.723326 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ac893-4a55-4874-93c2-4029f6de2ada admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:10.723926 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ac893-4a55-4874-93c2-4029f6de2ada admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:10.724203 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ac893-4a55-4874-93c2-4029f6de2ada admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:10.724470 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ac893-4a55-4874-93c2-4029f6de2ada admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:10.725098 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ac893-4a55-4874-93c2-4029f6de2ada admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:10.727019 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ac893-4a55-4874-93c2-4029f6de2ada admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:10.811008 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfee189-73da-4e2c-bc74-9c53bf861f84 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:10.817923 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1380/2792] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:13:10 2022] POST /identity/v3/projects => generated 379 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:13:10.818172 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-8dfee189-73da-4e2c-bc74-9c53bf861f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:10.819438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ac893-4a55-4874-93c2-4029f6de2ada admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:10.834994 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfee189-73da-4e2c-bc74-9c53bf861f84 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:10.889340 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ac893-4a55-4874-93c2-4029f6de2ada admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:10.893006 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf17ec-4a91-4e88-944c-28918022ec86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:10.894732 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf17ec-4a91-4e88-944c-28918022ec86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:10.895099 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf17ec-4a91-4e88-944c-28918022ec86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:10.895350 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cab0c-52e2-471b-84b6-b563e70fcc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:10.895494 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaf17ec-4a91-4e88-944c-28918022ec86 admin admin] PATH_INFO: `/v3/projects/8dd3a8ba3b56461d879323fbca40e7c4` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:10.895962 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cab0c-52e2-471b-84b6-b563e70fcc57 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:10.896247 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cab0c-52e2-471b-84b6-b563e70fcc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:10.896520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444cab0c-52e2-471b-84b6-b563e70fcc57 admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:10.897039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf17ec-4a91-4e88-944c-28918022ec86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dd3a8ba3b56461d879323fbca40e7c4)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:10.897175 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cab0c-52e2-471b-84b6-b563e70fcc57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:10.899037 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaf17ec-4a91-4e88-944c-28918022ec86 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:10.899158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444cab0c-52e2-471b-84b6-b563e70fcc57 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:11.025449 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1381/2793] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:13:10 2022] POST /identity/v3/users => generated 296 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:13:11.029417 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cab0c-52e2-471b-84b6-b563e70fcc57 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:11.039217 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444cab0c-52e2-471b-84b6-b563e70fcc57 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:11.045294 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e710b-e45d-4250-b5cc-a2e70ee37df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:11.045926 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e710b-e45d-4250-b5cc-a2e70ee37df2 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:11.046207 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e710b-e45d-4250-b5cc-a2e70ee37df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:11.046479 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e710b-e45d-4250-b5cc-a2e70ee37df2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:11.047146 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e710b-e45d-4250-b5cc-a2e70ee37df2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:11.048734 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e710b-e45d-4250-b5cc-a2e70ee37df2 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:11.063697 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1382/2794] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:13:11.063920 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dcaf17ec-4a91-4e88-944c-28918022ec86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dd3a8ba3b56461d879323fbca40e7c4', 'request_id': 'req-dcaf17ec-4a91-4e88-944c-28918022ec86'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:11.064780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e710b-e45d-4250-b5cc-a2e70ee37df2 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:11.074951 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e710b-e45d-4250-b5cc-a2e70ee37df2 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:11.131667 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65c89c-8705-4c38-95c4-7ced5838b14a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:11.132308 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65c89c-8705-4c38-95c4-7ced5838b14a admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:11.132584 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65c89c-8705-4c38-95c4-7ced5838b14a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:11.132862 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f65c89c-8705-4c38-95c4-7ced5838b14a admin admin] PATH_INFO: `/v3/projects/5ae2a6cd984a43c68072b9e7c742ec30/users/ef86165ff13d4666a285ed3a8f1c27f5/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:11.135013 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:11.147613 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f65c89c-8705-4c38-95c4-7ced5838b14a admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae2a6cd984a43c68072b9e7c742ec30, user_id=ef86165ff13d4666a285ed3a8f1c27f5, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:11.150276 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f65c89c-8705-4c38-95c4-7ced5838b14a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:11.157108 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dcaf17ec-4a91-4e88-944c-28918022ec86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dd3a8ba3b56461d879323fbca40e7c4', 'request_id': 'req-dcaf17ec-4a91-4e88-944c-28918022ec86'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:11.163177 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dcaf17ec-4a91-4e88-944c-28918022ec86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dd3a8ba3b56461d879323fbca40e7c4', 'request_id': 'req-dcaf17ec-4a91-4e88-944c-28918022ec86'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:11.174759 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dcaf17ec-4a91-4e88-944c-28918022ec86 admin admin] The token cache is being invalidate because project 8dd3a8ba3b56461d879323fbca40e7c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:13:11.175653 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dcaf17ec-4a91-4e88-944c-28918022ec86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:11.176346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-dcaf17ec-4a91-4e88-944c-28918022ec86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:11.177896 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1413/2795] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:13:10 2022] DELETE /identity/v3/projects/8dd3a8ba3b56461d879323fbca40e7c4 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:11.181855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf17ec-4a91-4e88-944c-28918022ec86 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:11.183160 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-dcaf17ec-4a91-4e88-944c-28918022ec86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:11.196263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaf17ec-4a91-4e88-944c-28918022ec86 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:11.200982 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba39a09-c19f-46de-9ea9-32142f615bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:11.201586 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba39a09-c19f-46de-9ea9-32142f615bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:11.201911 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba39a09-c19f-46de-9ea9-32142f615bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:11.202185 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba39a09-c19f-46de-9ea9-32142f615bd6 admin admin] PATH_INFO: `/v3/users/7d5ea34a61d24515bed26a6a6cc4df2d` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:11.203288 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba39a09-c19f-46de-9ea9-32142f615bd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d5ea34a61d24515bed26a6a6cc4df2d)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:11.205342 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba39a09-c19f-46de-9ea9-32142f615bd6 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:11.241002 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1383/2796] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:11 2022] PUT /identity/v3/projects/5ae2a6cd984a43c68072b9e7c742ec30/users/ef86165ff13d4666a285ed3a8f1c27f5/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:11.244927 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65c89c-8705-4c38-95c4-7ced5838b14a admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:11.246562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-3f65c89c-8705-4c38-95c4-7ced5838b14a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:11.309256 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f65c89c-8705-4c38-95c4-7ced5838b14a admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:11.314007 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50b950-bf9d-4d89-960d-72b98bdd47d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:11.314605 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50b950-bf9d-4d89-960d-72b98bdd47d1 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:11.314879 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50b950-bf9d-4d89-960d-72b98bdd47d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:11.315147 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50b950-bf9d-4d89-960d-72b98bdd47d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:11.315847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50b950-bf9d-4d89-960d-72b98bdd47d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:11.317434 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f50b950-bf9d-4d89-960d-72b98bdd47d1 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:11.327335 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1384/2797] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:11 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:11.331491 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50b950-bf9d-4d89-960d-72b98bdd47d1 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:11.341525 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50b950-bf9d-4d89-960d-72b98bdd47d1 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:11.347369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601533e3-e78f-4c88-9ae9-54db158f3311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:11.348043 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601533e3-e78f-4c88-9ae9-54db158f3311 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:11.348351 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601533e3-e78f-4c88-9ae9-54db158f3311 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:11.348627 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601533e3-e78f-4c88-9ae9-54db158f3311 admin admin] PATH_INFO: `/v3/projects/5ae2a6cd984a43c68072b9e7c742ec30/users/ef86165ff13d4666a285ed3a8f1c27f5/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:11.350591 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601533e3-e78f-4c88-9ae9-54db158f3311 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ae2a6cd984a43c68072b9e7c742ec30, user_id=ef86165ff13d4666a285ed3a8f1c27f5, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:11.353268 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601533e3-e78f-4c88-9ae9-54db158f3311 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:11.364107 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1385/2798] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:11 2022] PUT /identity/v3/projects/5ae2a6cd984a43c68072b9e7c742ec30/users/ef86165ff13d4666a285ed3a8f1c27f5/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:11.374419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34342418-7ad0-4b16-8173-8084e89add3c None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:11.374703 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34342418-7ad0-4b16-8173-8084e89add3c None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:11.374974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34342418-7ad0-4b16-8173-8084e89add3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:11.380197 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4ba39a09-c19f-46de-9ea9-32142f615bd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d5ea34a61d24515bed26a6a6cc4df2d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:11.402864 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-34342418-7ad0-4b16-8173-8084e89add3c None None] MFA Rules not processed for user `ef86165ff13d4666a285ed3a8f1c27f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:11.404073 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-34342418-7ad0-4b16-8173-8084e89add3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:11.454220 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4ba39a09-c19f-46de-9ea9-32142f615bd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d5ea34a61d24515bed26a6a6cc4df2d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:11.466490 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:11.467804 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4ba39a09-c19f-46de-9ea9-32142f615bd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d5ea34a61d24515bed26a6a6cc4df2d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:11.468519 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4ba39a09-c19f-46de-9ea9-32142f615bd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d5ea34a61d24515bed26a6a6cc4df2d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:11.473540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1386/2799] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:11 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:13:11.476377 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4ba39a09-c19f-46de-9ea9-32142f615bd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d5ea34a61d24515bed26a6a6cc4df2d'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:11.482486 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1414/2800] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:13:11 2022] DELETE /identity/v3/users/7d5ea34a61d24515bed26a6a6cc4df2d => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:11.489815 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34342418-7ad0-4b16-8173-8084e89add3c None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:11.491229 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-34342418-7ad0-4b16-8173-8084e89add3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:11.554375 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34342418-7ad0-4b16-8173-8084e89add3c None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:11.558544 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:11.607178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56175c0-31e6-4bc2-841a-996ee33d7798 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:11.608066 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56175c0-31e6-4bc2-841a-996ee33d7798 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:11.608066 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56175c0-31e6-4bc2-841a-996ee33d7798 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:11.608312 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56175c0-31e6-4bc2-841a-996ee33d7798 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:11.610083 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b56175c0-31e6-4bc2-841a-996ee33d7798 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:11.673852 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56175c0-31e6-4bc2-841a-996ee33d7798 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:11.675929 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56175c0-31e6-4bc2-841a-996ee33d7798 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:11.686225 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1387/2801] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:11 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:13:11.941234 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba39a09-c19f-46de-9ea9-32142f615bd6 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:11.942698 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4ba39a09-c19f-46de-9ea9-32142f615bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:11.955311 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba39a09-c19f-46de-9ea9-32142f615bd6 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:11.958950 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dffa26-fd0f-40cb-aab7-6d566dab88f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:11.959539 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dffa26-fd0f-40cb-aab7-6d566dab88f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:11.959840 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dffa26-fd0f-40cb-aab7-6d566dab88f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:11.960107 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64dffa26-fd0f-40cb-aab7-6d566dab88f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:11.962175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-64dffa26-fd0f-40cb-aab7-6d566dab88f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:11.987197 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56175c0-31e6-4bc2-841a-996ee33d7798 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:11.990390 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b56175c0-31e6-4bc2-841a-996ee33d7798 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:12.031220 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dffa26-fd0f-40cb-aab7-6d566dab88f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:12.032663 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64dffa26-fd0f-40cb-aab7-6d566dab88f1 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:12.043105 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1415/2802] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:11 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:13:12.082835 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56175c0-31e6-4bc2-841a-996ee33d7798 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:12.088347 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861b0a9-3a06-4960-b471-7c50cf43e2c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:12.089224 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861b0a9-3a06-4960-b471-7c50cf43e2c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:12.089504 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861b0a9-3a06-4960-b471-7c50cf43e2c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:12.089811 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5861b0a9-3a06-4960-b471-7c50cf43e2c4 admin admin] PATH_INFO: `/v3/projects/3710dfa92f6d4738a1b2f7ff19399160` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:12.090995 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861b0a9-3a06-4960-b471-7c50cf43e2c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3710dfa92f6d4738a1b2f7ff19399160)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:12.093020 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5861b0a9-3a06-4960-b471-7c50cf43e2c4 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:12.204108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5861b0a9-3a06-4960-b471-7c50cf43e2c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3710dfa92f6d4738a1b2f7ff19399160', 'request_id': 'req-5861b0a9-3a06-4960-b471-7c50cf43e2c4'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:12.210077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5861b0a9-3a06-4960-b471-7c50cf43e2c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3710dfa92f6d4738a1b2f7ff19399160', 'request_id': 'req-5861b0a9-3a06-4960-b471-7c50cf43e2c4'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:12.211318 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:12.217599 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5861b0a9-3a06-4960-b471-7c50cf43e2c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3710dfa92f6d4738a1b2f7ff19399160', 'request_id': 'req-5861b0a9-3a06-4960-b471-7c50cf43e2c4'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:12.317785 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5861b0a9-3a06-4960-b471-7c50cf43e2c4 admin admin] The token cache is being invalidate because project 3710dfa92f6d4738a1b2f7ff19399160 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:13:12.318096 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5861b0a9-3a06-4960-b471-7c50cf43e2c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:12.318792 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5861b0a9-3a06-4960-b471-7c50cf43e2c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:12.320296 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1388/2803] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:13:11 2022] DELETE /identity/v3/projects/3710dfa92f6d4738a1b2f7ff19399160 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:12.324295 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dffa26-fd0f-40cb-aab7-6d566dab88f1 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:12.335473 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64dffa26-fd0f-40cb-aab7-6d566dab88f1 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:12.390636 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e14f4-844f-438b-8f63-ac68acb022cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:12.391339 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e14f4-844f-438b-8f63-ac68acb022cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:12.391530 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e14f4-844f-438b-8f63-ac68acb022cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:12.391803 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e14f4-844f-438b-8f63-ac68acb022cf admin admin] PATH_INFO: `/v3/users/0224238eb7ff43f6b2d5a3e7b13914e8` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:12.392937 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e14f4-844f-438b-8f63-ac68acb022cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=0224238eb7ff43f6b2d5a3e7b13914e8)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:12.395476 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e14f4-844f-438b-8f63-ac68acb022cf admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:12.576942 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d26e14f4-844f-438b-8f63-ac68acb022cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0224238eb7ff43f6b2d5a3e7b13914e8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:12.643234 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d26e14f4-844f-438b-8f63-ac68acb022cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0224238eb7ff43f6b2d5a3e7b13914e8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:12.656227 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d26e14f4-844f-438b-8f63-ac68acb022cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0224238eb7ff43f6b2d5a3e7b13914e8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:12.656850 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d26e14f4-844f-438b-8f63-ac68acb022cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0224238eb7ff43f6b2d5a3e7b13914e8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:12.664354 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-d26e14f4-844f-438b-8f63-ac68acb022cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0224238eb7ff43f6b2d5a3e7b13914e8'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:12.670402 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1416/2804] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:13:12 2022] DELETE /identity/v3/users/0224238eb7ff43f6b2d5a3e7b13914e8 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:13.093560 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861b0a9-3a06-4960-b471-7c50cf43e2c4 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:13.095877 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5861b0a9-3a06-4960-b471-7c50cf43e2c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:13.109991 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5861b0a9-3a06-4960-b471-7c50cf43e2c4 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:13.168778 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59077b51-0555-4a8a-bb43-6477c1a6b556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:13.169333 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59077b51-0555-4a8a-bb43-6477c1a6b556 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:13.169614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59077b51-0555-4a8a-bb43-6477c1a6b556 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:13.169910 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59077b51-0555-4a8a-bb43-6477c1a6b556 admin admin] PATH_INFO: `/v3/projects/c01f4fcb9d364b5aa3981b24fa80844d` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:13.171046 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59077b51-0555-4a8a-bb43-6477c1a6b556 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c01f4fcb9d364b5aa3981b24fa80844d)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:13.172935 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59077b51-0555-4a8a-bb43-6477c1a6b556 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:13.291577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-59077b51-0555-4a8a-bb43-6477c1a6b556 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c01f4fcb9d364b5aa3981b24fa80844d', 'request_id': 'req-59077b51-0555-4a8a-bb43-6477c1a6b556'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:13.297140 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-59077b51-0555-4a8a-bb43-6477c1a6b556 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c01f4fcb9d364b5aa3981b24fa80844d', 'request_id': 'req-59077b51-0555-4a8a-bb43-6477c1a6b556'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:13.303834 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-59077b51-0555-4a8a-bb43-6477c1a6b556 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c01f4fcb9d364b5aa3981b24fa80844d', 'request_id': 'req-59077b51-0555-4a8a-bb43-6477c1a6b556'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:13.382860 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-59077b51-0555-4a8a-bb43-6477c1a6b556 admin admin] The token cache is being invalidate because project c01f4fcb9d364b5aa3981b24fa80844d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:13:13.383153 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-59077b51-0555-4a8a-bb43-6477c1a6b556 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:13.383809 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-59077b51-0555-4a8a-bb43-6477c1a6b556 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:13.385308 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1389/2805] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:13:13 2022] DELETE /identity/v3/projects/c01f4fcb9d364b5aa3981b24fa80844d => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:13.390252 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60746e87-4dd8-4885-b654-00885a663865 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:13.390536 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60746e87-4dd8-4885-b654-00885a663865 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:13.390808 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60746e87-4dd8-4885-b654-00885a663865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:13.399887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:13.409922 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-60746e87-4dd8-4885-b654-00885a663865 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:13.411146 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-60746e87-4dd8-4885-b654-00885a663865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:13.468660 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1417/2806] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:13.535580 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dc6b3-cac1-4c96-aec8-637820dc8d58 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:13.536000 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dc6b3-cac1-4c96-aec8-637820dc8d58 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:13.536283 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07dc6b3-cac1-4c96-aec8-637820dc8d58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:13.557363 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-f07dc6b3-cac1-4c96-aec8-637820dc8d58 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:13.560833 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f07dc6b3-cac1-4c96-aec8-637820dc8d58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:13.567281 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1390/2807] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:13.571558 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60746e87-4dd8-4885-b654-00885a663865 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:13.581035 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60746e87-4dd8-4885-b654-00885a663865 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:13.586215 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a53fb-be9e-4f38-bae7-77aebf50191d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:13.589490 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a53fb-be9e-4f38-bae7-77aebf50191d admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:13.589490 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a53fb-be9e-4f38-bae7-77aebf50191d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:13.589490 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01a53fb-be9e-4f38-bae7-77aebf50191d admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:13.589490 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a53fb-be9e-4f38-bae7-77aebf50191d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:13:13.589490 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a53fb-be9e-4f38-bae7-77aebf50191d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:13.590081 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01a53fb-be9e-4f38-bae7-77aebf50191d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:13.601370 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1418/2808] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:13:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:13:13.605804 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07dc6b3-cac1-4c96-aec8-637820dc8d58 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:13.615340 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07dc6b3-cac1-4c96-aec8-637820dc8d58 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:13.623885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb4354-bfcd-4697-b3b1-8c95ab191388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:13.623885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb4354-bfcd-4697-b3b1-8c95ab191388 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:13.623885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb4354-bfcd-4697-b3b1-8c95ab191388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:13.623885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eb4354-bfcd-4697-b3b1-8c95ab191388 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:13.624338 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb4354-bfcd-4697-b3b1-8c95ab191388 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:13.624338 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eb4354-bfcd-4697-b3b1-8c95ab191388 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:13.764787 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1391/2809] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:13:13 2022] POST /identity/v3/projects => generated 383 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:13:13.768946 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a53fb-be9e-4f38-bae7-77aebf50191d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:13.779508 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01a53fb-be9e-4f38-bae7-77aebf50191d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:13.836046 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4008ef-d5ea-47d1-be4f-de223380296d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:13.836649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4008ef-d5ea-47d1-be4f-de223380296d admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:13.837175 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4008ef-d5ea-47d1-be4f-de223380296d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:13.837442 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4008ef-d5ea-47d1-be4f-de223380296d admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:13.838131 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4008ef-d5ea-47d1-be4f-de223380296d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:13.840051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4008ef-d5ea-47d1-be4f-de223380296d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:13.943989 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1419/2810] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:13:13 2022] POST /identity/v3/users => generated 292 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:13:13.947895 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb4354-bfcd-4697-b3b1-8c95ab191388 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:13.958505 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eb4354-bfcd-4697-b3b1-8c95ab191388 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:13.964678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d3579-dc63-4148-85cc-c697c7a69ae6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:13.966353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d3579-dc63-4148-85cc-c697c7a69ae6 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:13.966353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d3579-dc63-4148-85cc-c697c7a69ae6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:13.966353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502d3579-dc63-4148-85cc-c697c7a69ae6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:13.966756 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d3579-dc63-4148-85cc-c697c7a69ae6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:13.968134 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502d3579-dc63-4148-85cc-c697c7a69ae6 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:13.979707 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1392/2811] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:13.983609 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4008ef-d5ea-47d1-be4f-de223380296d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:13.993731 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4008ef-d5ea-47d1-be4f-de223380296d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:13.998249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c588192-7275-47f5-9ffc-bb875174b6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:13.998839 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c588192-7275-47f5-9ffc-bb875174b6e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:13.999116 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c588192-7275-47f5-9ffc-bb875174b6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:13.999388 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c588192-7275-47f5-9ffc-bb875174b6e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:14.000022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c588192-7275-47f5-9ffc-bb875174b6e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:14.001616 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c588192-7275-47f5-9ffc-bb875174b6e0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:14.013217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1420/2812] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:14.017487 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d3579-dc63-4148-85cc-c697c7a69ae6 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:14.027758 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502d3579-dc63-4148-85cc-c697c7a69ae6 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:14.032327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825318c-18eb-4c3a-9974-1b78b1157b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:14.032966 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825318c-18eb-4c3a-9974-1b78b1157b96 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:14.033264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825318c-18eb-4c3a-9974-1b78b1157b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:14.033566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a825318c-18eb-4c3a-9974-1b78b1157b96 admin admin] PATH_INFO: `/v3/projects/f444369d8a2448699451c6fcc0ea9887/users/da4728c1b90347e79ec9f0ecafb352eb/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:14.062259 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825318c-18eb-4c3a-9974-1b78b1157b96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f444369d8a2448699451c6fcc0ea9887, user_id=da4728c1b90347e79ec9f0ecafb352eb, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:14.062259 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a825318c-18eb-4c3a-9974-1b78b1157b96 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:14.163616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1393/2813] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:14 2022] PUT /identity/v3/projects/f444369d8a2448699451c6fcc0ea9887/users/da4728c1b90347e79ec9f0ecafb352eb/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:14.172883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b3862-c530-4237-a08e-d8fb317cad13 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:14.173168 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b3862-c530-4237-a08e-d8fb317cad13 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:14.173469 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026b3862-c530-4237-a08e-d8fb317cad13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:14.200866 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-026b3862-c530-4237-a08e-d8fb317cad13 None None] MFA Rules not processed for user `da4728c1b90347e79ec9f0ecafb352eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:14.202122 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-026b3862-c530-4237-a08e-d8fb317cad13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:14.263420 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:14.268074 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1421/2814] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:14.272957 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825318c-18eb-4c3a-9974-1b78b1157b96 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:14.287030 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:14.338524 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a825318c-18eb-4c3a-9974-1b78b1157b96 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:14.343254 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7cda2-325f-4231-9af3-b2f1005b34dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:14.343882 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7cda2-325f-4231-9af3-b2f1005b34dc admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:14.344161 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7cda2-325f-4231-9af3-b2f1005b34dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:14.344432 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc7cda2-325f-4231-9af3-b2f1005b34dc admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:14.345051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7cda2-325f-4231-9af3-b2f1005b34dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:14.347023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc7cda2-325f-4231-9af3-b2f1005b34dc admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:14.459089 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1394/2815] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:13:14 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:13:14.463415 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b3862-c530-4237-a08e-d8fb317cad13 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:14.473943 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026b3862-c530-4237-a08e-d8fb317cad13 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:14.533669 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c616dd9-c74c-46d7-8c99-ee5037b29ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:14.534221 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c616dd9-c74c-46d7-8c99-ee5037b29ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:14.534511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c616dd9-c74c-46d7-8c99-ee5037b29ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:14.534763 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c616dd9-c74c-46d7-8c99-ee5037b29ea9 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:14.535383 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c616dd9-c74c-46d7-8c99-ee5037b29ea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:14.537353 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c616dd9-c74c-46d7-8c99-ee5037b29ea9 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:14.643439 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1422/2816] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:13:14 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:13:14.649733 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7cda2-325f-4231-9af3-b2f1005b34dc admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:14.659863 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc7cda2-325f-4231-9af3-b2f1005b34dc admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:14.664455 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005efa1-d99e-44a4-a4cf-932f529398ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:14.665048 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005efa1-d99e-44a4-a4cf-932f529398ed admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:14.665326 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005efa1-d99e-44a4-a4cf-932f529398ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:14.665594 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005efa1-d99e-44a4-a4cf-932f529398ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:14.666338 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005efa1-d99e-44a4-a4cf-932f529398ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:14.667912 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005efa1-d99e-44a4-a4cf-932f529398ed admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:14.678575 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1395/2817] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:13:14.682479 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c616dd9-c74c-46d7-8c99-ee5037b29ea9 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:14.692974 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c616dd9-c74c-46d7-8c99-ee5037b29ea9 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:14.697502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0575ff80-0ab1-4812-9fe0-80288318598b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:14.698131 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575ff80-0ab1-4812-9fe0-80288318598b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:14.698409 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575ff80-0ab1-4812-9fe0-80288318598b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:14.698678 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0575ff80-0ab1-4812-9fe0-80288318598b admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:14.699312 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575ff80-0ab1-4812-9fe0-80288318598b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:14.700890 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0575ff80-0ab1-4812-9fe0-80288318598b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:14.710789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1423/2818] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:14.714947 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005efa1-d99e-44a4-a4cf-932f529398ed admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:14.725924 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005efa1-d99e-44a4-a4cf-932f529398ed admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:14.730798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d93211-8f5e-43ed-afcf-dd8fdd1381eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:14.731442 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d93211-8f5e-43ed-afcf-dd8fdd1381eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:14.731720 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d93211-8f5e-43ed-afcf-dd8fdd1381eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:14.731994 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d93211-8f5e-43ed-afcf-dd8fdd1381eb admin admin] PATH_INFO: `/v3/projects/f296cbbc9bd543b188650bb7b969f034/users/bc7f7cf6b61d4c9a9086382dc9cb8cca/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:14.747072 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d93211-8f5e-43ed-afcf-dd8fdd1381eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f296cbbc9bd543b188650bb7b969f034, user_id=bc7f7cf6b61d4c9a9086382dc9cb8cca, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:14.749910 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d93211-8f5e-43ed-afcf-dd8fdd1381eb admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:14.855124 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1396/2819] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:14 2022] PUT /identity/v3/projects/f296cbbc9bd543b188650bb7b969f034/users/bc7f7cf6b61d4c9a9086382dc9cb8cca/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:14.870452 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3057b3-9616-4850-90a5-90ce2e11499c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:14.870841 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3057b3-9616-4850-90a5-90ce2e11499c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:14.871126 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3057b3-9616-4850-90a5-90ce2e11499c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:14.900100 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-9c3057b3-9616-4850-90a5-90ce2e11499c None None] MFA Rules not processed for user `bc7f7cf6b61d4c9a9086382dc9cb8cca`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:14.901312 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-9c3057b3-9616-4850-90a5-90ce2e11499c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:14.980748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1424/2820] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:14 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:14.981904 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d93211-8f5e-43ed-afcf-dd8fdd1381eb admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:15.045477 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d93211-8f5e-43ed-afcf-dd8fdd1381eb admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:15.050128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0aaa8-517c-4d4e-a2f9-3062bbd2219a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:15.050738 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0aaa8-517c-4d4e-a2f9-3062bbd2219a admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:15.051021 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0aaa8-517c-4d4e-a2f9-3062bbd2219a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:15.051854 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a0aaa8-517c-4d4e-a2f9-3062bbd2219a admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:15.052475 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0aaa8-517c-4d4e-a2f9-3062bbd2219a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:15.054403 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a0aaa8-517c-4d4e-a2f9-3062bbd2219a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:15.175958 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1397/2821] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:13:14 2022] POST /identity/v3/projects => generated 381 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:13:15.180473 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3057b3-9616-4850-90a5-90ce2e11499c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:15.190804 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3057b3-9616-4850-90a5-90ce2e11499c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:15.247188 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde37d0d-7bfb-48cc-b1d7-9c674b09bfda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:15.247790 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde37d0d-7bfb-48cc-b1d7-9c674b09bfda admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:15.248063 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde37d0d-7bfb-48cc-b1d7-9c674b09bfda admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:15.248330 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde37d0d-7bfb-48cc-b1d7-9c674b09bfda admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:15.248959 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde37d0d-7bfb-48cc-b1d7-9c674b09bfda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:15.251067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde37d0d-7bfb-48cc-b1d7-9c674b09bfda admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:15.324940 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:15.333652 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1425/2822] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:13:15 2022] POST /identity/v3/users => generated 297 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:13:15.335033 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0aaa8-517c-4d4e-a2f9-3062bbd2219a admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:15.345878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a0aaa8-517c-4d4e-a2f9-3062bbd2219a admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:15.351012 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae1a95-4c03-4dd1-91b1-a3ce960e21c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:15.353861 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae1a95-4c03-4dd1-91b1-a3ce960e21c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:15.353861 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae1a95-4c03-4dd1-91b1-a3ce960e21c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:15.353861 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae1a95-4c03-4dd1-91b1-a3ce960e21c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:15.353861 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae1a95-4c03-4dd1-91b1-a3ce960e21c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:15.354460 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae1a95-4c03-4dd1-91b1-a3ce960e21c0 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:15.365104 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1398/2823] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:15.369196 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde37d0d-7bfb-48cc-b1d7-9c674b09bfda admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:15.379781 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde37d0d-7bfb-48cc-b1d7-9c674b09bfda admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:15.384429 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44798c8-c15f-45e5-9fdb-ea17a2fc1567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:15.385135 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44798c8-c15f-45e5-9fdb-ea17a2fc1567 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:15.385419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44798c8-c15f-45e5-9fdb-ea17a2fc1567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:15.385711 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44798c8-c15f-45e5-9fdb-ea17a2fc1567 admin admin] PATH_INFO: `/v3/projects/128a52b022d04bbda19d10cdbc809378/users/d0e9ecd389064bbebfb91a011461c748/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:15.401680 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44798c8-c15f-45e5-9fdb-ea17a2fc1567 admin admin] RBAC: Authorizing `identity:create_grant(project_id=128a52b022d04bbda19d10cdbc809378, user_id=d0e9ecd389064bbebfb91a011461c748, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:15.404337 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44798c8-c15f-45e5-9fdb-ea17a2fc1567 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:15.497635 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1426/2824] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:15 2022] PUT /identity/v3/projects/128a52b022d04bbda19d10cdbc809378/users/d0e9ecd389064bbebfb91a011461c748/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:15.501614 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae1a95-4c03-4dd1-91b1-a3ce960e21c0 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:15.512067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae1a95-4c03-4dd1-91b1-a3ce960e21c0 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:15.544643 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:15.567903 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351db59-119b-4df6-9744-4c24f64c2de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:15.568504 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351db59-119b-4df6-9744-4c24f64c2de4 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:15.568780 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351db59-119b-4df6-9744-4c24f64c2de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:15.569049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f351db59-119b-4df6-9744-4c24f64c2de4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:15.569677 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351db59-119b-4df6-9744-4c24f64c2de4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:15.573084 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f351db59-119b-4df6-9744-4c24f64c2de4 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:15.580819 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1399/2825] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:15.585102 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44798c8-c15f-45e5-9fdb-ea17a2fc1567 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:15.596443 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44798c8-c15f-45e5-9fdb-ea17a2fc1567 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:15.601066 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8294ea-c946-44d1-8d7d-5f7461c8ce7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:15.601828 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8294ea-c946-44d1-8d7d-5f7461c8ce7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:15.602049 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8294ea-c946-44d1-8d7d-5f7461c8ce7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:15.602318 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8294ea-c946-44d1-8d7d-5f7461c8ce7e admin admin] PATH_INFO: `/v3/projects/128a52b022d04bbda19d10cdbc809378/users/d0e9ecd389064bbebfb91a011461c748/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:15.604203 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8294ea-c946-44d1-8d7d-5f7461c8ce7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=128a52b022d04bbda19d10cdbc809378, user_id=d0e9ecd389064bbebfb91a011461c748, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:15.606954 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8294ea-c946-44d1-8d7d-5f7461c8ce7e admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:15.618235 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1427/2826] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:15 2022] PUT /identity/v3/projects/128a52b022d04bbda19d10cdbc809378/users/d0e9ecd389064bbebfb91a011461c748/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:15.627515 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351db59-119b-4df6-9744-4c24f64c2de4 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:15.630560 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f351db59-119b-4df6-9744-4c24f64c2de4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:15.634596 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ab430-4a7c-4bd8-9e2d-f4ce7e683719 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:15.634879 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ab430-4a7c-4bd8-9e2d-f4ce7e683719 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:15.635151 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611ab430-4a7c-4bd8-9e2d-f4ce7e683719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:15.642638 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f351db59-119b-4df6-9744-4c24f64c2de4 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:15.663424 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-611ab430-4a7c-4bd8-9e2d-f4ce7e683719 None None] MFA Rules not processed for user `d0e9ecd389064bbebfb91a011461c748`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:15.664972 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-611ab430-4a7c-4bd8-9e2d-f4ce7e683719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:15.699441 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745bab91-a075-4c9a-aeca-8903c2ba8b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:15.700077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bab91-a075-4c9a-aeca-8903c2ba8b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:15.700412 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bab91-a075-4c9a-aeca-8903c2ba8b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:15.700690 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745bab91-a075-4c9a-aeca-8903c2ba8b14 admin admin] PATH_INFO: `/v3/users/ac238f3be2544e74b765aabf281a405f` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:15.701846 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bab91-a075-4c9a-aeca-8903c2ba8b14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac238f3be2544e74b765aabf281a405f)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:15.703883 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745bab91-a075-4c9a-aeca-8903c2ba8b14 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:15.733390 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1428/2827] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:15 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:15.745266 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ab430-4a7c-4bd8-9e2d-f4ce7e683719 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:15.746579 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-611ab430-4a7c-4bd8-9e2d-f4ce7e683719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:15.802417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611ab430-4a7c-4bd8-9e2d-f4ce7e683719 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:15.806016 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479c20f-aba8-48cb-84bc-9825f62e5e32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:15.806608 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479c20f-aba8-48cb-84bc-9825f62e5e32 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:15.806883 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479c20f-aba8-48cb-84bc-9825f62e5e32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:15.807151 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6479c20f-aba8-48cb-84bc-9825f62e5e32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:15.861093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479c20f-aba8-48cb-84bc-9825f62e5e32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:15.862552 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6479c20f-aba8-48cb-84bc-9825f62e5e32 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:15.867583 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:15.871942 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1429/2828] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:13:15.968926 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-745bab91-a075-4c9a-aeca-8903c2ba8b14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac238f3be2544e74b765aabf281a405f'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:16.046058 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479c20f-aba8-48cb-84bc-9825f62e5e32 service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:16.047472 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6479c20f-aba8-48cb-84bc-9825f62e5e32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:16.061578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6479c20f-aba8-48cb-84bc-9825f62e5e32 service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:16.066481 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3284f7-c292-4ece-888b-30e6e1addcdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:16.067135 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3284f7-c292-4ece-888b-30e6e1addcdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:16.067426 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3284f7-c292-4ece-888b-30e6e1addcdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:16.067725 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3284f7-c292-4ece-888b-30e6e1addcdb admin admin] PATH_INFO: `/v3/users/91d62375d2b9428a94272536e7abbfec` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:16.068847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3284f7-c292-4ece-888b-30e6e1addcdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=91d62375d2b9428a94272536e7abbfec)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:16.069566 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-745bab91-a075-4c9a-aeca-8903c2ba8b14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac238f3be2544e74b765aabf281a405f'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:16.070789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3284f7-c292-4ece-888b-30e6e1addcdb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:16.084295 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-745bab91-a075-4c9a-aeca-8903c2ba8b14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac238f3be2544e74b765aabf281a405f'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:16.086196 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-745bab91-a075-4c9a-aeca-8903c2ba8b14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac238f3be2544e74b765aabf281a405f'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:16.093772 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-745bab91-a075-4c9a-aeca-8903c2ba8b14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac238f3be2544e74b765aabf281a405f'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:16.100543 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1400/2829] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:13:15 2022] DELETE /identity/v3/users/ac238f3be2544e74b765aabf281a405f => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:16.104886 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dea88-e565-46bf-8b50-8ac7ac9e6932 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:16.105173 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dea88-e565-46bf-8b50-8ac7ac9e6932 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:16.105442 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00dea88-e565-46bf-8b50-8ac7ac9e6932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:16.124907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-f00dea88-e565-46bf-8b50-8ac7ac9e6932 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:16.129077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f00dea88-e565-46bf-8b50-8ac7ac9e6932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:16.173644 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:16.185405 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1401/2830] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:13:16.195176 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dea88-e565-46bf-8b50-8ac7ac9e6932 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:16.196503 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f00dea88-e565-46bf-8b50-8ac7ac9e6932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:16.252429 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00dea88-e565-46bf-8b50-8ac7ac9e6932 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:16.256115 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd506b86-1441-452c-be47-53d4f5f0221b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:16.256716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd506b86-1441-452c-be47-53d4f5f0221b service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:16.256998 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd506b86-1441-452c-be47-53d4f5f0221b service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:16.257269 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd506b86-1441-452c-be47-53d4f5f0221b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:16.266135 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd506b86-1441-452c-be47-53d4f5f0221b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:16.267563 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd506b86-1441-452c-be47-53d4f5f0221b service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:16.277799 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1402/2831] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:13:16.277948 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4f3284f7-c292-4ece-888b-30e6e1addcdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91d62375d2b9428a94272536e7abbfec'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:16.355051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4f3284f7-c292-4ece-888b-30e6e1addcdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91d62375d2b9428a94272536e7abbfec'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:16.367974 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4f3284f7-c292-4ece-888b-30e6e1addcdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91d62375d2b9428a94272536e7abbfec'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:16.368626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4f3284f7-c292-4ece-888b-30e6e1addcdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91d62375d2b9428a94272536e7abbfec'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:16.375703 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-4f3284f7-c292-4ece-888b-30e6e1addcdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91d62375d2b9428a94272536e7abbfec'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:16.381571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1430/2832] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:13:16 2022] DELETE /identity/v3/users/91d62375d2b9428a94272536e7abbfec => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:16.386331 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2597ed4-ae0d-434b-ad51-3cce19ea83a1 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:16.397405 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2597ed4-ae0d-434b-ad51-3cce19ea83a1 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:16.397405 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2597ed4-ae0d-434b-ad51-3cce19ea83a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:16.406275 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-f2597ed4-ae0d-434b-ad51-3cce19ea83a1 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:16.407473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f2597ed4-ae0d-434b-ad51-3cce19ea83a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:16.467181 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1403/2833] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:16.478404 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3284f7-c292-4ece-888b-30e6e1addcdb admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:16.479905 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4f3284f7-c292-4ece-888b-30e6e1addcdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:16.553173 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3284f7-c292-4ece-888b-30e6e1addcdb admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:16.557099 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72ee81-2ba5-4e8b-af21-0c5d509419a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:16.558170 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72ee81-2ba5-4e8b-af21-0c5d509419a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:16.558170 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72ee81-2ba5-4e8b-af21-0c5d509419a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:16.559355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e72ee81-2ba5-4e8b-af21-0c5d509419a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:16.569907 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72ee81-2ba5-4e8b-af21-0c5d509419a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:16.571572 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e72ee81-2ba5-4e8b-af21-0c5d509419a8 service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:16.582228 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1431/2834] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:13:16.701520 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2597ed4-ae0d-434b-ad51-3cce19ea83a1 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:16.703092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-f2597ed4-ae0d-434b-ad51-3cce19ea83a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:16.716377 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2597ed4-ae0d-434b-ad51-3cce19ea83a1 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:16.732967 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb698b-06bf-438c-ae9e-33761aed36e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:16.733644 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb698b-06bf-438c-ae9e-33761aed36e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:16.734315 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb698b-06bf-438c-ae9e-33761aed36e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:16.734715 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cb698b-06bf-438c-ae9e-33761aed36e5 admin admin] PATH_INFO: `/v3/projects/9f24bc8192b7444591d9043854977ddd` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:16.736641 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb698b-06bf-438c-ae9e-33761aed36e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f24bc8192b7444591d9043854977ddd)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:16.738603 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cb698b-06bf-438c-ae9e-33761aed36e5 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:16.858513 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-66cb698b-06bf-438c-ae9e-33761aed36e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f24bc8192b7444591d9043854977ddd', 'request_id': 'req-66cb698b-06bf-438c-ae9e-33761aed36e5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:16.865132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-66cb698b-06bf-438c-ae9e-33761aed36e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f24bc8192b7444591d9043854977ddd', 'request_id': 'req-66cb698b-06bf-438c-ae9e-33761aed36e5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:16.872017 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-66cb698b-06bf-438c-ae9e-33761aed36e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f24bc8192b7444591d9043854977ddd', 'request_id': 'req-66cb698b-06bf-438c-ae9e-33761aed36e5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:16.954538 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-66cb698b-06bf-438c-ae9e-33761aed36e5 admin admin] The token cache is being invalidate because project 9f24bc8192b7444591d9043854977ddd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:13:16.954832 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-66cb698b-06bf-438c-ae9e-33761aed36e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:16.955480 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-66cb698b-06bf-438c-ae9e-33761aed36e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:16.957231 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1404/2835] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:13:16 2022] DELETE /identity/v3/projects/9f24bc8192b7444591d9043854977ddd => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:16.961684 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72ee81-2ba5-4e8b-af21-0c5d509419a8 service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:16.971605 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e72ee81-2ba5-4e8b-af21-0c5d509419a8 service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:17.029714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ed3d5-14a4-4fe0-a53d-78168c91e002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:17.030348 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ed3d5-14a4-4fe0-a53d-78168c91e002 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:17.030627 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ed3d5-14a4-4fe0-a53d-78168c91e002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:17.030908 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ed3d5-14a4-4fe0-a53d-78168c91e002 admin admin] PATH_INFO: `/v3/users/e3bdfe940cde4e339cd53d5e60c10e4c` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:17.032063 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ed3d5-14a4-4fe0-a53d-78168c91e002 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e3bdfe940cde4e339cd53d5e60c10e4c)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:17.033989 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0ed3d5-14a4-4fe0-a53d-78168c91e002 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:17.049901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:17.099650 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb698b-06bf-438c-ae9e-33761aed36e5 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:17.101175 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-66cb698b-06bf-438c-ae9e-33761aed36e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:17.114579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cb698b-06bf-438c-ae9e-33761aed36e5 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:17.119540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b791d3-9d84-43e4-a778-d32e0938098d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:17.124222 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b791d3-9d84-43e4-a778-d32e0938098d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:17.124222 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b791d3-9d84-43e4-a778-d32e0938098d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:17.124222 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b791d3-9d84-43e4-a778-d32e0938098d admin admin] PATH_INFO: `/v3/projects/f91a668629a7466ca0498b72aaa56b94` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:17.124222 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b791d3-9d84-43e4-a778-d32e0938098d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f91a668629a7466ca0498b72aaa56b94)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:17.124222 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b791d3-9d84-43e4-a778-d32e0938098d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:17.140308 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:17.252032 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ad0ed3d5-14a4-4fe0-a53d-78168c91e002 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e3bdfe940cde4e339cd53d5e60c10e4c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:17.255464 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-79b791d3-9d84-43e4-a778-d32e0938098d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f91a668629a7466ca0498b72aaa56b94', 'request_id': 'req-79b791d3-9d84-43e4-a778-d32e0938098d'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:17.261358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-79b791d3-9d84-43e4-a778-d32e0938098d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f91a668629a7466ca0498b72aaa56b94', 'request_id': 'req-79b791d3-9d84-43e4-a778-d32e0938098d'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:17.267960 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-79b791d3-9d84-43e4-a778-d32e0938098d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f91a668629a7466ca0498b72aaa56b94', 'request_id': 'req-79b791d3-9d84-43e4-a778-d32e0938098d'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:17.352042 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ad0ed3d5-14a4-4fe0-a53d-78168c91e002 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e3bdfe940cde4e339cd53d5e60c10e4c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:17.364312 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ad0ed3d5-14a4-4fe0-a53d-78168c91e002 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e3bdfe940cde4e339cd53d5e60c10e4c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:17.364968 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ad0ed3d5-14a4-4fe0-a53d-78168c91e002 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e3bdfe940cde4e339cd53d5e60c10e4c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:17.371841 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-ad0ed3d5-14a4-4fe0-a53d-78168c91e002 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e3bdfe940cde4e339cd53d5e60c10e4c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:17.377868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1432/2836] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:13:16 2022] DELETE /identity/v3/users/e3bdfe940cde4e339cd53d5e60c10e4c => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:17.411752 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-79b791d3-9d84-43e4-a778-d32e0938098d admin admin] The token cache is being invalidate because project f91a668629a7466ca0498b72aaa56b94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:13:17.412043 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-79b791d3-9d84-43e4-a778-d32e0938098d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:17.412742 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-79b791d3-9d84-43e4-a778-d32e0938098d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:17.414307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1405/2837] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:13:17 2022] DELETE /identity/v3/projects/f91a668629a7466ca0498b72aaa56b94 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:17.418278 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ed3d5-14a4-4fe0-a53d-78168c91e002 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:17.419794 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ad0ed3d5-14a4-4fe0-a53d-78168c91e002 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:17.484230 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0ed3d5-14a4-4fe0-a53d-78168c91e002 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:17.489028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9d16c-d5d3-4f01-9b0d-38d4d156ca43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:17.494086 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9d16c-d5d3-4f01-9b0d-38d4d156ca43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:17.494086 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9d16c-d5d3-4f01-9b0d-38d4d156ca43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:17.494086 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9d16c-d5d3-4f01-9b0d-38d4d156ca43 admin admin] PATH_INFO: `/v3/users/de17a22b701f4b8da7adba67980046da` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:17.494086 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9d16c-d5d3-4f01-9b0d-38d4d156ca43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de17a22b701f4b8da7adba67980046da)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:17.494086 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9d16c-d5d3-4f01-9b0d-38d4d156ca43 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:17.810676 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-29c9d16c-d5d3-4f01-9b0d-38d4d156ca43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de17a22b701f4b8da7adba67980046da'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:17.890084 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-29c9d16c-d5d3-4f01-9b0d-38d4d156ca43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de17a22b701f4b8da7adba67980046da'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:17.912413 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-29c9d16c-d5d3-4f01-9b0d-38d4d156ca43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de17a22b701f4b8da7adba67980046da'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:17.913154 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-29c9d16c-d5d3-4f01-9b0d-38d4d156ca43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de17a22b701f4b8da7adba67980046da'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:17.921648 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-29c9d16c-d5d3-4f01-9b0d-38d4d156ca43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de17a22b701f4b8da7adba67980046da'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:17.930718 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1433/2838] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:13:17 2022] DELETE /identity/v3/users/de17a22b701f4b8da7adba67980046da => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:17.947927 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b791d3-9d84-43e4-a778-d32e0938098d admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:17.949756 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-79b791d3-9d84-43e4-a778-d32e0938098d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:18.014191 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b791d3-9d84-43e4-a778-d32e0938098d admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:18.067415 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490fafa-80a7-439d-a9dc-326ecf0b6ba8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:18.068030 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490fafa-80a7-439d-a9dc-326ecf0b6ba8 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:18.068307 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490fafa-80a7-439d-a9dc-326ecf0b6ba8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:18.068577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5490fafa-80a7-439d-a9dc-326ecf0b6ba8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:18.070383 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5490fafa-80a7-439d-a9dc-326ecf0b6ba8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:18.129128 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490fafa-80a7-439d-a9dc-326ecf0b6ba8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:18.131117 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5490fafa-80a7-439d-a9dc-326ecf0b6ba8 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:18.143429 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9d16c-d5d3-4f01-9b0d-38d4d156ca43 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:18.146738 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-29c9d16c-d5d3-4f01-9b0d-38d4d156ca43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:18.153676 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1406/2839] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:17 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:13:18.187166 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:18.252119 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9d16c-d5d3-4f01-9b0d-38d4d156ca43 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:18.259003 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76bfa5fc-8ce7-41ab-8302-7a02c8de6651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:18.259644 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfa5fc-8ce7-41ab-8302-7a02c8de6651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:18.259927 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfa5fc-8ce7-41ab-8302-7a02c8de6651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:18.260200 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76bfa5fc-8ce7-41ab-8302-7a02c8de6651 admin admin] PATH_INFO: `/v3/projects/1f8c9415a3324729a1eb8b4cb3343f80` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:18.261324 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfa5fc-8ce7-41ab-8302-7a02c8de6651 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f8c9415a3324729a1eb8b4cb3343f80)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:18.263252 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76bfa5fc-8ce7-41ab-8302-7a02c8de6651 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:18.365963 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490fafa-80a7-439d-a9dc-326ecf0b6ba8 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:18.367540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5490fafa-80a7-439d-a9dc-326ecf0b6ba8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:18.378566 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-76bfa5fc-8ce7-41ab-8302-7a02c8de6651 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f8c9415a3324729a1eb8b4cb3343f80', 'request_id': 'req-76bfa5fc-8ce7-41ab-8302-7a02c8de6651'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:18.391889 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5490fafa-80a7-439d-a9dc-326ecf0b6ba8 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:18.402543 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:18.448137 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-76bfa5fc-8ce7-41ab-8302-7a02c8de6651 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f8c9415a3324729a1eb8b4cb3343f80', 'request_id': 'req-76bfa5fc-8ce7-41ab-8302-7a02c8de6651'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:18.453086 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905660e2-fcbc-40a2-b077-41496b094d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:18.453749 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905660e2-fcbc-40a2-b077-41496b094d5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:18.454031 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905660e2-fcbc-40a2-b077-41496b094d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:18.454305 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905660e2-fcbc-40a2-b077-41496b094d5c admin admin] PATH_INFO: `/v3/projects/4419c735e9ca4b8b98910a43e07ffaec` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:18.454666 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-76bfa5fc-8ce7-41ab-8302-7a02c8de6651 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f8c9415a3324729a1eb8b4cb3343f80', 'request_id': 'req-76bfa5fc-8ce7-41ab-8302-7a02c8de6651'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:18.455470 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905660e2-fcbc-40a2-b077-41496b094d5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4419c735e9ca4b8b98910a43e07ffaec)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:18.457377 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905660e2-fcbc-40a2-b077-41496b094d5c admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:18.467007 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-76bfa5fc-8ce7-41ab-8302-7a02c8de6651 admin admin] The token cache is being invalidate because project 1f8c9415a3324729a1eb8b4cb3343f80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:13:18.467306 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-76bfa5fc-8ce7-41ab-8302-7a02c8de6651 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:18.467998 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-76bfa5fc-8ce7-41ab-8302-7a02c8de6651 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:18.469559 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1434/2840] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:13:18 2022] DELETE /identity/v3/projects/1f8c9415a3324729a1eb8b4cb3343f80 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:18.474915 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322c2b6-4ef0-42df-8961-bd6b5865958e None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:18.475198 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322c2b6-4ef0-42df-8961-bd6b5865958e None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:18.475475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322c2b6-4ef0-42df-8961-bd6b5865958e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:18.494591 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-a322c2b6-4ef0-42df-8961-bd6b5865958e None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:18.495785 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a322c2b6-4ef0-42df-8961-bd6b5865958e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:18.503624 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1435/2841] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:13:18.511278 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe62775-1f7f-427e-aa6a-0c730e29ae1a None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:18.512021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe62775-1f7f-427e-aa6a-0c730e29ae1a None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:18.512021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe62775-1f7f-427e-aa6a-0c730e29ae1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:18.531698 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-cbe62775-1f7f-427e-aa6a-0c730e29ae1a None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:18.532881 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-cbe62775-1f7f-427e-aa6a-0c730e29ae1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:18.541230 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1436/2842] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:13:18.545301 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe62775-1f7f-427e-aa6a-0c730e29ae1a None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:18.554520 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe62775-1f7f-427e-aa6a-0c730e29ae1a None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:18.559079 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95488e8-974f-45d4-9582-e6995c6c6ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:18.559656 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95488e8-974f-45d4-9582-e6995c6c6ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:18.559930 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95488e8-974f-45d4-9582-e6995c6c6ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:18.560199 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95488e8-974f-45d4-9582-e6995c6c6ad8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:18.560826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95488e8-974f-45d4-9582-e6995c6c6ad8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:13:18.561121 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95488e8-974f-45d4-9582-e6995c6c6ad8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:18.562730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95488e8-974f-45d4-9582-e6995c6c6ad8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:18.574905 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1437/2843] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:13:18.580159 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95488e8-974f-45d4-9582-e6995c6c6ad8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:18.589564 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95488e8-974f-45d4-9582-e6995c6c6ad8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:18.594205 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bee35-263a-44c8-94c1-94d7cb854b6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:18.594770 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bee35-263a-44c8-94c1-94d7cb854b6d admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:18.595051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bee35-263a-44c8-94c1-94d7cb854b6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:18.595323 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913bee35-263a-44c8-94c1-94d7cb854b6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:18.595930 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bee35-263a-44c8-94c1-94d7cb854b6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:18.597798 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913bee35-263a-44c8-94c1-94d7cb854b6d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:18.609840 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-905660e2-fcbc-40a2-b077-41496b094d5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4419c735e9ca4b8b98910a43e07ffaec', 'request_id': 'req-905660e2-fcbc-40a2-b077-41496b094d5c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:18.615849 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-905660e2-fcbc-40a2-b077-41496b094d5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4419c735e9ca4b8b98910a43e07ffaec', 'request_id': 'req-905660e2-fcbc-40a2-b077-41496b094d5c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:18.624206 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-905660e2-fcbc-40a2-b077-41496b094d5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4419c735e9ca4b8b98910a43e07ffaec', 'request_id': 'req-905660e2-fcbc-40a2-b077-41496b094d5c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:18.694208 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1438/2844] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:13:18 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:13:18.698112 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bee35-263a-44c8-94c1-94d7cb854b6d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:18.722028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-905660e2-fcbc-40a2-b077-41496b094d5c admin admin] The token cache is being invalidate because project 4419c735e9ca4b8b98910a43e07ffaec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:13:18.726505 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-905660e2-fcbc-40a2-b077-41496b094d5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:18.726505 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-905660e2-fcbc-40a2-b077-41496b094d5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:18.726505 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1407/2845] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:13:18 2022] DELETE /identity/v3/projects/4419c735e9ca4b8b98910a43e07ffaec => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:18.729540 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905660e2-fcbc-40a2-b077-41496b094d5c admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:18.730974 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-905660e2-fcbc-40a2-b077-41496b094d5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:18.763949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:18.769040 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913bee35-263a-44c8-94c1-94d7cb854b6d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:18.774025 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60322f85-2e4d-4a94-bf02-c7fc6e34b37f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:18.774635 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60322f85-2e4d-4a94-bf02-c7fc6e34b37f admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:18.774910 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60322f85-2e4d-4a94-bf02-c7fc6e34b37f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:18.775181 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60322f85-2e4d-4a94-bf02-c7fc6e34b37f admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:18.775830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60322f85-2e4d-4a94-bf02-c7fc6e34b37f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:18.777922 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60322f85-2e4d-4a94-bf02-c7fc6e34b37f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:18.798611 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905660e2-fcbc-40a2-b077-41496b094d5c admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:18.803830 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83574491-24d2-4722-b89e-0549b9401aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:18.804502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83574491-24d2-4722-b89e-0549b9401aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:18.804733 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83574491-24d2-4722-b89e-0549b9401aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:18.805006 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83574491-24d2-4722-b89e-0549b9401aeb admin admin] PATH_INFO: `/v3/users/ef86165ff13d4666a285ed3a8f1c27f5` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:18.806165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83574491-24d2-4722-b89e-0549b9401aeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef86165ff13d4666a285ed3a8f1c27f5)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:18.808066 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83574491-24d2-4722-b89e-0549b9401aeb admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:18.846412 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1439/2846] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:13:18 2022] POST /identity/v3/users => generated 286 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:13:18.850366 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60322f85-2e4d-4a94-bf02-c7fc6e34b37f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:18.852065 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-60322f85-2e4d-4a94-bf02-c7fc6e34b37f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:18.864462 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60322f85-2e4d-4a94-bf02-c7fc6e34b37f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:18.869071 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16677c02-8486-4e12-b74a-08371b3e1775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:18.869649 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16677c02-8486-4e12-b74a-08371b3e1775 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:18.869962 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16677c02-8486-4e12-b74a-08371b3e1775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:18.870319 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16677c02-8486-4e12-b74a-08371b3e1775 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:18.870932 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16677c02-8486-4e12-b74a-08371b3e1775 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:18.872517 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16677c02-8486-4e12-b74a-08371b3e1775 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:18.883314 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1440/2847] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:13:18.889537 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16677c02-8486-4e12-b74a-08371b3e1775 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:18.899951 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16677c02-8486-4e12-b74a-08371b3e1775 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:18.904686 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e9ba2-6000-4a65-a068-e6445bbb1179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:18.906099 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e9ba2-6000-4a65-a068-e6445bbb1179 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:18.906391 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e9ba2-6000-4a65-a068-e6445bbb1179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:18.906669 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258e9ba2-6000-4a65-a068-e6445bbb1179 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:18.907313 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e9ba2-6000-4a65-a068-e6445bbb1179 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:18.909109 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258e9ba2-6000-4a65-a068-e6445bbb1179 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:18.921862 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1441/2848] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:13:18.925929 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e9ba2-6000-4a65-a068-e6445bbb1179 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:18.935938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258e9ba2-6000-4a65-a068-e6445bbb1179 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:18.940513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eea9450-df06-41ce-a2c7-6b755358af08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:18.941141 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea9450-df06-41ce-a2c7-6b755358af08 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:18.941419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea9450-df06-41ce-a2c7-6b755358af08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:18.941714 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eea9450-df06-41ce-a2c7-6b755358af08 admin admin] PATH_INFO: `/v3/projects/e5a5a3c3cd1b44868264f815d01ebfbf/users/74c665847739461f895ed2bba3107329/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:18.955906 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea9450-df06-41ce-a2c7-6b755358af08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5a5a3c3cd1b44868264f815d01ebfbf, user_id=74c665847739461f895ed2bba3107329, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:18.958513 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eea9450-df06-41ce-a2c7-6b755358af08 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:19.019586 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-83574491-24d2-4722-b89e-0549b9401aeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef86165ff13d4666a285ed3a8f1c27f5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:19.080762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-83574491-24d2-4722-b89e-0549b9401aeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef86165ff13d4666a285ed3a8f1c27f5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:19.086620 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1442/2849] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:18 2022] PUT /identity/v3/projects/e5a5a3c3cd1b44868264f815d01ebfbf/users/74c665847739461f895ed2bba3107329/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:19.091783 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb054b0e-48b5-4bbe-8220-854ecf4351a4 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:19.092067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb054b0e-48b5-4bbe-8220-854ecf4351a4 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:19.092339 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb054b0e-48b5-4bbe-8220-854ecf4351a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:19.094081 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-83574491-24d2-4722-b89e-0549b9401aeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef86165ff13d4666a285ed3a8f1c27f5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:19.094773 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-83574491-24d2-4722-b89e-0549b9401aeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef86165ff13d4666a285ed3a8f1c27f5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:19.102306 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-83574491-24d2-4722-b89e-0549b9401aeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef86165ff13d4666a285ed3a8f1c27f5'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:19.108194 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1408/2850] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:13:18 2022] DELETE /identity/v3/users/ef86165ff13d4666a285ed3a8f1c27f5 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:19.112215 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-bb054b0e-48b5-4bbe-8220-854ecf4351a4 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:19.113301 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bb054b0e-48b5-4bbe-8220-854ecf4351a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:19.172646 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:19.175018 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1443/2851] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:13:19.184596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83574491-24d2-4722-b89e-0549b9401aeb admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:19.186133 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-83574491-24d2-4722-b89e-0549b9401aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:19.243954 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83574491-24d2-4722-b89e-0549b9401aeb admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:19.247871 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281282e-b376-4cc0-9ed5-685af8ee5fb3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:19.248473 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281282e-b376-4cc0-9ed5-685af8ee5fb3 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:19.248751 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281282e-b376-4cc0-9ed5-685af8ee5fb3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:19.251847 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8281282e-b376-4cc0-9ed5-685af8ee5fb3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:19.257999 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281282e-b376-4cc0-9ed5-685af8ee5fb3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:19.259399 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8281282e-b376-4cc0-9ed5-685af8ee5fb3 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:19.268519 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1409/2852] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:13:19.570950 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb054b0e-48b5-4bbe-8220-854ecf4351a4 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:19.572396 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bb054b0e-48b5-4bbe-8220-854ecf4351a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:19.627012 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281282e-b376-4cc0-9ed5-685af8ee5fb3 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:19.630474 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8281282e-b376-4cc0-9ed5-685af8ee5fb3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:19.630630 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb054b0e-48b5-4bbe-8220-854ecf4351a4 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:19.635203 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c023d00-39b9-4bc4-b225-02fd1ed6d2f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:19.635840 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c023d00-39b9-4bc4-b225-02fd1ed6d2f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:19.636118 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c023d00-39b9-4bc4-b225-02fd1ed6d2f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:19.636386 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c023d00-39b9-4bc4-b225-02fd1ed6d2f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:19.638292 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-7c023d00-39b9-4bc4-b225-02fd1ed6d2f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:19.644232 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8281282e-b376-4cc0-9ed5-685af8ee5fb3 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:19.650588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c289a83e-a0c5-418a-9201-0bea07361ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:19.651226 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289a83e-a0c5-418a-9201-0bea07361ebc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:19.651514 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289a83e-a0c5-418a-9201-0bea07361ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:19.651812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c289a83e-a0c5-418a-9201-0bea07361ebc admin admin] PATH_INFO: `/v3/projects/5ae2a6cd984a43c68072b9e7c742ec30` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:19.653178 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289a83e-a0c5-418a-9201-0bea07361ebc admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ae2a6cd984a43c68072b9e7c742ec30)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:19.655233 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c289a83e-a0c5-418a-9201-0bea07361ebc admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:19.705826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:19.720258 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c023d00-39b9-4bc4-b225-02fd1ed6d2f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:19.722037 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c023d00-39b9-4bc4-b225-02fd1ed6d2f9 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:19.732770 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1444/2853] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:13:19.783616 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c289a83e-a0c5-418a-9201-0bea07361ebc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ae2a6cd984a43c68072b9e7c742ec30', 'request_id': 'req-c289a83e-a0c5-418a-9201-0bea07361ebc'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:19.789500 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c289a83e-a0c5-418a-9201-0bea07361ebc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ae2a6cd984a43c68072b9e7c742ec30', 'request_id': 'req-c289a83e-a0c5-418a-9201-0bea07361ebc'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:19.796620 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c289a83e-a0c5-418a-9201-0bea07361ebc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ae2a6cd984a43c68072b9e7c742ec30', 'request_id': 'req-c289a83e-a0c5-418a-9201-0bea07361ebc'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:19.932469 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c289a83e-a0c5-418a-9201-0bea07361ebc admin admin] The token cache is being invalidate because project 5ae2a6cd984a43c68072b9e7c742ec30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:13:19.932762 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c289a83e-a0c5-418a-9201-0bea07361ebc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:19.933393 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-c289a83e-a0c5-418a-9201-0bea07361ebc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:19.935028 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1410/2854] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:13:19 2022] DELETE /identity/v3/projects/5ae2a6cd984a43c68072b9e7c742ec30 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:19.940816 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd527c01-8eac-407e-abb9-0604936974df None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:19.941399 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd527c01-8eac-407e-abb9-0604936974df None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:19.941399 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd527c01-8eac-407e-abb9-0604936974df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:19.961892 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-bd527c01-8eac-407e-abb9-0604936974df None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:19.963372 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-bd527c01-8eac-407e-abb9-0604936974df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:20.028162 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1445/2855] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:20.036505 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b21b47-cec1-43f2-bce7-0a15dbb310d9 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:20.036797 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b21b47-cec1-43f2-bce7-0a15dbb310d9 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:20.037076 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b21b47-cec1-43f2-bce7-0a15dbb310d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:20.060269 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-d6b21b47-cec1-43f2-bce7-0a15dbb310d9 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:20.060269 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-d6b21b47-cec1-43f2-bce7-0a15dbb310d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:20.070252 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1411/2856] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:20.074495 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd527c01-8eac-407e-abb9-0604936974df None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:20.084724 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd527c01-8eac-407e-abb9-0604936974df None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:20.089896 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e20465-6658-43b3-923c-70e55bf6dc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:20.094932 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e20465-6658-43b3-923c-70e55bf6dc17 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:20.094932 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e20465-6658-43b3-923c-70e55bf6dc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:20.094932 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e20465-6658-43b3-923c-70e55bf6dc17 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:20.094932 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e20465-6658-43b3-923c-70e55bf6dc17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:13:20.094932 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e20465-6658-43b3-923c-70e55bf6dc17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:20.094932 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e20465-6658-43b3-923c-70e55bf6dc17 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:20.105645 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1446/2857] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:13:20.110378 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b21b47-cec1-43f2-bce7-0a15dbb310d9 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:20.122264 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b21b47-cec1-43f2-bce7-0a15dbb310d9 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:20.127204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91804d-b759-4997-bc0e-9eb7ed0773cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:20.132776 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91804d-b759-4997-bc0e-9eb7ed0773cf admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:20.132776 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91804d-b759-4997-bc0e-9eb7ed0773cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:20.132776 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91804d-b759-4997-bc0e-9eb7ed0773cf admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:20.132776 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91804d-b759-4997-bc0e-9eb7ed0773cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:20.132776 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a91804d-b759-4997-bc0e-9eb7ed0773cf admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:20.228726 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1412/2858] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:13:20 2022] POST /identity/v3/projects => generated 385 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:13:20.232851 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e20465-6658-43b3-923c-70e55bf6dc17 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:20.242876 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e20465-6658-43b3-923c-70e55bf6dc17 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:20.297563 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee54b5-eafd-48d7-b288-e4b6d4dc01aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:20.298132 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee54b5-eafd-48d7-b288-e4b6d4dc01aa admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:20.298414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee54b5-eafd-48d7-b288-e4b6d4dc01aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:20.298687 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee54b5-eafd-48d7-b288-e4b6d4dc01aa admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:20.299318 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee54b5-eafd-48d7-b288-e4b6d4dc01aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:20.301259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee54b5-eafd-48d7-b288-e4b6d4dc01aa admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:20.410224 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1447/2859] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:13:20 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:13:20.411470 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91804d-b759-4997-bc0e-9eb7ed0773cf admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:20.421906 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91804d-b759-4997-bc0e-9eb7ed0773cf admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:20.426997 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99070ca5-fadb-424c-8b88-6084b847ad53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:20.427612 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99070ca5-fadb-424c-8b88-6084b847ad53 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:20.427920 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99070ca5-fadb-424c-8b88-6084b847ad53 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:20.428193 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99070ca5-fadb-424c-8b88-6084b847ad53 admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:20.428833 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99070ca5-fadb-424c-8b88-6084b847ad53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:20.430478 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99070ca5-fadb-424c-8b88-6084b847ad53 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:20.441204 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1413/2860] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:20.446063 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee54b5-eafd-48d7-b288-e4b6d4dc01aa admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:20.456860 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee54b5-eafd-48d7-b288-e4b6d4dc01aa admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:20.462463 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcc33f-e32a-4532-bae1-bc0c8cd72b3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:20.463067 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcc33f-e32a-4532-bae1-bc0c8cd72b3b admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:20.463347 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcc33f-e32a-4532-bae1-bc0c8cd72b3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:20.463621 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcc33f-e32a-4532-bae1-bc0c8cd72b3b admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:20.464262 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcc33f-e32a-4532-bae1-bc0c8cd72b3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:20.465901 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dcc33f-e32a-4532-bae1-bc0c8cd72b3b admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:20.476730 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1448/2861] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:20.480993 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99070ca5-fadb-424c-8b88-6084b847ad53 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:20.493469 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99070ca5-fadb-424c-8b88-6084b847ad53 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:20.498202 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f3950-b604-49b9-8d22-1c635ddc5a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:20.498856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f3950-b604-49b9-8d22-1c635ddc5a7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:20.499138 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f3950-b604-49b9-8d22-1c635ddc5a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:20.499413 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5f3950-b604-49b9-8d22-1c635ddc5a7a admin admin] PATH_INFO: `/v3/projects/ef99a7b1b49a45e79e42d25c146c9772/users/956ce73ee2fa4c6fb8713b98ae6f86a8/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:20.502467 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:20.514892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f3950-b604-49b9-8d22-1c635ddc5a7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef99a7b1b49a45e79e42d25c146c9772, user_id=956ce73ee2fa4c6fb8713b98ae6f86a8, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:20.517646 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5f3950-b604-49b9-8d22-1c635ddc5a7a admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:20.604159 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1414/2862] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:20 2022] PUT /identity/v3/projects/ef99a7b1b49a45e79e42d25c146c9772/users/956ce73ee2fa4c6fb8713b98ae6f86a8/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:20.615638 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c28e3-69d2-42ff-b1e5-5899e31644c8 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:20.615951 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c28e3-69d2-42ff-b1e5-5899e31644c8 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:20.616311 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021c28e3-69d2-42ff-b1e5-5899e31644c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:20.647549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-021c28e3-69d2-42ff-b1e5-5899e31644c8 None None] MFA Rules not processed for user `956ce73ee2fa4c6fb8713b98ae6f86a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:20.648803 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-021c28e3-69d2-42ff-b1e5-5899e31644c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:20.691858 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:20.713127 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1449/2863] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:20.717951 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f3950-b604-49b9-8d22-1c635ddc5a7a admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:20.779528 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5f3950-b604-49b9-8d22-1c635ddc5a7a admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:20.784286 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e554d20-c18a-4faf-93ed-ab37af90846d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:20.784880 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e554d20-c18a-4faf-93ed-ab37af90846d admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:20.785158 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e554d20-c18a-4faf-93ed-ab37af90846d admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:20.785427 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e554d20-c18a-4faf-93ed-ab37af90846d admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:20.786108 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e554d20-c18a-4faf-93ed-ab37af90846d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:20.788037 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e554d20-c18a-4faf-93ed-ab37af90846d admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:20.897936 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1415/2864] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:13:20 2022] POST /identity/v3/projects => generated 383 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:13:20.902151 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c28e3-69d2-42ff-b1e5-5899e31644c8 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:20.910680 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a9d77-a81e-47a1-8581-e01f9af61f3f None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:20.912152 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a9d77-a81e-47a1-8581-e01f9af61f3f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:20.912438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366a9d77-a81e-47a1-8581-e01f9af61f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:20.914740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021c28e3-69d2-42ff-b1e5-5899e31644c8 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:20.943975 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-366a9d77-a81e-47a1-8581-e01f9af61f3f None None] MFA Rules not processed for user `74c665847739461f895ed2bba3107329`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:20.945525 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-366a9d77-a81e-47a1-8581-e01f9af61f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:20.983398 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd777f7-b4dc-4e68-b432-6a7500196806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:20.984024 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd777f7-b4dc-4e68-b432-6a7500196806 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:20.984277 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd777f7-b4dc-4e68-b432-6a7500196806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:20.984552 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd777f7-b4dc-4e68-b432-6a7500196806 admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:20.985795 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd777f7-b4dc-4e68-b432-6a7500196806 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:20.987757 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd777f7-b4dc-4e68-b432-6a7500196806 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:21.024623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1416/2865] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:21.029152 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a9d77-a81e-47a1-8581-e01f9af61f3f None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:21.030703 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-366a9d77-a81e-47a1-8581-e01f9af61f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:21.043845 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366a9d77-a81e-47a1-8581-e01f9af61f3f None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:21.048382 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09862027-f643-4c71-9aad-c19c5e6344fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:21.049327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09862027-f643-4c71-9aad-c19c5e6344fb admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:21.049327 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09862027-f643-4c71-9aad-c19c5e6344fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:21.049595 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09862027-f643-4c71-9aad-c19c5e6344fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:21.050146 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09862027-f643-4c71-9aad-c19c5e6344fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:21.052165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09862027-f643-4c71-9aad-c19c5e6344fb admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:21.072987 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1450/2866] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:13:20 2022] POST /identity/v3/users => generated 298 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:13:21.076979 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd777f7-b4dc-4e68-b432-6a7500196806 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:21.087222 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd777f7-b4dc-4e68-b432-6a7500196806 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:21.092158 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd0fae-f30c-45f5-b6f9-c2afb094ecdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:21.092752 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd0fae-f30c-45f5-b6f9-c2afb094ecdd admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:21.093031 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd0fae-f30c-45f5-b6f9-c2afb094ecdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:21.093304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd0fae-f30c-45f5-b6f9-c2afb094ecdd admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:21.093980 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd0fae-f30c-45f5-b6f9-c2afb094ecdd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:21.095567 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccd0fae-f30c-45f5-b6f9-c2afb094ecdd admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:21.106021 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1451/2867] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:13:21.111274 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd0fae-f30c-45f5-b6f9-c2afb094ecdd admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:21.121779 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd0fae-f30c-45f5-b6f9-c2afb094ecdd admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:21.126804 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e684056-28e3-4750-b797-4c3713749aff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:21.127503 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e684056-28e3-4750-b797-4c3713749aff admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:21.127849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e684056-28e3-4750-b797-4c3713749aff admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:21.128202 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e684056-28e3-4750-b797-4c3713749aff admin admin] PATH_INFO: `/v3/projects/7d25e92fcaa848ce8d01f6771f2a0820/users/fc84dfb6b1fd4d80b96671eb4ab8213c/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:21.134101 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1417/2868] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:13:21 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:13:21.135081 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09862027-f643-4c71-9aad-c19c5e6344fb admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:21.146311 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e684056-28e3-4750-b797-4c3713749aff admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d25e92fcaa848ce8d01f6771f2a0820, user_id=fc84dfb6b1fd4d80b96671eb4ab8213c, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:21.149136 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e684056-28e3-4750-b797-4c3713749aff admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:21.179953 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:21.202100 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09862027-f643-4c71-9aad-c19c5e6344fb admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:21.206303 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1452/2869] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:21 2022] PUT /identity/v3/projects/7d25e92fcaa848ce8d01f6771f2a0820/users/fc84dfb6b1fd4d80b96671eb4ab8213c/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:21.206717 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e684056-28e3-4750-b797-4c3713749aff admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:21.268300 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7677a6b0-82f6-4084-af7a-da21bf77f52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:21.268911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677a6b0-82f6-4084-af7a-da21bf77f52b admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:21.269192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677a6b0-82f6-4084-af7a-da21bf77f52b admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:21.269543 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7677a6b0-82f6-4084-af7a-da21bf77f52b admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:21.270249 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677a6b0-82f6-4084-af7a-da21bf77f52b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:21.272695 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7677a6b0-82f6-4084-af7a-da21bf77f52b admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:21.275482 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e684056-28e3-4750-b797-4c3713749aff admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:21.280144 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf450ff-9c64-446f-b09a-d6e734ffcc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:21.280747 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf450ff-9c64-446f-b09a-d6e734ffcc04 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:21.281321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf450ff-9c64-446f-b09a-d6e734ffcc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:21.281593 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf450ff-9c64-446f-b09a-d6e734ffcc04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:21.282269 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf450ff-9c64-446f-b09a-d6e734ffcc04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:21.283853 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf450ff-9c64-446f-b09a-d6e734ffcc04 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:21.298349 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1453/2870] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:21.306268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf450ff-9c64-446f-b09a-d6e734ffcc04 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:21.318077 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf450ff-9c64-446f-b09a-d6e734ffcc04 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:21.322610 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571eb98-e185-4ed7-9202-e4627c903de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:21.323225 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571eb98-e185-4ed7-9202-e4627c903de8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:21.323501 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571eb98-e185-4ed7-9202-e4627c903de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:21.332648 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9571eb98-e185-4ed7-9202-e4627c903de8 admin admin] PATH_INFO: `/v3/projects/7d25e92fcaa848ce8d01f6771f2a0820/users/fc84dfb6b1fd4d80b96671eb4ab8213c/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:21.332648 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571eb98-e185-4ed7-9202-e4627c903de8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d25e92fcaa848ce8d01f6771f2a0820, user_id=fc84dfb6b1fd4d80b96671eb4ab8213c, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:21.332648 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9571eb98-e185-4ed7-9202-e4627c903de8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:21.338830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1454/2871] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:21 2022] PUT /identity/v3/projects/7d25e92fcaa848ce8d01f6771f2a0820/users/fc84dfb6b1fd4d80b96671eb4ab8213c/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:21.388903 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1418/2872] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:13:21 2022] POST /identity/v3/users => generated 292 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:13:21.393186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571eb98-e185-4ed7-9202-e4627c903de8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:21.405846 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eccb2b-f4de-4bfe-9dc6-8d35e3b6c51f None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:21.406040 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eccb2b-f4de-4bfe-9dc6-8d35e3b6c51f None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:21.406317 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09eccb2b-f4de-4bfe-9dc6-8d35e3b6c51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:21.420906 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:21.435055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-09eccb2b-f4de-4bfe-9dc6-8d35e3b6c51f None None] MFA Rules not processed for user `fc84dfb6b1fd4d80b96671eb4ab8213c`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:21.436299 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-09eccb2b-f4de-4bfe-9dc6-8d35e3b6c51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:21.458988 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9571eb98-e185-4ed7-9202-e4627c903de8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:21.464263 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cba05a-464f-4349-a867-8aae61efed58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:21.464736 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cba05a-464f-4349-a867-8aae61efed58 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:21.464858 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cba05a-464f-4349-a867-8aae61efed58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:21.465091 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cba05a-464f-4349-a867-8aae61efed58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:21.465748 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cba05a-464f-4349-a867-8aae61efed58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:21.469923 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cba05a-464f-4349-a867-8aae61efed58 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:21.478854 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1455/2873] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:21.483048 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cba05a-464f-4349-a867-8aae61efed58 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:21.493662 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cba05a-464f-4349-a867-8aae61efed58 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:21.498875 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d47600-22d9-49a3-87a7-2db858479de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:21.499681 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d47600-22d9-49a3-87a7-2db858479de8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:21.500053 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d47600-22d9-49a3-87a7-2db858479de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:21.500335 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d47600-22d9-49a3-87a7-2db858479de8 admin admin] PATH_INFO: `/v3/projects/602ecca70775412ea11f5775fe85212b/users/0f76b6371bcc4aa1b1a2cb181ea9a8d3/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:21.514855 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d47600-22d9-49a3-87a7-2db858479de8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=602ecca70775412ea11f5775fe85212b, user_id=0f76b6371bcc4aa1b1a2cb181ea9a8d3, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:21.515503 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1419/2874] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:21 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:13:21.517780 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d47600-22d9-49a3-87a7-2db858479de8 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:21.527006 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eccb2b-f4de-4bfe-9dc6-8d35e3b6c51f None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:21.528636 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-09eccb2b-f4de-4bfe-9dc6-8d35e3b6c51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:21.585825 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09eccb2b-f4de-4bfe-9dc6-8d35e3b6c51f None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:21.589674 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0b52c-0b90-4aa6-b9f9-0b2feb4ac5a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:21.590304 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0b52c-0b90-4aa6-b9f9-0b2feb4ac5a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:21.590576 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0b52c-0b90-4aa6-b9f9-0b2feb4ac5a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:21.590844 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0b52c-0b90-4aa6-b9f9-0b2feb4ac5a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:21.602521 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:21.616568 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1456/2875] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:21 2022] PUT /identity/v3/projects/602ecca70775412ea11f5775fe85212b/users/0f76b6371bcc4aa1b1a2cb181ea9a8d3/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:21.617599 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d47600-22d9-49a3-87a7-2db858479de8 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:21.648297 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0b52c-0b90-4aa6-b9f9-0b2feb4ac5a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:21.649878 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0b52c-0b90-4aa6-b9f9-0b2feb4ac5a6 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:21.659117 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1420/2876] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:13:21.681552 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d47600-22d9-49a3-87a7-2db858479de8 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:21.686718 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887793f4-1855-4cee-981c-9988da8a9afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:21.687363 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887793f4-1855-4cee-981c-9988da8a9afc admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:21.687673 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887793f4-1855-4cee-981c-9988da8a9afc admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:21.687947 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887793f4-1855-4cee-981c-9988da8a9afc admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:21.688587 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887793f4-1855-4cee-981c-9988da8a9afc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:21.690214 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887793f4-1855-4cee-981c-9988da8a9afc admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:21.702236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1457/2877] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:21 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 13 20:13:21.706622 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0b52c-0b90-4aa6-b9f9-0b2feb4ac5a6 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:21.720979 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0b52c-0b90-4aa6-b9f9-0b2feb4ac5a6 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:21.734305 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5cdd63-6c7b-43c9-85c3-610d18795d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:21.734305 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cdd63-6c7b-43c9-85c3-610d18795d13 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:21.734305 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cdd63-6c7b-43c9-85c3-610d18795d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:21.734305 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5cdd63-6c7b-43c9-85c3-610d18795d13 admin admin] PATH_INFO: `/v3/projects/602ecca70775412ea11f5775fe85212b/users/0f76b6371bcc4aa1b1a2cb181ea9a8d3/roles/cd02ef2043de492a8bff6c165485f255` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:21.734894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5cdd63-6c7b-43c9-85c3-610d18795d13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=602ecca70775412ea11f5775fe85212b, user_id=0f76b6371bcc4aa1b1a2cb181ea9a8d3, role_id=cd02ef2043de492a8bff6c165485f255)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:21.734894 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5cdd63-6c7b-43c9-85c3-610d18795d13 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:21.743933 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1421/2878] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:21 2022] PUT /identity/v3/projects/602ecca70775412ea11f5775fe85212b/users/0f76b6371bcc4aa1b1a2cb181ea9a8d3/roles/cd02ef2043de492a8bff6c165485f255 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:23.105356 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a0db9-45e2-44d8-a16b-3df951728250 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:23.105903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a0db9-45e2-44d8-a16b-3df951728250 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:23.106040 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5a0db9-45e2-44d8-a16b-3df951728250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:23.138290 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4d5a0db9-45e2-44d8-a16b-3df951728250 None None] MFA Rules not processed for user `0f76b6371bcc4aa1b1a2cb181ea9a8d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:23.139494 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4d5a0db9-45e2-44d8-a16b-3df951728250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:23.216327 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1458/2879] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:23.227445 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14895a42-5994-4c02-a28e-abec23130b7d None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:23.227919 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14895a42-5994-4c02-a28e-abec23130b7d None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:23.228133 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14895a42-5994-4c02-a28e-abec23130b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:23.248066 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-14895a42-5994-4c02-a28e-abec23130b7d None None] MFA Rules not processed for user `74c665847739461f895ed2bba3107329`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:23.249393 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-14895a42-5994-4c02-a28e-abec23130b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:23.304082 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1422/2880] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:23 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:23.318142 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a0db9-45e2-44d8-a16b-3df951728250 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:23.319556 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4d5a0db9-45e2-44d8-a16b-3df951728250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:23.339571 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:23.393272 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5a0db9-45e2-44d8-a16b-3df951728250 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:23.400490 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea028713-5bf1-4fbe-8931-9527a2bd78ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:23.400490 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea028713-5bf1-4fbe-8931-9527a2bd78ab service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:23.400490 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea028713-5bf1-4fbe-8931-9527a2bd78ab service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:23.400784 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea028713-5bf1-4fbe-8931-9527a2bd78ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:23.409371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea028713-5bf1-4fbe-8931-9527a2bd78ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:23.411617 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea028713-5bf1-4fbe-8931-9527a2bd78ab service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:23.421667 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1459/2881] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:23 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:13:23.662199 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14895a42-5994-4c02-a28e-abec23130b7d None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:23.665981 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-14895a42-5994-4c02-a28e-abec23130b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:23.721856 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14895a42-5994-4c02-a28e-abec23130b7d None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:23.725593 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a461df15-a32c-4571-99a6-90114481a94b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:23.726250 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461df15-a32c-4571-99a6-90114481a94b service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:23.726559 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461df15-a32c-4571-99a6-90114481a94b service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:23.726828 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a461df15-a32c-4571-99a6-90114481a94b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:23.728588 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a461df15-a32c-4571-99a6-90114481a94b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:23.738113 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461df15-a32c-4571-99a6-90114481a94b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:23.740279 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a461df15-a32c-4571-99a6-90114481a94b service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:23.748562 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1423/2882] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:13:24.530791 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea028713-5bf1-4fbe-8931-9527a2bd78ab service nova] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:24.532205 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-ea028713-5bf1-4fbe-8931-9527a2bd78ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:24.598388 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea028713-5bf1-4fbe-8931-9527a2bd78ab service nova] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:24.603626 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8185f-4390-49c3-a7b4-5433ab8e5d82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:24.604253 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8185f-4390-49c3-a7b4-5433ab8e5d82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:24.604530 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8185f-4390-49c3-a7b4-5433ab8e5d82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:24.604798 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8185f-4390-49c3-a7b4-5433ab8e5d82 admin admin] PATH_INFO: `/v3/users/da4728c1b90347e79ec9f0ecafb352eb` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:24.605975 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8185f-4390-49c3-a7b4-5433ab8e5d82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da4728c1b90347e79ec9f0ecafb352eb)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:24.607902 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e8185f-4390-49c3-a7b4-5433ab8e5d82 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:24.799039 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b1e8185f-4390-49c3-a7b4-5433ab8e5d82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da4728c1b90347e79ec9f0ecafb352eb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:24.943907 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b1e8185f-4390-49c3-a7b4-5433ab8e5d82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da4728c1b90347e79ec9f0ecafb352eb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:24.956671 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b1e8185f-4390-49c3-a7b4-5433ab8e5d82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da4728c1b90347e79ec9f0ecafb352eb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:24.957311 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b1e8185f-4390-49c3-a7b4-5433ab8e5d82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da4728c1b90347e79ec9f0ecafb352eb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:24.964618 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b1e8185f-4390-49c3-a7b4-5433ab8e5d82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da4728c1b90347e79ec9f0ecafb352eb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:24.970847 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1460/2883] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:13:24 2022] DELETE /identity/v3/users/da4728c1b90347e79ec9f0ecafb352eb => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:24.975788 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea95d51-939c-4ec9-b443-5ddbbfbba703 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:24.976283 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea95d51-939c-4ec9-b443-5ddbbfbba703 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:24.976418 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea95d51-939c-4ec9-b443-5ddbbfbba703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:24.996116 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-1ea95d51-939c-4ec9-b443-5ddbbfbba703 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:24.997344 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1ea95d51-939c-4ec9-b443-5ddbbfbba703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:25.041000 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:25.056224 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1424/2884] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:25.066680 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8185f-4390-49c3-a7b4-5433ab8e5d82 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:25.067749 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b1e8185f-4390-49c3-a7b4-5433ab8e5d82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:25.089498 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:25.125890 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8185f-4390-49c3-a7b4-5433ab8e5d82 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:25.129680 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df4f8e-fa46-4d39-96c7-c8082378f1fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:25.130316 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df4f8e-fa46-4d39-96c7-c8082378f1fa service neutron] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:25.130595 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df4f8e-fa46-4d39-96c7-c8082378f1fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:25.130889 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df4f8e-fa46-4d39-96c7-c8082378f1fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:25.139675 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df4f8e-fa46-4d39-96c7-c8082378f1fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:25.141096 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df4f8e-fa46-4d39-96c7-c8082378f1fa service neutron] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:25.151525 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1461/2885] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:13:25.191444 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea95d51-939c-4ec9-b443-5ddbbfbba703 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:25.192868 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1ea95d51-939c-4ec9-b443-5ddbbfbba703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:25.290555 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea95d51-939c-4ec9-b443-5ddbbfbba703 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:25.293779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913dcb0-a648-49da-8f27-cef3031c7049 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e7df5170c841abb449f3b4a547ec4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:25.294493 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913dcb0-a648-49da-8f27-cef3031c7049 service placement] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:25.294842 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913dcb0-a648-49da-8f27-cef3031c7049 service placement] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:25.295179 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913dcb0-a648-49da-8f27-cef3031c7049 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:25.297001 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6913dcb0-a648-49da-8f27-cef3031c7049 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:25.309342 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913dcb0-a648-49da-8f27-cef3031c7049 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:25.311020 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6913dcb0-a648-49da-8f27-cef3031c7049 service placement] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:25.321428 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1425/2886] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:13:25.617625 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df4f8e-fa46-4d39-96c7-c8082378f1fa service neutron] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:25.619799 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d7df4f8e-fa46-4d39-96c7-c8082378f1fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:25.634634 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df4f8e-fa46-4d39-96c7-c8082378f1fa service neutron] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:25.640113 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e52017-f54b-47cf-adaf-7e82a1550cbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:25.640746 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e52017-f54b-47cf-adaf-7e82a1550cbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:25.641061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e52017-f54b-47cf-adaf-7e82a1550cbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:25.641381 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e52017-f54b-47cf-adaf-7e82a1550cbb admin admin] PATH_INFO: `/v3/projects/f444369d8a2448699451c6fcc0ea9887` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:25.642531 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e52017-f54b-47cf-adaf-7e82a1550cbb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f444369d8a2448699451c6fcc0ea9887)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:25.644442 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e52017-f54b-47cf-adaf-7e82a1550cbb admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:25.747802 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-06e52017-f54b-47cf-adaf-7e82a1550cbb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f444369d8a2448699451c6fcc0ea9887', 'request_id': 'req-06e52017-f54b-47cf-adaf-7e82a1550cbb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:25.821200 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-06e52017-f54b-47cf-adaf-7e82a1550cbb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f444369d8a2448699451c6fcc0ea9887', 'request_id': 'req-06e52017-f54b-47cf-adaf-7e82a1550cbb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:25.827224 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-06e52017-f54b-47cf-adaf-7e82a1550cbb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f444369d8a2448699451c6fcc0ea9887', 'request_id': 'req-06e52017-f54b-47cf-adaf-7e82a1550cbb'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:25.839747 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-06e52017-f54b-47cf-adaf-7e82a1550cbb admin admin] The token cache is being invalidate because project f444369d8a2448699451c6fcc0ea9887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:13:25.840043 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-06e52017-f54b-47cf-adaf-7e82a1550cbb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:25.840722 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-06e52017-f54b-47cf-adaf-7e82a1550cbb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:25.842409 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1462/2887] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:13:25 2022] DELETE /identity/v3/projects/f444369d8a2448699451c6fcc0ea9887 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:25.846425 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913dcb0-a648-49da-8f27-cef3031c7049 service placement] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:25.857137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6913dcb0-a648-49da-8f27-cef3031c7049 service placement] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:25.922664 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77aea5-1d33-4937-aba3-05caa8450cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:25.922664 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77aea5-1d33-4937-aba3-05caa8450cfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:25.922664 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77aea5-1d33-4937-aba3-05caa8450cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:25.922664 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e77aea5-1d33-4937-aba3-05caa8450cfa admin admin] PATH_INFO: `/v3/users/bc7f7cf6b61d4c9a9086382dc9cb8cca` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:25.923055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77aea5-1d33-4937-aba3-05caa8450cfa admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc7f7cf6b61d4c9a9086382dc9cb8cca)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:25.923055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e77aea5-1d33-4937-aba3-05caa8450cfa admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:26.149986 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2e77aea5-1d33-4937-aba3-05caa8450cfa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc7f7cf6b61d4c9a9086382dc9cb8cca'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:26.215745 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2e77aea5-1d33-4937-aba3-05caa8450cfa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc7f7cf6b61d4c9a9086382dc9cb8cca'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:26.233154 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2e77aea5-1d33-4937-aba3-05caa8450cfa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc7f7cf6b61d4c9a9086382dc9cb8cca'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:26.233865 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2e77aea5-1d33-4937-aba3-05caa8450cfa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc7f7cf6b61d4c9a9086382dc9cb8cca'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:26.241438 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-2e77aea5-1d33-4937-aba3-05caa8450cfa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc7f7cf6b61d4c9a9086382dc9cb8cca'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:26.242940 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:26.247892 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1426/2888] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:13:25 2022] DELETE /identity/v3/users/bc7f7cf6b61d4c9a9086382dc9cb8cca => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:26.729646 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e52017-f54b-47cf-adaf-7e82a1550cbb admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:26.731434 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-06e52017-f54b-47cf-adaf-7e82a1550cbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:26.750346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e52017-f54b-47cf-adaf-7e82a1550cbb admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:26.809871 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b143ea-3dd0-459d-83e5-1852709c5887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:26.810502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b143ea-3dd0-459d-83e5-1852709c5887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:26.810834 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b143ea-3dd0-459d-83e5-1852709c5887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:26.811106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b143ea-3dd0-459d-83e5-1852709c5887 admin admin] PATH_INFO: `/v3/projects/f296cbbc9bd543b188650bb7b969f034` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:26.812208 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b143ea-3dd0-459d-83e5-1852709c5887 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f296cbbc9bd543b188650bb7b969f034)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:26.814133 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b143ea-3dd0-459d-83e5-1852709c5887 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:26.910578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:26.911912 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-45b143ea-3dd0-459d-83e5-1852709c5887 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f296cbbc9bd543b188650bb7b969f034', 'request_id': 'req-45b143ea-3dd0-459d-83e5-1852709c5887'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:26.986948 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-45b143ea-3dd0-459d-83e5-1852709c5887 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f296cbbc9bd543b188650bb7b969f034', 'request_id': 'req-45b143ea-3dd0-459d-83e5-1852709c5887'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:26.994363 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-45b143ea-3dd0-459d-83e5-1852709c5887 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f296cbbc9bd543b188650bb7b969f034', 'request_id': 'req-45b143ea-3dd0-459d-83e5-1852709c5887'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:27.013084 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-45b143ea-3dd0-459d-83e5-1852709c5887 admin admin] The token cache is being invalidate because project f296cbbc9bd543b188650bb7b969f034 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:13:27.013389 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-45b143ea-3dd0-459d-83e5-1852709c5887 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:27.014252 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-45b143ea-3dd0-459d-83e5-1852709c5887 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:27.015791 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1463/2889] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:13:26 2022] DELETE /identity/v3/projects/f296cbbc9bd543b188650bb7b969f034 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:27.020113 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77aea5-1d33-4937-aba3-05caa8450cfa admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:27.021872 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-2e77aea5-1d33-4937-aba3-05caa8450cfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:27.034666 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e77aea5-1d33-4937-aba3-05caa8450cfa admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:27.084734 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b143ea-3dd0-459d-83e5-1852709c5887 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:27.089449 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-45b143ea-3dd0-459d-83e5-1852709c5887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:27.098508 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608eac72-f3b9-4e37-b70a-ba73962b6795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:27.099169 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608eac72-f3b9-4e37-b70a-ba73962b6795 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:27.099465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608eac72-f3b9-4e37-b70a-ba73962b6795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:27.100293 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608eac72-f3b9-4e37-b70a-ba73962b6795 admin admin] PATH_INFO: `/v3/users/d0e9ecd389064bbebfb91a011461c748` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:27.101419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608eac72-f3b9-4e37-b70a-ba73962b6795 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0e9ecd389064bbebfb91a011461c748)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:27.103370 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608eac72-f3b9-4e37-b70a-ba73962b6795 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:27.145474 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b143ea-3dd0-459d-83e5-1852709c5887 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:27.149542 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3d2ff-e284-40a5-b25f-c1d04a834d5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:27.150200 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3d2ff-e284-40a5-b25f-c1d04a834d5c service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:27.150475 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3d2ff-e284-40a5-b25f-c1d04a834d5c service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:27.150742 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e3d2ff-e284-40a5-b25f-c1d04a834d5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:27.152494 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-85e3d2ff-e284-40a5-b25f-c1d04a834d5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:27.218304 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3d2ff-e284-40a5-b25f-c1d04a834d5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:27.219776 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e3d2ff-e284-40a5-b25f-c1d04a834d5c service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:27.229257 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1464/2890] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:27 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:13:27.293502 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-608eac72-f3b9-4e37-b70a-ba73962b6795 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0e9ecd389064bbebfb91a011461c748'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:27.376148 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-608eac72-f3b9-4e37-b70a-ba73962b6795 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0e9ecd389064bbebfb91a011461c748'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:27.389925 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-608eac72-f3b9-4e37-b70a-ba73962b6795 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0e9ecd389064bbebfb91a011461c748'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:27.390703 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-608eac72-f3b9-4e37-b70a-ba73962b6795 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0e9ecd389064bbebfb91a011461c748'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:27.397718 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-608eac72-f3b9-4e37-b70a-ba73962b6795 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0e9ecd389064bbebfb91a011461c748'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:27.403896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1427/2891] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:13:27 2022] DELETE /identity/v3/users/d0e9ecd389064bbebfb91a011461c748 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:27.927111 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3d2ff-e284-40a5-b25f-c1d04a834d5c service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:27.929301 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-85e3d2ff-e284-40a5-b25f-c1d04a834d5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:27.958470 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e3d2ff-e284-40a5-b25f-c1d04a834d5c service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:28.029152 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca0f31-d274-4765-bd0d-e346382d423c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:28.029761 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca0f31-d274-4765-bd0d-e346382d423c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:28.030216 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca0f31-d274-4765-bd0d-e346382d423c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:28.030504 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ca0f31-d274-4765-bd0d-e346382d423c admin admin] PATH_INFO: `/v3/projects/128a52b022d04bbda19d10cdbc809378` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:28.031702 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca0f31-d274-4765-bd0d-e346382d423c admin admin] RBAC: Authorizing `identity:delete_project(project_id=128a52b022d04bbda19d10cdbc809378)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:28.033611 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ca0f31-d274-4765-bd0d-e346382d423c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:28.144435 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:28.163289 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-60ca0f31-d274-4765-bd0d-e346382d423c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '128a52b022d04bbda19d10cdbc809378', 'request_id': 'req-60ca0f31-d274-4765-bd0d-e346382d423c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:28.281417 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-60ca0f31-d274-4765-bd0d-e346382d423c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '128a52b022d04bbda19d10cdbc809378', 'request_id': 'req-60ca0f31-d274-4765-bd0d-e346382d423c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:28.288224 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-60ca0f31-d274-4765-bd0d-e346382d423c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '128a52b022d04bbda19d10cdbc809378', 'request_id': 'req-60ca0f31-d274-4765-bd0d-e346382d423c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:28.301531 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-60ca0f31-d274-4765-bd0d-e346382d423c admin admin] The token cache is being invalidate because project 128a52b022d04bbda19d10cdbc809378 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:13:28.301848 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-60ca0f31-d274-4765-bd0d-e346382d423c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:28.302600 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-60ca0f31-d274-4765-bd0d-e346382d423c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:28.304306 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1465/2892] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:13:27 2022] DELETE /identity/v3/projects/128a52b022d04bbda19d10cdbc809378 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:28.915828 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608eac72-f3b9-4e37-b70a-ba73962b6795 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:28.923662 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-608eac72-f3b9-4e37-b70a-ba73962b6795 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:28.974055 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608eac72-f3b9-4e37-b70a-ba73962b6795 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:29.003583 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:29.022385 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac7e09-d6a6-42bc-8f49-05b163bf0e47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:29.022995 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac7e09-d6a6-42bc-8f49-05b163bf0e47 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:29.023273 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac7e09-d6a6-42bc-8f49-05b163bf0e47 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:29.023547 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac7e09-d6a6-42bc-8f49-05b163bf0e47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:29.025263 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8fac7e09-d6a6-42bc-8f49-05b163bf0e47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:29.034837 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac7e09-d6a6-42bc-8f49-05b163bf0e47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:29.036248 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac7e09-d6a6-42bc-8f49-05b163bf0e47 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:29.044839 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1428/2893] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:28 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:13:29.967543 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca0f31-d274-4765-bd0d-e346382d423c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:29.969005 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-60ca0f31-d274-4765-bd0d-e346382d423c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:30.053752 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ca0f31-d274-4765-bd0d-e346382d423c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:30.059518 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7e664-ee18-4af7-a889-8b3fdb320abf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:30.060320 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7e664-ee18-4af7-a889-8b3fdb320abf service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:30.060602 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7e664-ee18-4af7-a889-8b3fdb320abf service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:30.064968 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7e664-ee18-4af7-a889-8b3fdb320abf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:30.064968 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-d3d7e664-ee18-4af7-a889-8b3fdb320abf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:30.075546 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7e664-ee18-4af7-a889-8b3fdb320abf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:30.077153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7e664-ee18-4af7-a889-8b3fdb320abf service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:30.088356 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1466/2894] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:29 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:13:33.177817 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac7e09-d6a6-42bc-8f49-05b163bf0e47 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:33.179884 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-8fac7e09-d6a6-42bc-8f49-05b163bf0e47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:33.255328 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac7e09-d6a6-42bc-8f49-05b163bf0e47 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:33.260192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78c8f5-e4f3-431a-92b6-5bf5a44f1607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:33.260910 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78c8f5-e4f3-431a-92b6-5bf5a44f1607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:33.261188 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78c8f5-e4f3-431a-92b6-5bf5a44f1607 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:33.261456 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e78c8f5-e4f3-431a-92b6-5bf5a44f1607 admin admin] PATH_INFO: `/v3/users/956ce73ee2fa4c6fb8713b98ae6f86a8` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:33.262723 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78c8f5-e4f3-431a-92b6-5bf5a44f1607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=956ce73ee2fa4c6fb8713b98ae6f86a8)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:33.264805 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e78c8f5-e4f3-431a-92b6-5bf5a44f1607 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:33.449491 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1e78c8f5-e4f3-431a-92b6-5bf5a44f1607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '956ce73ee2fa4c6fb8713b98ae6f86a8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:33.515451 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1e78c8f5-e4f3-431a-92b6-5bf5a44f1607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '956ce73ee2fa4c6fb8713b98ae6f86a8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:33.528652 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1e78c8f5-e4f3-431a-92b6-5bf5a44f1607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '956ce73ee2fa4c6fb8713b98ae6f86a8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:33.529339 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1e78c8f5-e4f3-431a-92b6-5bf5a44f1607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '956ce73ee2fa4c6fb8713b98ae6f86a8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:33.536250 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-1e78c8f5-e4f3-431a-92b6-5bf5a44f1607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '956ce73ee2fa4c6fb8713b98ae6f86a8'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:33.542405 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1429/2895] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:13:33 2022] DELETE /identity/v3/users/956ce73ee2fa4c6fb8713b98ae6f86a8 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:33.547068 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f6fc6-86a0-4f52-8d95-2200ede203ee None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:33.547556 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f6fc6-86a0-4f52-8d95-2200ede203ee None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:33.547660 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4f6fc6-86a0-4f52-8d95-2200ede203ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:33.567650 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-2a4f6fc6-86a0-4f52-8d95-2200ede203ee None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:33.569481 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2a4f6fc6-86a0-4f52-8d95-2200ede203ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:33.628283 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1467/2896] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:33.638721 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78c8f5-e4f3-431a-92b6-5bf5a44f1607 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:33.640137 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-1e78c8f5-e4f3-431a-92b6-5bf5a44f1607 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:33.697771 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e78c8f5-e4f3-431a-92b6-5bf5a44f1607 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:33.701395 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073eab29-ec43-4567-9a28-f835281121a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:33.702023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073eab29-ec43-4567-9a28-f835281121a2 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:33.702303 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073eab29-ec43-4567-9a28-f835281121a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:33.702577 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073eab29-ec43-4567-9a28-f835281121a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:33.711378 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073eab29-ec43-4567-9a28-f835281121a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:33.712794 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073eab29-ec43-4567-9a28-f835281121a2 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:33.716936 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:33.722906 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1430/2897] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:13:34.202928 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f6fc6-86a0-4f52-8d95-2200ede203ee None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:34.204386 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-2a4f6fc6-86a0-4f52-8d95-2200ede203ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:34.218101 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4f6fc6-86a0-4f52-8d95-2200ede203ee None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:34.222605 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab53a4-4745-49b5-8330-d837e3d79e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:34.228674 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab53a4-4745-49b5-8330-d837e3d79e5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:34.228674 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab53a4-4745-49b5-8330-d837e3d79e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:34.228674 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ab53a4-4745-49b5-8330-d837e3d79e5c admin admin] PATH_INFO: `/v3/projects/ef99a7b1b49a45e79e42d25c146c9772` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:34.228674 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab53a4-4745-49b5-8330-d837e3d79e5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef99a7b1b49a45e79e42d25c146c9772)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:34.228674 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ab53a4-4745-49b5-8330-d837e3d79e5c admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:34.336566 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:34.345151 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-39ab53a4-4745-49b5-8330-d837e3d79e5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef99a7b1b49a45e79e42d25c146c9772', 'request_id': 'req-39ab53a4-4745-49b5-8330-d837e3d79e5c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:34.413651 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-39ab53a4-4745-49b5-8330-d837e3d79e5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef99a7b1b49a45e79e42d25c146c9772', 'request_id': 'req-39ab53a4-4745-49b5-8330-d837e3d79e5c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:34.419727 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-39ab53a4-4745-49b5-8330-d837e3d79e5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef99a7b1b49a45e79e42d25c146c9772', 'request_id': 'req-39ab53a4-4745-49b5-8330-d837e3d79e5c'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:34.431217 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-39ab53a4-4745-49b5-8330-d837e3d79e5c admin admin] The token cache is being invalidate because project ef99a7b1b49a45e79e42d25c146c9772 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:13:34.431502 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-39ab53a4-4745-49b5-8330-d837e3d79e5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:34.432153 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-39ab53a4-4745-49b5-8330-d837e3d79e5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:34.433630 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1468/2898] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:13:34 2022] DELETE /identity/v3/projects/ef99a7b1b49a45e79e42d25c146c9772 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:34.437716 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073eab29-ec43-4567-9a28-f835281121a2 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:34.447623 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073eab29-ec43-4567-9a28-f835281121a2 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:34.507753 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ea7d5-0dd7-47cf-b618-d0274b5d6886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:34.508391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ea7d5-0dd7-47cf-b618-d0274b5d6886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:34.508736 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ea7d5-0dd7-47cf-b618-d0274b5d6886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:34.509065 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0ea7d5-0dd7-47cf-b618-d0274b5d6886 admin admin] PATH_INFO: `/v3/users/fc84dfb6b1fd4d80b96671eb4ab8213c` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:34.510260 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ea7d5-0dd7-47cf-b618-d0274b5d6886 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc84dfb6b1fd4d80b96671eb4ab8213c)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:34.513127 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0ea7d5-0dd7-47cf-b618-d0274b5d6886 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:34.701654 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5e0ea7d5-0dd7-47cf-b618-d0274b5d6886 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc84dfb6b1fd4d80b96671eb4ab8213c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:34.773634 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5e0ea7d5-0dd7-47cf-b618-d0274b5d6886 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc84dfb6b1fd4d80b96671eb4ab8213c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:34.786462 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5e0ea7d5-0dd7-47cf-b618-d0274b5d6886 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc84dfb6b1fd4d80b96671eb4ab8213c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:34.787100 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5e0ea7d5-0dd7-47cf-b618-d0274b5d6886 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc84dfb6b1fd4d80b96671eb4ab8213c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:34.794715 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-5e0ea7d5-0dd7-47cf-b618-d0274b5d6886 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc84dfb6b1fd4d80b96671eb4ab8213c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:34.800665 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1431/2899] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:13:34 2022] DELETE /identity/v3/users/fc84dfb6b1fd4d80b96671eb4ab8213c => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:35.148300 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab53a4-4745-49b5-8330-d837e3d79e5c admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:35.149958 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-39ab53a4-4745-49b5-8330-d837e3d79e5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:35.209119 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ea7d5-0dd7-47cf-b618-d0274b5d6886 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:35.210836 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-5e0ea7d5-0dd7-47cf-b618-d0274b5d6886 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:35.232960 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ab53a4-4745-49b5-8330-d837e3d79e5c admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:35.295937 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0ea7d5-0dd7-47cf-b618-d0274b5d6886 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:35.302136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e058618e-c3c6-4de2-9099-5f847e0ac5a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:35.302788 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058618e-c3c6-4de2-9099-5f847e0ac5a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:35.303066 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058618e-c3c6-4de2-9099-5f847e0ac5a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:35.303386 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e058618e-c3c6-4de2-9099-5f847e0ac5a2 admin admin] PATH_INFO: `/v3/projects/7d25e92fcaa848ce8d01f6771f2a0820` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:35.305106 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058618e-c3c6-4de2-9099-5f847e0ac5a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d25e92fcaa848ce8d01f6771f2a0820)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:35.306969 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e058618e-c3c6-4de2-9099-5f847e0ac5a2 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:35.307204 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b313f2a3-24ca-493e-8c56-0f745b8d07c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3919b24291f54df99a9da0f5d3164ccf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'service', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:35.307814 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313f2a3-24ca-493e-8c56-0f745b8d07c0 service nova] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:35.308087 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313f2a3-24ca-493e-8c56-0f745b8d07c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:35.308355 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b313f2a3-24ca-493e-8c56-0f745b8d07c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:35.310181 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b313f2a3-24ca-493e-8c56-0f745b8d07c0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:35.322737 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313f2a3-24ca-493e-8c56-0f745b8d07c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:35.324383 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b313f2a3-24ca-493e-8c56-0f745b8d07c0 service nova] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:35.331286 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:35.335637 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1469/2900] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:13:35.443343 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e058618e-c3c6-4de2-9099-5f847e0ac5a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d25e92fcaa848ce8d01f6771f2a0820', 'request_id': 'req-e058618e-c3c6-4de2-9099-5f847e0ac5a2'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:35.449358 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e058618e-c3c6-4de2-9099-5f847e0ac5a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d25e92fcaa848ce8d01f6771f2a0820', 'request_id': 'req-e058618e-c3c6-4de2-9099-5f847e0ac5a2'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:35.455684 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e058618e-c3c6-4de2-9099-5f847e0ac5a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d25e92fcaa848ce8d01f6771f2a0820', 'request_id': 'req-e058618e-c3c6-4de2-9099-5f847e0ac5a2'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:35.528888 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e058618e-c3c6-4de2-9099-5f847e0ac5a2 admin admin] The token cache is being invalidate because project 7d25e92fcaa848ce8d01f6771f2a0820 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81555) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:13:35.529948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e058618e-c3c6-4de2-9099-5f847e0ac5a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:35.529948 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-e058618e-c3c6-4de2-9099-5f847e0ac5a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:35.531420 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1432/2901] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:13:35 2022] DELETE /identity/v3/projects/7d25e92fcaa848ce8d01f6771f2a0820 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:35.537620 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b0a28-85bc-4fb4-a1a7-c040a52a54b2 None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:35.538023 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b0a28-85bc-4fb4-a1a7-c040a52a54b2 None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:35.538366 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b0a28-85bc-4fb4-a1a7-c040a52a54b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:35.558593 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-3b0b0a28-85bc-4fb4-a1a7-c040a52a54b2 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:35.559933 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3b0b0a28-85bc-4fb4-a1a7-c040a52a54b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:35.606447 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:35.624108 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1470/2902] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:35.632347 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2a686-4e41-4fe7-ad5a-159bfb875b49 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:35.633168 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2a686-4e41-4fe7-ad5a-159bfb875b49 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:35.633494 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd2a686-4e41-4fe7-ad5a-159bfb875b49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:35.655658 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-9dd2a686-4e41-4fe7-ad5a-159bfb875b49 None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:35.656865 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9dd2a686-4e41-4fe7-ad5a-159bfb875b49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:35.669740 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1433/2903] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:35.672530 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b0a28-85bc-4fb4-a1a7-c040a52a54b2 None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:35.684531 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b0a28-85bc-4fb4-a1a7-c040a52a54b2 None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:35.690756 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3b5d3-1028-46e3-b7a1-8120cb56d5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:35.691444 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3b5d3-1028-46e3-b7a1-8120cb56d5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:35.691827 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3b5d3-1028-46e3-b7a1-8120cb56d5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:35.692160 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe3b5d3-1028-46e3-b7a1-8120cb56d5f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:35.692938 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3b5d3-1028-46e3-b7a1-8120cb56d5f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81554) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:13:35.693683 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3b5d3-1028-46e3-b7a1-8120cb56d5f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:35.700258 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe3b5d3-1028-46e3-b7a1-8120cb56d5f7 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:35.708579 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1471/2904] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 13 20:13:35.712710 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2a686-4e41-4fe7-ad5a-159bfb875b49 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:35.722873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd2a686-4e41-4fe7-ad5a-159bfb875b49 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:35.728213 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a77aa-e3bf-47ca-bea4-ff63e41eaf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:35.728816 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a77aa-e3bf-47ca-bea4-ff63e41eaf52 admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:35.729088 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a77aa-e3bf-47ca-bea4-ff63e41eaf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:35.729357 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6a77aa-e3bf-47ca-bea4-ff63e41eaf52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:35.737485 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a77aa-e3bf-47ca-bea4-ff63e41eaf52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:35.737485 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6a77aa-e3bf-47ca-bea4-ff63e41eaf52 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:35.841675 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1434/2905] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:13:35 2022] POST /identity/v3/projects => generated 377 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 13 20:13:35.846024 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3b5d3-1028-46e3-b7a1-8120cb56d5f7 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:35.856679 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe3b5d3-1028-46e3-b7a1-8120cb56d5f7 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:35.915672 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3f458-5b6c-4d91-9291-ebe8a792b12d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:35.921352 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3f458-5b6c-4d91-9291-ebe8a792b12d admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:35.921352 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3f458-5b6c-4d91-9291-ebe8a792b12d admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:35.921352 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3f458-5b6c-4d91-9291-ebe8a792b12d admin admin] PATH_INFO: `/v3/users` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:35.921352 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3f458-5b6c-4d91-9291-ebe8a792b12d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:35.921352 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3f458-5b6c-4d91-9291-ebe8a792b12d admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:36.013276 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1472/2906] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:13:35 2022] POST /identity/v3/users => generated 289 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:13:36.017306 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a77aa-e3bf-47ca-bea4-ff63e41eaf52 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:36.028062 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6a77aa-e3bf-47ca-bea4-ff63e41eaf52 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:36.032702 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c6a7c-4c0d-44a9-bae7-cb0dbdd66ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:36.033291 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c6a7c-4c0d-44a9-bae7-cb0dbdd66ebf admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:36.033575 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c6a7c-4c0d-44a9-bae7-cb0dbdd66ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:36.033885 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386c6a7c-4c0d-44a9-bae7-cb0dbdd66ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:36.034518 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c6a7c-4c0d-44a9-bae7-cb0dbdd66ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:36.036180 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386c6a7c-4c0d-44a9-bae7-cb0dbdd66ebf admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:36.047053 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1435/2907] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:36.051908 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3f458-5b6c-4d91-9291-ebe8a792b12d admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:36.061350 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3f458-5b6c-4d91-9291-ebe8a792b12d admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:36.065926 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c294a8f6-711a-409a-a5b0-d7fd0c023a72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:36.066549 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294a8f6-711a-409a-a5b0-d7fd0c023a72 admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:36.066829 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294a8f6-711a-409a-a5b0-d7fd0c023a72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:36.067093 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c294a8f6-711a-409a-a5b0-d7fd0c023a72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:36.067723 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294a8f6-711a-409a-a5b0-d7fd0c023a72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:36.069298 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c294a8f6-711a-409a-a5b0-d7fd0c023a72 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:36.079609 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1473/2908] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:36.083529 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c6a7c-4c0d-44a9-bae7-cb0dbdd66ebf admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:36.093579 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386c6a7c-4c0d-44a9-bae7-cb0dbdd66ebf admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:36.098152 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da880d-f649-428b-a1b0-d17165c22f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:36.098823 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da880d-f649-428b-a1b0-d17165c22f39 admin admin] REQUEST_METHOD: `PUT` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:36.099077 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da880d-f649-428b-a1b0-d17165c22f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:36.099349 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da880d-f649-428b-a1b0-d17165c22f39 admin admin] PATH_INFO: `/v3/projects/13a63ea7575c452eab9ee68cc98c039a/users/bfe886854e5245769f634770aca2a96c/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:36.114119 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da880d-f649-428b-a1b0-d17165c22f39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13a63ea7575c452eab9ee68cc98c039a, user_id=bfe886854e5245769f634770aca2a96c, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:36.116788 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da880d-f649-428b-a1b0-d17165c22f39 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:36.224727 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1436/2909] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:36 2022] PUT /identity/v3/projects/13a63ea7575c452eab9ee68cc98c039a/users/bfe886854e5245769f634770aca2a96c/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:36.236312 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41588f-1347-40d0-97e0-38038b602eaf None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:36.236797 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41588f-1347-40d0-97e0-38038b602eaf None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:36.236918 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b41588f-1347-40d0-97e0-38038b602eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:36.266550 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-6b41588f-1347-40d0-97e0-38038b602eaf None None] MFA Rules not processed for user `bfe886854e5245769f634770aca2a96c`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:36.267745 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6b41588f-1347-40d0-97e0-38038b602eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:36.331625 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1474/2910] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:36.343316 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da880d-f649-428b-a1b0-d17165c22f39 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:36.344984 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-84da880d-f649-428b-a1b0-d17165c22f39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:36.400951 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da880d-f649-428b-a1b0-d17165c22f39 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:36.404596 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4814abf-4111-422d-b9b0-8d2f38897bd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:36.405190 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4814abf-4111-422d-b9b0-8d2f38897bd0 service cinder] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:36.405465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4814abf-4111-422d-b9b0-8d2f38897bd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:36.405760 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4814abf-4111-422d-b9b0-8d2f38897bd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:36.414342 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4814abf-4111-422d-b9b0-8d2f38897bd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:36.415746 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4814abf-4111-422d-b9b0-8d2f38897bd0 service cinder] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:36.424735 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1437/2911] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:13:40.338340 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41588f-1347-40d0-97e0-38038b602eaf None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:40.340022 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-6b41588f-1347-40d0-97e0-38038b602eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:40.351826 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b41588f-1347-40d0-97e0-38038b602eaf None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:40.355929 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e834856-07c9-405c-9bb9-f94d65f3a7c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:40.356523 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e834856-07c9-405c-9bb9-f94d65f3a7c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:40.356801 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e834856-07c9-405c-9bb9-f94d65f3a7c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:40.357072 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e834856-07c9-405c-9bb9-f94d65f3a7c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:40.358778 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-3e834856-07c9-405c-9bb9-f94d65f3a7c4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:40.401269 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:40.421511 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e834856-07c9-405c-9bb9-f94d65f3a7c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:40.422909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e834856-07c9-405c-9bb9-f94d65f3a7c4 service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:40.433349 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1475/2912] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:40 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:13:46.421030 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=69,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:50.456375 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=10 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:52.531173 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4814abf-4111-422d-b9b0-8d2f38897bd0 service cinder] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:52.593198 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4814abf-4111-422d-b9b0-8d2f38897bd0 service cinder] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:52.597633 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf1f43-9e9b-49fe-ad5e-f9c7a25d0194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:52.598271 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf1f43-9e9b-49fe-ad5e-f9c7a25d0194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:52.598544 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf1f43-9e9b-49fe-ad5e-f9c7a25d0194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:52.598811 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdf1f43-9e9b-49fe-ad5e-f9c7a25d0194 admin admin] PATH_INFO: `/v3/users/bfe886854e5245769f634770aca2a96c` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:52.599900 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf1f43-9e9b-49fe-ad5e-f9c7a25d0194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfe886854e5245769f634770aca2a96c)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:52.601820 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdf1f43-9e9b-49fe-ad5e-f9c7a25d0194 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:52.775454 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4fdf1f43-9e9b-49fe-ad5e-f9c7a25d0194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfe886854e5245769f634770aca2a96c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:52.840542 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4fdf1f43-9e9b-49fe-ad5e-f9c7a25d0194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfe886854e5245769f634770aca2a96c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:52.854808 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4fdf1f43-9e9b-49fe-ad5e-f9c7a25d0194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfe886854e5245769f634770aca2a96c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:52.855516 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4fdf1f43-9e9b-49fe-ad5e-f9c7a25d0194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfe886854e5245769f634770aca2a96c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:52.863157 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-4fdf1f43-9e9b-49fe-ad5e-f9c7a25d0194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfe886854e5245769f634770aca2a96c'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:52.869103 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1438/2913] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:13:52 2022] DELETE /identity/v3/users/bfe886854e5245769f634770aca2a96c => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:52.873909 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c8d37-50a8-43c8-91dd-f22f0321372b None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:52.874857 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c8d37-50a8-43c8-91dd-f22f0321372b None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:52.874857 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7c8d37-50a8-43c8-91dd-f22f0321372b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:52.893766 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-4d7c8d37-50a8-43c8-91dd-f22f0321372b None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:52.894983 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4d7c8d37-50a8-43c8-91dd-f22f0321372b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:52.953949 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1476/2914] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:52.963617 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf1f43-9e9b-49fe-ad5e-f9c7a25d0194 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:52.965273 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-4fdf1f43-9e9b-49fe-ad5e-f9c7a25d0194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:53.022007 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdf1f43-9e9b-49fe-ad5e-f9c7a25d0194 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:53.025658 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf952d-7d3a-4045-b55e-9a25b9a13844 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:53.026288 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf952d-7d3a-4045-b55e-9a25b9a13844 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:53.026568 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf952d-7d3a-4045-b55e-9a25b9a13844 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:53.026841 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf952d-7d3a-4045-b55e-9a25b9a13844 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:53.037363 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf952d-7d3a-4045-b55e-9a25b9a13844 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:53.038813 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bf952d-7d3a-4045-b55e-9a25b9a13844 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:53.049629 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1439/2915] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:13:53.478824 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c8d37-50a8-43c8-91dd-f22f0321372b None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:53.480270 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-4d7c8d37-50a8-43c8-91dd-f22f0321372b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:53.492212 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7c8d37-50a8-43c8-91dd-f22f0321372b None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:53.498793 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9365a074-c2f1-4f99-86e5-9bba80373218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:53.498921 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365a074-c2f1-4f99-86e5-9bba80373218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:53.499186 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365a074-c2f1-4f99-86e5-9bba80373218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:53.499483 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9365a074-c2f1-4f99-86e5-9bba80373218 admin admin] PATH_INFO: `/v3/projects/13a63ea7575c452eab9ee68cc98c039a` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:53.500702 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365a074-c2f1-4f99-86e5-9bba80373218 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13a63ea7575c452eab9ee68cc98c039a)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:53.503936 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9365a074-c2f1-4f99-86e5-9bba80373218 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:53.644448 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9365a074-c2f1-4f99-86e5-9bba80373218 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13a63ea7575c452eab9ee68cc98c039a', 'request_id': 'req-9365a074-c2f1-4f99-86e5-9bba80373218'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:53.768166 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9365a074-c2f1-4f99-86e5-9bba80373218 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13a63ea7575c452eab9ee68cc98c039a', 'request_id': 'req-9365a074-c2f1-4f99-86e5-9bba80373218'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:53.774236 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9365a074-c2f1-4f99-86e5-9bba80373218 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13a63ea7575c452eab9ee68cc98c039a', 'request_id': 'req-9365a074-c2f1-4f99-86e5-9bba80373218'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:53.785429 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9365a074-c2f1-4f99-86e5-9bba80373218 admin admin] The token cache is being invalidate because project 13a63ea7575c452eab9ee68cc98c039a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:13:53.785740 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9365a074-c2f1-4f99-86e5-9bba80373218 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:53.786377 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-9365a074-c2f1-4f99-86e5-9bba80373218 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:13:53.787853 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1477/2916] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:13:53 2022] DELETE /identity/v3/projects/13a63ea7575c452eab9ee68cc98c039a => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:13:53.792909 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78cc23-8ebd-4139-8fe5-3fdc50202f2c None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:53.793446 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78cc23-8ebd-4139-8fe5-3fdc50202f2c None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:53.793446 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d78cc23-8ebd-4139-8fe5-3fdc50202f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:53.815683 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-6d78cc23-8ebd-4139-8fe5-3fdc50202f2c None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:53.816873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6d78cc23-8ebd-4139-8fe5-3fdc50202f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:53.834658 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:53.876391 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1440/2917] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 13 20:13:53.884334 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf0fec-f505-4517-b62e-4ff8f02b484c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:53.884830 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf0fec-f505-4517-b62e-4ff8f02b484c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:53.884933 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debf0fec-f505-4517-b62e-4ff8f02b484c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:53.907028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-debf0fec-f505-4517-b62e-4ff8f02b484c None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:53.908220 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-debf0fec-f505-4517-b62e-4ff8f02b484c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:53.916320 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1478/2918] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:53.921231 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78cc23-8ebd-4139-8fe5-3fdc50202f2c None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:53.930808 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d78cc23-8ebd-4139-8fe5-3fdc50202f2c None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:53.937165 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed00a73-42c8-43ed-9e94-6eb02de13624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:53.937815 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed00a73-42c8-43ed-9e94-6eb02de13624 admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:53.938092 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed00a73-42c8-43ed-9e94-6eb02de13624 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:53.938364 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed00a73-42c8-43ed-9e94-6eb02de13624 admin admin] PATH_INFO: `/v3/domains` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:53.939007 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed00a73-42c8-43ed-9e94-6eb02de13624 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81555) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 13 20:13:53.939299 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed00a73-42c8-43ed-9e94-6eb02de13624 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:53.940891 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed00a73-42c8-43ed-9e94-6eb02de13624 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:53.952348 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1441/2919] 10.222.0.59 () {58 vars in 1153 bytes} [Tue Sep 13 20:13:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 13 20:13:53.956627 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf0fec-f505-4517-b62e-4ff8f02b484c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:53.965850 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debf0fec-f505-4517-b62e-4ff8f02b484c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:53.970440 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fe8bf-b793-47bc-b4a1-e9ee88f2ae34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:53.973952 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fe8bf-b793-47bc-b4a1-e9ee88f2ae34 admin admin] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:53.973952 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fe8bf-b793-47bc-b4a1-e9ee88f2ae34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:53.973952 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642fe8bf-b793-47bc-b4a1-e9ee88f2ae34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:53.973952 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fe8bf-b793-47bc-b4a1-e9ee88f2ae34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:53.974321 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642fe8bf-b793-47bc-b4a1-e9ee88f2ae34 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:54.067598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1479/2920] 10.222.0.59 () {60 vars in 1153 bytes} [Tue Sep 13 20:13:53 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:13:54.072023 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed00a73-42c8-43ed-9e94-6eb02de13624 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:54.082470 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed00a73-42c8-43ed-9e94-6eb02de13624 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:54.141130 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a7b76-41e3-4b0a-9158-1fa58801d6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:54.141768 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a7b76-41e3-4b0a-9158-1fa58801d6cf admin admin] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:54.142051 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a7b76-41e3-4b0a-9158-1fa58801d6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:54.142354 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414a7b76-41e3-4b0a-9158-1fa58801d6cf admin admin] PATH_INFO: `/v3/users` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:54.142992 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a7b76-41e3-4b0a-9158-1fa58801d6cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:54.145337 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414a7b76-41e3-4b0a-9158-1fa58801d6cf admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:54.237954 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1442/2921] 10.222.0.59 () {60 vars in 1144 bytes} [Tue Sep 13 20:13:54 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 13 20:13:54.242269 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fe8bf-b793-47bc-b4a1-e9ee88f2ae34 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:54.253369 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642fe8bf-b793-47bc-b4a1-e9ee88f2ae34 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:54.257956 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950f563-90af-4cc2-acc6-51181603e03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:54.258578 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950f563-90af-4cc2-acc6-51181603e03f admin admin] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:54.258863 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950f563-90af-4cc2-acc6-51181603e03f admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:54.259136 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9950f563-90af-4cc2-acc6-51181603e03f admin admin] PATH_INFO: `/v3/roles` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:54.259770 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950f563-90af-4cc2-acc6-51181603e03f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:54.261361 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9950f563-90af-4cc2-acc6-51181603e03f admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:54.271768 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1480/2922] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:54.275738 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a7b76-41e3-4b0a-9158-1fa58801d6cf admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:54.286464 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414a7b76-41e3-4b0a-9158-1fa58801d6cf admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:54.291353 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8553a42-0237-43b2-b7eb-f882cf2137bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:54.291952 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8553a42-0237-43b2-b7eb-f882cf2137bc admin admin] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:54.292235 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8553a42-0237-43b2-b7eb-f882cf2137bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:54.292512 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8553a42-0237-43b2-b7eb-f882cf2137bc admin admin] PATH_INFO: `/v3/roles` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:54.293152 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8553a42-0237-43b2-b7eb-f882cf2137bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:54.294824 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8553a42-0237-43b2-b7eb-f882cf2137bc admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:54.306049 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1443/2923] 10.222.0.59 () {58 vars in 1122 bytes} [Tue Sep 13 20:13:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 13 20:13:54.310107 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950f563-90af-4cc2-acc6-51181603e03f admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:54.320020 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9950f563-90af-4cc2-acc6-51181603e03f admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:54.324863 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76bf9f1-6b56-4293-b1a7-e4481dc32db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:54.327327 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bf9f1-6b56-4293-b1a7-e4481dc32db0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:54.327327 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bf9f1-6b56-4293-b1a7-e4481dc32db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:54.327327 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76bf9f1-6b56-4293-b1a7-e4481dc32db0 admin admin] PATH_INFO: `/v3/projects/58e88979f0ab45568754d85076562340/users/196b0fa9cd1e4fd49558a43f92258a94/roles/033268df62114ee6bf4c0512568f2609` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:54.341188 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76bf9f1-6b56-4293-b1a7-e4481dc32db0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58e88979f0ab45568754d85076562340, user_id=196b0fa9cd1e4fd49558a43f92258a94, role_id=033268df62114ee6bf4c0512568f2609)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:54.344376 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76bf9f1-6b56-4293-b1a7-e4481dc32db0 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:54.437319 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1481/2924] 10.222.0.59 () {60 vars in 1483 bytes} [Tue Sep 13 20:13:54 2022] PUT /identity/v3/projects/58e88979f0ab45568754d85076562340/users/196b0fa9cd1e4fd49558a43f92258a94/roles/033268df62114ee6bf4c0512568f2609 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 13 20:13:54.447840 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f208f1-aba4-4e59-9f78-51f0a025bae0 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:54.448130 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f208f1-aba4-4e59-9f78-51f0a025bae0 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:54.448432 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f208f1-aba4-4e59-9f78-51f0a025bae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:54.476712 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-68f208f1-aba4-4e59-9f78-51f0a025bae0 None None] MFA Rules not processed for user `196b0fa9cd1e4fd49558a43f92258a94`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:54.477995 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-68f208f1-aba4-4e59-9f78-51f0a025bae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:54.543215 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1444/2925] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:13:54.554371 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76bf9f1-6b56-4293-b1a7-e4481dc32db0 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:13:54.556033 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a76bf9f1-6b56-4293-b1a7-e4481dc32db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:54.578406 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:13:54.615353 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76bf9f1-6b56-4293-b1a7-e4481dc32db0 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:13:54.619268 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00dc708-c6bb-45cb-9774-ab20344b36fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbdff73734304485ac9884d6b44ea73c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:13:54.619887 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00dc708-c6bb-45cb-9774-ab20344b36fa service cinder] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:54.620165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00dc708-c6bb-45cb-9774-ab20344b36fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:54.620436 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00dc708-c6bb-45cb-9774-ab20344b36fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:54.628868 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00dc708-c6bb-45cb-9774-ab20344b36fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:13:54.637029 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00dc708-c6bb-45cb-9774-ab20344b36fa service cinder] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:13:54.639849 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1482/2926] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:13:54 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:13:56.481083 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe0859-9bed-448b-9369-d89001e89caa None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:13:56.481634 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe0859-9bed-448b-9369-d89001e89caa None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:13:56.481784 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebe0859-9bed-448b-9369-d89001e89caa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:13:56.501329 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-9ebe0859-9bed-448b-9369-d89001e89caa None None] MFA Rules not processed for user `196b0fa9cd1e4fd49558a43f92258a94`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:13:56.502545 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9ebe0859-9bed-448b-9369-d89001e89caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:13:56.509369 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1445/2927] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:13:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:14:02.801172 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00dc708-c6bb-45cb-9774-ab20344b36fa service cinder] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:14:02.802598 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-a00dc708-c6bb-45cb-9774-ab20344b36fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:14:02.873165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00dc708-c6bb-45cb-9774-ab20344b36fa service cinder] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:14:02.878159 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b51bc-13c2-44aa-b471-d33ad5b900df service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e7df5170c841abb449f3b4a547ec4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:14:02.878767 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b51bc-13c2-44aa-b471-d33ad5b900df service placement] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:14:02.879045 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b51bc-13c2-44aa-b471-d33ad5b900df service placement] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:14:02.879311 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661b51bc-13c2-44aa-b471-d33ad5b900df service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:14:02.881017 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-661b51bc-13c2-44aa-b471-d33ad5b900df service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:14:02.893564 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b51bc-13c2-44aa-b471-d33ad5b900df service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:14:02.898227 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661b51bc-13c2-44aa-b471-d33ad5b900df service placement] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:14:02.905289 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1483/2928] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:14:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:14:03.599832 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe0859-9bed-448b-9369-d89001e89caa None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:14:03.601803 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9ebe0859-9bed-448b-9369-d89001e89caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:14:03.616328 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:14:03.668297 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebe0859-9bed-448b-9369-d89001e89caa None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:14:03.672873 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3665ecb-6846-4f78-9588-275a72d67d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:14:03.673500 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3665ecb-6846-4f78-9588-275a72d67d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:14:03.673812 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3665ecb-6846-4f78-9588-275a72d67d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:14:03.674089 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3665ecb-6846-4f78-9588-275a72d67d63 admin admin] PATH_INFO: `/v3/users/74c665847739461f895ed2bba3107329` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:14:03.675192 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3665ecb-6846-4f78-9588-275a72d67d63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74c665847739461f895ed2bba3107329)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:14:03.677103 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3665ecb-6846-4f78-9588-275a72d67d63 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:14:03.862931 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b3665ecb-6846-4f78-9588-275a72d67d63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74c665847739461f895ed2bba3107329'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:03.935132 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b3665ecb-6846-4f78-9588-275a72d67d63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74c665847739461f895ed2bba3107329'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:03.948359 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b3665ecb-6846-4f78-9588-275a72d67d63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74c665847739461f895ed2bba3107329'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:03.949018 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b3665ecb-6846-4f78-9588-275a72d67d63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74c665847739461f895ed2bba3107329'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:03.956510 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-b3665ecb-6846-4f78-9588-275a72d67d63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74c665847739461f895ed2bba3107329'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:03.962764 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1446/2929] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:14:03 2022] DELETE /identity/v3/users/74c665847739461f895ed2bba3107329 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:14:04.226903 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b51bc-13c2-44aa-b471-d33ad5b900df service placement] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:14:04.238749 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661b51bc-13c2-44aa-b471-d33ad5b900df service placement] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:14:04.326017 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfcccd-5fd3-4e7d-addc-4b0bdfae58f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:14:04.326654 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfcccd-5fd3-4e7d-addc-4b0bdfae58f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:14:04.326936 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfcccd-5fd3-4e7d-addc-4b0bdfae58f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:14:04.327209 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dfcccd-5fd3-4e7d-addc-4b0bdfae58f4 admin admin] PATH_INFO: `/v3/projects/e5a5a3c3cd1b44868264f815d01ebfbf` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:14:04.328363 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dfcccd-5fd3-4e7d-addc-4b0bdfae58f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5a5a3c3cd1b44868264f815d01ebfbf)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:14:04.330834 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dfcccd-5fd3-4e7d-addc-4b0bdfae58f4 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:14:04.429291 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e6dfcccd-5fd3-4e7d-addc-4b0bdfae58f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5a5a3c3cd1b44868264f815d01ebfbf', 'request_id': 'req-e6dfcccd-5fd3-4e7d-addc-4b0bdfae58f4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:04.432808 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:14:04.505347 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e6dfcccd-5fd3-4e7d-addc-4b0bdfae58f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5a5a3c3cd1b44868264f815d01ebfbf', 'request_id': 'req-e6dfcccd-5fd3-4e7d-addc-4b0bdfae58f4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:04.511551 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e6dfcccd-5fd3-4e7d-addc-4b0bdfae58f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5a5a3c3cd1b44868264f815d01ebfbf', 'request_id': 'req-e6dfcccd-5fd3-4e7d-addc-4b0bdfae58f4'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:04.536798 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e6dfcccd-5fd3-4e7d-addc-4b0bdfae58f4 admin admin] The token cache is being invalidate because project e5a5a3c3cd1b44868264f815d01ebfbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:14:04.536798 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e6dfcccd-5fd3-4e7d-addc-4b0bdfae58f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:04.536798 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-e6dfcccd-5fd3-4e7d-addc-4b0bdfae58f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:04.536798 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1484/2930] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:14:04 2022] DELETE /identity/v3/projects/e5a5a3c3cd1b44868264f815d01ebfbf => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:14:04.541770 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3665ecb-6846-4f78-9588-275a72d67d63 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:14:04.543142 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-b3665ecb-6846-4f78-9588-275a72d67d63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:14:04.558935 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3665ecb-6846-4f78-9588-275a72d67d63 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:14:04.622759 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0afb2-5476-4bbd-8bee-4265ffbfa162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:14:04.623449 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0afb2-5476-4bbd-8bee-4265ffbfa162 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:14:04.623711 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0afb2-5476-4bbd-8bee-4265ffbfa162 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:14:04.623997 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0afb2-5476-4bbd-8bee-4265ffbfa162 admin admin] PATH_INFO: `/v3/users/0f76b6371bcc4aa1b1a2cb181ea9a8d3` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:14:04.628610 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0afb2-5476-4bbd-8bee-4265ffbfa162 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f76b6371bcc4aa1b1a2cb181ea9a8d3)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:14:04.628610 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0afb2-5476-4bbd-8bee-4265ffbfa162 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:14:04.788601 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:14:04.801680 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d1e0afb2-5476-4bbd-8bee-4265ffbfa162 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f76b6371bcc4aa1b1a2cb181ea9a8d3'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:04.917672 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d1e0afb2-5476-4bbd-8bee-4265ffbfa162 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f76b6371bcc4aa1b1a2cb181ea9a8d3'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:04.931119 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d1e0afb2-5476-4bbd-8bee-4265ffbfa162 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f76b6371bcc4aa1b1a2cb181ea9a8d3'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:04.931782 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d1e0afb2-5476-4bbd-8bee-4265ffbfa162 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f76b6371bcc4aa1b1a2cb181ea9a8d3'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:04.938802 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-d1e0afb2-5476-4bbd-8bee-4265ffbfa162 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f76b6371bcc4aa1b1a2cb181ea9a8d3'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:04.944689 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1447/2931] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:14:04 2022] DELETE /identity/v3/users/0f76b6371bcc4aa1b1a2cb181ea9a8d3 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:14:05.206818 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfcccd-5fd3-4e7d-addc-4b0bdfae58f4 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:14:05.208239 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-e6dfcccd-5fd3-4e7d-addc-4b0bdfae58f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:14:05.223929 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dfcccd-5fd3-4e7d-addc-4b0bdfae58f4 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:14:05.288276 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3252c3e-01db-49a9-8a7d-b65edec747d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:14:05.289349 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3252c3e-01db-49a9-8a7d-b65edec747d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:14:05.289661 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3252c3e-01db-49a9-8a7d-b65edec747d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:14:05.289984 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3252c3e-01db-49a9-8a7d-b65edec747d5 admin admin] PATH_INFO: `/v3/projects/602ecca70775412ea11f5775fe85212b` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:14:05.291260 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3252c3e-01db-49a9-8a7d-b65edec747d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=602ecca70775412ea11f5775fe85212b)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:14:05.293727 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3252c3e-01db-49a9-8a7d-b65edec747d5 admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:14:05.427442 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b3252c3e-01db-49a9-8a7d-b65edec747d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '602ecca70775412ea11f5775fe85212b', 'request_id': 'req-b3252c3e-01db-49a9-8a7d-b65edec747d5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:05.509303 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b3252c3e-01db-49a9-8a7d-b65edec747d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '602ecca70775412ea11f5775fe85212b', 'request_id': 'req-b3252c3e-01db-49a9-8a7d-b65edec747d5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:05.515581 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b3252c3e-01db-49a9-8a7d-b65edec747d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '602ecca70775412ea11f5775fe85212b', 'request_id': 'req-b3252c3e-01db-49a9-8a7d-b65edec747d5'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:05.528545 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b3252c3e-01db-49a9-8a7d-b65edec747d5 admin admin] The token cache is being invalidate because project 602ecca70775412ea11f5775fe85212b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:14:05.528840 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b3252c3e-01db-49a9-8a7d-b65edec747d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:05.529566 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-b3252c3e-01db-49a9-8a7d-b65edec747d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:05.537531 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1485/2932] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:14:05 2022] DELETE /identity/v3/projects/602ecca70775412ea11f5775fe85212b => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:14:15.098768 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=17,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:14:15.525377 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=57,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:14:18.217868 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ca7c8-bfa0-487e-9bcf-779f24d31cd3 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:14:18.218506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ca7c8-bfa0-487e-9bcf-779f24d31cd3 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:14:18.218506 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ca7c8-bfa0-487e-9bcf-779f24d31cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:14:18.267418 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-9f6ca7c8-bfa0-487e-9bcf-779f24d31cd3 None None] MFA Rules not processed for user `9fd7a80714874e73bf64dfa392632391`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:14:18.268779 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9f6ca7c8-bfa0-487e-9bcf-779f24d31cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:14:18.331624 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1448/2933] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Sep 13 20:14:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:14:18.457016 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3252c3e-01db-49a9-8a7d-b65edec747d5 admin admin] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:14:18.458492 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b3252c3e-01db-49a9-8a7d-b65edec747d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:14:18.546818 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3252c3e-01db-49a9-8a7d-b65edec747d5 admin admin] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:14:18.552342 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4196b-3169-4e66-b01e-bdadf52ea7c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00e78bf5e5c4db29c47dce1e87f3f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:14:18.552942 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4196b-3169-4e66-b01e-bdadf52ea7c8 service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:14:18.553221 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4196b-3169-4e66-b01e-bdadf52ea7c8 service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:14:18.553494 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca4196b-3169-4e66-b01e-bdadf52ea7c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:14:18.561414 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4196b-3169-4e66-b01e-bdadf52ea7c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:14:18.563019 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca4196b-3169-4e66-b01e-bdadf52ea7c8 service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:14:18.571419 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1486/2934] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Sep 13 20:14:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:14:19.314813 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dc881-ca03-4314-9b31-543eec5b4bbe None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:14:19.315292 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dc881-ca03-4314-9b31-543eec5b4bbe None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:14:19.315421 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dc881-ca03-4314-9b31-543eec5b4bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:14:19.334772 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-989dc881-ca03-4314-9b31-543eec5b4bbe None None] MFA Rules not processed for user `9fd7a80714874e73bf64dfa392632391`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:14:19.335966 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-989dc881-ca03-4314-9b31-543eec5b4bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:14:19.343279 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1449/2935] 10.222.0.59 () {58 vars in 967 bytes} [Tue Sep 13 20:14:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:14:19.355812 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4196b-3169-4e66-b01e-bdadf52ea7c8 service swift] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:14:19.366266 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca4196b-3169-4e66-b01e-bdadf52ea7c8 service swift] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:14:19.371381 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae464d-bd10-43c2-b773-c1eeba44e529 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00e78bf5e5c4db29c47dce1e87f3f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:14:19.371985 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae464d-bd10-43c2-b773-c1eeba44e529 service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:14:19.372259 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae464d-bd10-43c2-b773-c1eeba44e529 service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:14:19.372525 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ae464d-bd10-43c2-b773-c1eeba44e529 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:14:19.380411 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae464d-bd10-43c2-b773-c1eeba44e529 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:14:19.381993 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ae464d-bd10-43c2-b773-c1eeba44e529 service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:14:19.389638 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1487/2936] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Sep 13 20:14:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:14:19.990798 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc43e4-c7ee-4c74-a477-cb873358429c None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:14:19.991029 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc43e4-c7ee-4c74-a477-cb873358429c None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:14:19.991335 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bc43e4-c7ee-4c74-a477-cb873358429c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:14:20.010496 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-62bc43e4-c7ee-4c74-a477-cb873358429c None None] MFA Rules not processed for user `9fd7a80714874e73bf64dfa392632391`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:14:20.011678 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-62bc43e4-c7ee-4c74-a477-cb873358429c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:14:20.019288 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1450/2937] 10.222.0.59 () {58 vars in 1009 bytes} [Tue Sep 13 20:14:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:14:20.031055 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae464d-bd10-43c2-b773-c1eeba44e529 service swift] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:14:20.045234 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ae464d-bd10-43c2-b773-c1eeba44e529 service swift] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:14:20.050789 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ebf5f-f7d3-42e7-bce1-2da2a44ee9e2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00e78bf5e5c4db29c47dce1e87f3f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:14:20.051476 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ebf5f-f7d3-42e7-bce1-2da2a44ee9e2 service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:14:20.051758 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ebf5f-f7d3-42e7-bce1-2da2a44ee9e2 service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:14:20.052028 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932ebf5f-f7d3-42e7-bce1-2da2a44ee9e2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:14:20.059861 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ebf5f-f7d3-42e7-bce1-2da2a44ee9e2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:14:20.061429 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932ebf5f-f7d3-42e7-bce1-2da2a44ee9e2 service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:14:20.069913 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1488/2938] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Sep 13 20:14:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:14:20.623389 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b427c17-d2f0-43ba-b71d-3ee111484029 None None] REQUEST_METHOD: `POST` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:14:20.623884 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b427c17-d2f0-43ba-b71d-3ee111484029 None None] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:14:20.623997 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b427c17-d2f0-43ba-b71d-3ee111484029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:14:20.642536 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.auth.core [None req-9b427c17-d2f0-43ba-b71d-3ee111484029 None None] MFA Rules not processed for user `9fd7a80714874e73bf64dfa392632391`. Rule list: `[]` (Enabled: `True`). {{(pid=81555) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:14:20.643702 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9b427c17-d2f0-43ba-b71d-3ee111484029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:14:20.650907 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1451/2939] 10.222.0.59 () {58 vars in 967 bytes} [Tue Sep 13 20:14:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:14:20.663592 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ebf5f-f7d3-42e7-bce1-2da2a44ee9e2 service swift] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:14:20.674034 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932ebf5f-f7d3-42e7-bce1-2da2a44ee9e2 service swift] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:14:20.679557 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74f1b1-97f9-40a7-a31e-0a6dc9185262 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c00e78bf5e5c4db29c47dce1e87f3f5a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:14:20.680147 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74f1b1-97f9-40a7-a31e-0a6dc9185262 service swift] REQUEST_METHOD: `GET` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:14:20.680425 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74f1b1-97f9-40a7-a31e-0a6dc9185262 service swift] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:14:20.680697 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74f1b1-97f9-40a7-a31e-0a6dc9185262 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:14:20.688466 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74f1b1-97f9-40a7-a31e-0a6dc9185262 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:14:20.690061 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74f1b1-97f9-40a7-a31e-0a6dc9185262 service swift] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:14:20.697862 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1489/2940] 10.222.0.59 () {60 vars in 1384 bytes} [Tue Sep 13 20:14:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 13 20:14:23.421372 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b427c17-d2f0-43ba-b71d-3ee111484029 None None] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:14:23.422788 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-9b427c17-d2f0-43ba-b71d-3ee111484029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:14:23.489505 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b427c17-d2f0-43ba-b71d-3ee111484029 None None] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:14:23.494223 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986076b-db21-4c87-aaba-ac9202305f79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:14:23.494855 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986076b-db21-4c87-aaba-ac9202305f79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:14:23.495136 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986076b-db21-4c87-aaba-ac9202305f79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:14:23.495407 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6986076b-db21-4c87-aaba-ac9202305f79 admin admin] PATH_INFO: `/v3/users/196b0fa9cd1e4fd49558a43f92258a94` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:14:23.496522 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986076b-db21-4c87-aaba-ac9202305f79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=196b0fa9cd1e4fd49558a43f92258a94)` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:14:23.498472 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6986076b-db21-4c87-aaba-ac9202305f79 admin admin] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:14:23.626547 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6986076b-db21-4c87-aaba-ac9202305f79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '196b0fa9cd1e4fd49558a43f92258a94'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:23.689720 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6986076b-db21-4c87-aaba-ac9202305f79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '196b0fa9cd1e4fd49558a43f92258a94'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:23.690896 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:14:23.702162 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6986076b-db21-4c87-aaba-ac9202305f79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '196b0fa9cd1e4fd49558a43f92258a94'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:23.702805 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6986076b-db21-4c87-aaba-ac9202305f79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '196b0fa9cd1e4fd49558a43f92258a94'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:23.709549 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.notifications [None req-6986076b-db21-4c87-aaba-ac9202305f79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '196b0fa9cd1e4fd49558a43f92258a94'} {{(pid=81555) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:23.715376 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1452/2941] 10.222.0.59 () {58 vars in 1224 bytes} [Tue Sep 13 20:14:23 2022] DELETE /identity/v3/users/196b0fa9cd1e4fd49558a43f92258a94 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:14:23.720234 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6393153-963a-4ef1-9692-80365916a43c None None] REQUEST_METHOD: `POST` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:14:23.720706 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6393153-963a-4ef1-9692-80365916a43c None None] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:14:23.720808 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6393153-963a-4ef1-9692-80365916a43c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:14:23.740165 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.auth.core [None req-b6393153-963a-4ef1-9692-80365916a43c None None] MFA Rules not processed for user `7e2932bd7e7b4ca08c435ee8928789ee`. Rule list: `[]` (Enabled: `True`). {{(pid=81554) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 13 20:14:23.741346 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b6393153-963a-4ef1-9692-80365916a43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:14:23.799051 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1490/2942] 10.222.0.59 () {58 vars in 958 bytes} [Tue Sep 13 20:14:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 13 20:14:23.809361 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986076b-db21-4c87-aaba-ac9202305f79 admin admin] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:14:23.810699 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-6986076b-db21-4c87-aaba-ac9202305f79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:14:23.867419 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6986076b-db21-4c87-aaba-ac9202305f79 admin admin] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:14:23.871036 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8413a5-7dff-4da8-b0c5-d9eb873f29c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b86b85c457d84ac99359ac93add704d2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:14:23.871631 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8413a5-7dff-4da8-b0c5-d9eb873f29c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:14:23.871911 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8413a5-7dff-4da8-b0c5-d9eb873f29c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:14:23.872183 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8413a5-7dff-4da8-b0c5-d9eb873f29c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:14:23.881315 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8413a5-7dff-4da8-b0c5-d9eb873f29c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:14:23.882775 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8413a5-7dff-4da8-b0c5-d9eb873f29c0 service neutron] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:14:23.892459 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1453/2943] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:14:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 13 20:14:24.112476 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6393153-963a-4ef1-9692-80365916a43c None None] Authenticating user token {{(pid=81554) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:14:24.114527 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.fernet_utils [None req-b6393153-963a-4ef1-9692-80365916a43c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81554) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:14:24.127249 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6393153-963a-4ef1-9692-80365916a43c None None] Validating token access rules against request {{(pid=81554) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:14:24.132514 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd16351-f675-4d92-a241-b46b41082fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7e2932bd7e7b4ca08c435ee8928789ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a7c8626d92bb447c910575be75fc0558', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81554) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:14:24.133813 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd16351-f675-4d92-a241-b46b41082fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:14:24.134106 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd16351-f675-4d92-a241-b46b41082fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:14:24.134379 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd16351-f675-4d92-a241-b46b41082fed admin admin] PATH_INFO: `/v3/projects/58e88979f0ab45568754d85076562340` {{(pid=81554) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:14:24.135735 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd16351-f675-4d92-a241-b46b41082fed admin admin] RBAC: Authorizing `identity:delete_project(project_id=58e88979f0ab45568754d85076562340)` {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:14:24.137737 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd16351-f675-4d92-a241-b46b41082fed admin admin] RBAC: Authorization granted {{(pid=81554) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:14:24.223460 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:14:24.240357 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1cd16351-f675-4d92-a241-b46b41082fed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58e88979f0ab45568754d85076562340', 'request_id': 'req-1cd16351-f675-4d92-a241-b46b41082fed'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:24.318365 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1cd16351-f675-4d92-a241-b46b41082fed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58e88979f0ab45568754d85076562340', 'request_id': 'req-1cd16351-f675-4d92-a241-b46b41082fed'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:24.323989 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1cd16351-f675-4d92-a241-b46b41082fed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58e88979f0ab45568754d85076562340', 'request_id': 'req-1cd16351-f675-4d92-a241-b46b41082fed'} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:24.335289 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1cd16351-f675-4d92-a241-b46b41082fed admin admin] The token cache is being invalidate because project 58e88979f0ab45568754d85076562340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81554) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 13 20:14:24.335576 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1cd16351-f675-4d92-a241-b46b41082fed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:24.336190 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG keystone.notifications [None req-1cd16351-f675-4d92-a241-b46b41082fed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81554) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 13 20:14:24.337644 dv-cinder-828807-6-smb devstack@keystone.service[81554]: [pid: 81554|app: 0|req: 1491/2944] 10.222.0.59 () {58 vars in 1233 bytes} [Tue Sep 13 20:14:24 2022] DELETE /identity/v3/projects/58e88979f0ab45568754d85076562340 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 13 20:14:33.888067 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=37,keystone:DELETE=2 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:14:34.332317 dv-cinder-828807-6-smb devstack@keystone.service[81554]: DEBUG dbcounter [-] [81554] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=81554) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 13 20:15:11.825465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8413a5-7dff-4da8-b0c5-d9eb873f29c0 service neutron] Authenticating user token {{(pid=81555) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 13 20:15:11.826933 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-da8413a5-7dff-4da8-b0c5-d9eb873f29c0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:15:11.897372 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8413a5-7dff-4da8-b0c5-d9eb873f29c0 service neutron] Validating token access rules against request {{(pid=81555) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 13 20:15:11.960749 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2066b4e-f8bc-4f77-b3ea-6e45df6fb2fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '89e7df5170c841abb449f3b4a547ec4d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ad67761fec0a430181877e216e90e7d4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81555) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 13 20:15:11.961346 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2066b4e-f8bc-4f77-b3ea-6e45df6fb2fe service placement] REQUEST_METHOD: `GET` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 13 20:15:11.961624 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2066b4e-f8bc-4f77-b3ea-6e45df6fb2fe service placement] SCRIPT_NAME: `/identity` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 13 20:15:11.961925 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2066b4e-f8bc-4f77-b3ea-6e45df6fb2fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81555) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 13 20:15:11.963639 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.fernet_utils [None req-a2066b4e-f8bc-4f77-b3ea-6e45df6fb2fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81555) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 13 20:15:11.974917 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2066b4e-f8bc-4f77-b3ea-6e45df6fb2fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 13 20:15:11.976465 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2066b4e-f8bc-4f77-b3ea-6e45df6fb2fe service placement] RBAC: Authorization granted {{(pid=81555) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 13 20:15:11.986776 dv-cinder-828807-6-smb devstack@keystone.service[81555]: [pid: 81555|app: 0|req: 1454/2945] 10.222.0.59 () {60 vars in 1365 bytes} [Tue Sep 13 20:15:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 13 20:15:21.981961 dv-cinder-828807-6-smb devstack@keystone.service[81555]: DEBUG dbcounter [-] [81555] Writing DB stats keystone:SELECT=58 {{(pid=81555) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}